GitHub topics: cl100kbase
dmitry-brazhenko/SharpToken
SharpToken is a C# library for tokenizing natural language text. It's based on the tiktoken Python library and designed to be fast and accurate.
Language: C# - Size: 3.6 MB - Last synced at: 6 days ago - Pushed at: 11 months ago - Stars: 232 - Forks: 16
tryAGI/Tiktoken
This project implements token calculation for OpenAI's gpt-4 and gpt-3.5-turbo model, specifically using `cl100k_base` encoding.
Language: C# - Size: 3.82 MB - Last synced at: 15 days ago - Pushed at: 17 days ago - Stars: 75 - Forks: 4
danny50610/bpe-tokeniser
PHP port for openai/tiktoken (most)
Language: PHP - Size: 2.73 MB - Last synced at: 9 days ago - Pushed at: 8 months ago - Stars: 9 - Forks: 0
saschaschramm/chatgpt
Analysis of OpenAI's ChatGPT
Language: Jupyter Notebook - Size: 413 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 149 - Forks: 12
