Data

Tools

Indexes

Applications

Experiments

Repos

An open API service providing repository metadata for many open source software ecosystems.

GitHub topics: cl100kbase

tryAGI/Tiktoken

This project implements token calculation for OpenAI's gpt-4 and gpt-3.5-turbo model, specifically using `cl100k_base` encoding.

Language: C# - Size: 3.83 MB - Last synced at: 4 days ago - Pushed at: 4 days ago - Stars: 76 - Forks: 5

dmitry-brazhenko/SharpToken

SharpToken is a C# library for tokenizing natural language text. It's based on the tiktoken Python library and designed to be fast and accurate.

Language: C# - Size: 3.6 MB - Last synced at: 3 days ago - Pushed at: about 1 year ago - Stars: 235 - Forks: 16

danny50610/bpe-tokeniser

PHP port for openai/tiktoken (most)

Language: PHP - Size: 2.73 MB - Last synced at: 7 days ago - Pushed at: 10 months ago - Stars: 9 - Forks: 0

saschaschramm/chatgpt

Analysis of OpenAI's ChatGPT

Language: Jupyter Notebook - Size: 413 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 149 - Forks: 12

Related Keywords
cl100kbase 4 gpt-4 3 openai 3 tiktoken 3 chatgpt 2 csharp 2 gpt35turbo 2 tokenizer 2 chat-markup-language 1 gpt-35-turbo 1 gpt-35-turbo-0301 1 gpt-35-turbo-1106 1 gpt-35-turbo-16k-0613 1 gpt-4-0613 1 gpt-4-32k-0613 1 language-model 1 plugins 1 text-davinci-002-plugins 1 text-davinci-002-render 1 text-davinci-002-render-sha 1 chat 1 analysis 1 gpt-3 1 gpt 1 tokens 1 tiktoken-sharp 1 p50kbase 1 langchain-dotnet 1 langchain 1 gpt4 1 encoding 1 ai 1