GitHub / huggingface / tokenizers
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/huggingface%2Ftokenizers
Stars: 9,605
Forks: 883
Open issues: 89
License: apache-2.0
Language: Rust
Size: 10.2 MB
Dependencies parsed at: Pending
Created at: over 5 years ago
Updated at: 1 day ago
Pushed at: 4 days ago
Last synced at: 1 day ago
Commit Stats
Commits: 1729
Authors: 112
Mean commits per author: 15.44
Development Distribution Score: 0.46
More commit stats: https://commits.ecosyste.ms/hosts/GitHub/repositories/huggingface/tokenizers
Topics: bert, gpt, language-model, natural-language-processing, natural-language-understanding, nlp, transformers