GitHub / huggingface / tokenizers
💥 Fast State-of-the-Art Tokenizers optimized for Research and Production
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/huggingface%2Ftokenizers
Stars: 9,713
Forks: 903
Open issues: 104
License: apache-2.0
Language: Rust
Size: 10.2 MB
Dependencies parsed at: Pending
Created at: over 5 years ago
Updated at: 9 days ago
Pushed at: about 2 months ago
Last synced at: 9 days ago
Commit Stats
Commits: 1729
Authors: 112
Mean commits per author: 15.44
Development Distribution Score: 0.46
More commit stats: https://commits.ecosyste.ms/hosts/GitHub/repositories/huggingface/tokenizers
Topics: bert, gpt, language-model, natural-language-processing, natural-language-understanding, nlp, transformers