GitHub / mlc-ai / tokenizers-cpp
Universal cross-platform tokenizers binding to HF and sentencepiece
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mlc-ai%2Ftokenizers-cpp
PURL: pkg:github/mlc-ai/tokenizers-cpp
Stars: 364
Forks: 91
Open issues: 23
License: apache-2.0
Language: C++
Size: 87.9 KB
Dependencies parsed at: Pending
Created at: about 2 years ago
Updated at: 7 days ago
Pushed at: about 1 month ago
Last synced at: 1 day ago
Loading...