GitHub / jonasknobloch / mbpe
Morphologically biased byte-pair encoding pre-tokenization
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/jonasknobloch%2Fmbpe
PURL: pkg:github/jonasknobloch/mbpe
Stars: 0
Forks: 0
Open issues: 0
License: mit
Language: Rust
Size: 136 KB
Dependencies parsed at: Pending
Created at: over 1 year ago
Updated at: 6 months ago
Pushed at: 9 months ago
Last synced at: 4 months ago
Commit Stats
Commits: 46
Authors: 1
Mean commits per author: 46.0
Development Distribution Score: 0.0
More commit stats: https://commits.ecosyste.ms/hosts/GitHub/repositories/jonasknobloch/mbpe
Topics: byte-pair-encoding, morphological-analysis, morphology, nlp, segmentation, tokenizer