GitHub / cobanov / turkish-bpe-tokenizer

Byte Pair Encoding (BPE) tokenizer tailored for the Turkish language

JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/cobanov%2Fturkish-bpe-tokenizer
PURL: pkg:github/cobanov/turkish-bpe-tokenizer

Stars: 1
Forks: 0
Open issues: 0

License: mit
Language: Python
Size: 8.79 KB
Dependencies parsed at: Pending

Created at: 8 months ago
Updated at: 8 months ago
Pushed at: 8 months ago
Last synced at: 8 months ago

Topics: bpe, tokenizer, tokenizers, turkish, turkish-tokenization

Loading...