cobanov/turkish-bpe-tokenizer

Byte Pair Encoding (BPE) tokenizer tailored for the Turkish language

Language: Python - Size: 8.79 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 1 - Forks: 0