GitHub / bminixhofer / tokenkit

A toolkit implementing advanced methods to transfer models and model knowledge across tokenizers.

JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bminixhofer%2Ftokenkit
PURL: pkg:github/bminixhofer/tokenkit

Stars: 30
Forks: 4
Open issues: 2

License: apache-2.0
Language: Python
Size: 366 KB
Dependencies parsed at: Pending

Created at: 4 months ago
Updated at: about 1 month ago
Pushed at: about 1 month ago
Last synced at: about 1 month ago

Topics: distillation, jax, llms, machine-learning, tokenization, tokenizer-transfer, transfer-learning

Loading...