GitHub / burcgokden / BERT-Subword-Tokenizer-Wrapper
A framework for generating subword vocabulary from a tensorflow dataset and building custom BERT tokenizer models.
JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/burcgokden%2FBERT-Subword-Tokenizer-Wrapper
PURL: pkg:github/burcgokden/BERT-Subword-Tokenizer-Wrapper
Stars: 1
Forks: 0
Open issues: 0
License: apache-2.0
Language: Python
Size: 12.7 KB
Dependencies parsed at: Pending
Created at: about 4 years ago
Updated at: over 3 years ago
Pushed at: about 4 years ago
Last synced at: 6 months ago
Topics: bert, berttokenizer, deep-learning, machine-learning, machine-translation, subword, tensorflow, tensorflow-text, vocabulary-builder, wordpiece