Kaleidophon/token2index

A lightweight but powerful library to build token indices for NLP tasks, compatible with major Deep Learning frameworks like PyTorch and Tensorflow.

Language: Python - Size: 1.21 MB - Last synced at: 1 day ago - Pushed at: 5 months ago - Stars: 51 - Forks: 6