Kaleidophon/token2index

A lightweight but powerful library to build token indices for NLP tasks, compatible with major Deep Learning frameworks like PyTorch and Tensorflow.

Language: Python - Size: 1.21 MB - Last synced at: 13 days ago - Pushed at: 6 months ago - Stars: 51 - Forks: 6