kaleidophon / token2index Goto Github PK
View Code? Open in Web Editor NEWA lightweight but powerful library to build token indices for NLP tasks, compatible with major Deep Learning frameworks like PyTorch and Tensorflow.
Home Page: http://token2index.readthedocs.io
License: GNU General Public License v3.0