zminghua / sentencoding Goto Github PK

When execute the encode function, the following error occurs:

TypeError Traceback (most recent call last)
in
----> 1 m.encode(['123','456'], tokenize=True)

/apps/dataiku-data/jupyter-run/dku-workdirs/MARRIOTT/SentEncoding/master.py in encode(self, task_data, tokenize, use_norm)
261 for l in ds.keys():
262 numbatches = len(ds[l]) / self.conf['option']['encode_bs'] + 1
--> 263 for minibatch in range(numbatches):
264 caps = ds[l][minibatch::numbatches]
265

TypeError: 'float' object cannot be interpreted as an integer

Solved:
Cannot encode words outside dictionary.

Hello,

I went to the link http://yknzhu.wixsite.com/mbweb, however the BookCorpus dataset is no longer available. Could you let me know what other dataset we can use for training as it's showing me this error when I run run_train.py?

FileNotFoundError: [Errno 2] No such file or directory: '/content/SentEncoding/data/bookcorpus/books.vocab'

Thanks.