KeyError: '[SEP]' about electra

[stefan-it]

Hi @elyesmanai, do you train with TPU?

Then thevocab.txt file needs to be stored on your Google Bucket, e.g. located under gs://<bucket-name>/vocab.txt (if you didn't change the path in configure_pretraining.py).

[elyesmanai]

hello, yes i'm using tpus and put everything in cloud bucket and still got that

[stefan-it]

Could you post the output of grep "\]$" vocab.txt or could you point to the vocab file that you've found in the repo?

I've already trained some models with own vocab and pre-training was always working 🤔

[elyesmanai]

the output has been humongous so I changed it to grep "\SEP]$" and I got this

[elyesmanai]

turns out I was not changing the link to the vocab which has to be done in the configure_pretrain.py file. changed it and it works