Error in finetuning BLEURT about bleurt

[SaiKeshav]

The code works perfectly well for the previous checkpoint bleurt-base-128 but seems to fail for the latest checkpoint of BLEURT-20. So the error may be a result of some compatibility issues between the code and the newly trained model?

[tsellam]

Hi, thanks a lot for your feedback!
Unfortunately this is correct - the fine-tuning library does not work with the latest checkpoints, as it relies on BERT-specific code (BLEURT-20 uses RemBERT, not BERT). We will update the doc to reflect this.

[powerpuffpomelo]

Thanks for the great work!
I'm trying to finetune BLEURT-20 and encountering the same problem, wondering if this issue has been solved? Or where can I modify to fix it?
Any help would be appreciated~