'adam_m not found in checkpoint ' when further pretraining about electra

[clarkkev]

You should be able to do further training, just don't initialize the Adam parameters from the checkpoint by doing something like this. I don't think refreshing the Adam parameters will cause any real problem with the model.

[pnhuy]

I also had the same problem.

It seems that the adam_m parameter was removed from the checkpoint before saving. (google-research/bert#99 (comment))

So if we don't have the full checkpoint, we can't do further training.

Just waiting for the full checkpoint.

[w5688414]

I meet the same problem

Hello, I checked the solution @clarkkev mentioned above but still don't know the exact solution. Can anyone provide any further help? I am new to tensorflow and did not find anywhere skip the adam_m parameters from the link above. Thank you in advance.

[Veyronl]

I have the same trouble.Could you tell me how to fix it? @clarkkev @lincoln-jiang @w5688414 Thank you in advance.

[DayuanJiang]

@Veyronl I just gave up using Electra.