The NER results for 5 times runs about pure

[a3616001]

Hi Deming,

We used the predictions from NER models with different seeds. You can download ent_pred_test.json (BERT cross, W=300) here.

Best,
Zexuan

[YeDeming]

Thanks!

[YeDeming]

Hi Zexuan,

Due to the cuda memory limitation, I add the gradient accumulation to your code and try to run ALBERT with seed 0~4, but I get entity F1 as 89.71,89.93,89.53,89.93,90.18.

Could you share all the ent_pred_test.json for ALBERT (cross, W=100)? It is important for me to fairly compare with your RE method.

Thanks!

Best,
Deming

[a3616001]

Hi Deming,

I am not sure how you modified the code exactly. My runs are based on 4 GPUs without the gradient accumulation.

I have added all the ent_pred_test.json for ALBERT (cross, W=100) here.

Best,
Zexuan

[YeDeming]

Thanks for your rapid reply!

I will try to run with multiple GPUs.

Best,
Deming

[YeDeming]

Hi Zexuan,

Sorry to brother you again. Could you additionally share the ent_pred_test.json for SciERC?

Thanks!

Best,
Deming

[a3616001]

Hi Deming,

Sure! Please check here.

Best,
Zexuan

[YeDeming]

Thanks for your rapid reply!

Best,
Deming