scottyih / stagg Goto Github PK

Hi,

Thank you for providing those valuable resources. In the STAGG paper, the authors claimed that S-MART was superior than Freebase Search API for topic entity linking. However, I compared the two tools in terms of recall@k scores on the WebQuestions test set and reached an opposite conclusion. Here are the results I got:

fb search api:
r@1: 0.857
r@2: 0.916
r@3: 0.932
r@10: 0.956

smart suggest api:
r@1: 0.818
r@2: 0.860
r@3: 0.876
r@10: 0.880

Could you please kindly take a look at this? I was using the dumped results of S-MART in this file webquestions.examples.test.e2e.top10.filter.sid.tsv.

Thank you very much!

Hi, I am learning this paper and finding its very worthy to understand the implement of it. Will you release the source code?
Thanks for your great work.