scottyih / stagg Goto Github PK

Hi, I am learning this paper and finding its very worthy to understand the implement of it. Will you release the source code?
Thanks for your great work.

Hi,

Thank you for providing those valuable resources. In the STAGG paper, the authors claimed that S-MART was superior than Freebase Search API for topic entity linking. However, I compared the two tools in terms of recall@k scores on the WebQuestions test set and reached an opposite conclusion. Here are the results I got:

fb search api:
r@1: 0.857
r@2: 0.916
r@3: 0.932
r@10: 0.956

smart suggest api:
r@1: 0.818
r@2: 0.860
r@3: 0.876
r@10: 0.880

Could you please kindly take a look at this? I was using the dumped results of S-MART in this file webquestions.examples.test.e2e.top10.filter.sid.tsv.

Thank you very much!