zhenjia2017 / exaqt Goto Github PK

Will it be possible to provide the evaluations of EXAQT on the train/test data?

I just noticed that data/dictionaries/train_subgraph.json contains only 6970 questions rather than 9708 as mentioned in the paper. Test and dev_subgraph contain the correct number of questions. However data/TimeQuestions/train.json does contain all 9708 questions.

Where can I obtain the answer graphs for the remaining train questions?

Thanks

Hi Zhen! I'm trying to reproduce your subgraph retrieval method for other datasets, but I encountered several problems.

1. I am confused about how you got the facts, i.e. SPO.txt. You mentioned CLOCQ in another issue. If I got you right, did you use CLOCQ to retrieve all facts of each grounded entity?
2. In the paper, an important step is to inject connectivity. In your implementation, however, (AFAIK) the steps of generating the connectivity file are not included. Did you also use CLOCQ's shortest path API to get the shortest path between each question nodes?
3. Further question regarding point 2: the assumption that 2 works is that you ground at least 2 entities from the question. So if you only linked one or less entity in the question, the method doesn't work at all, am I correct?

I'd really appreciate it if you could share how you made it. Thank you in advance :)

Hi, thanks for the interesting work

I'm assuming SPO.txt contains a processed subgraph around the topic entities present in a question. What format is it stored in? It doesn't seem to be any 'triple' format.

For eg., data/files/ques_100/SPO.txt contains lines like

Q30-ce1df58f8415808bf89804171507f9b0-pq:||corner#Q30#0.9792777100286615#nation||United States||P7295||P1365||Q11184||Julian calendar

How should I interpret these, and can I get back the WikiData subgraph corresponding to these facts?

Thanks

How to run Explicit, Implicit, Temp Ans., Ordinal's experimental data?

Hi,

Could you please share the background KG? It looks like you had a train_subgraph.json. Thanks a lot!

Best regards
Sirui

Hi Zhen

Did you have any luck in trying EXAQT on CronQuestions dataset (https://github.com/apoorvumang/CronKGQA)? If not, what kind of dataset processing do you think is needed to get EXAQT to work on CronQuestions?

Thanks
Apoorv