About process_train.py

[tomtang110]

Hi ming

If you load the hotpot_dev_fullwiki_v1.json in your process_train.py, there is an error occuring.

[Sleepychord]

Hi, " hotpot_dev_fullwiki_v1.json" is not training data but validation data. This file is to process training data. Do not change the filename in the code.

[tomtang110]

Hi
I have run your code and evaluate it, but the result is weird, I am sure that I use the eval() function in hotpot_dev_fullwiki_v1.json. Could tell me what function you use to eval()?

[Sleepychord]

I think this problem can be solved by reading the evaluation codes, which is offered by HotpotQA dataset. It looks not relevant to CogQA. I am not sure about the exact reason.