Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clarification about the experiment setting in the paper #13

Closed
kerkathy opened this issue Mar 11, 2024 · 2 comments
Closed

Clarification about the experiment setting in the paper #13

kerkathy opened this issue Mar 11, 2024 · 2 comments

Comments

@kerkathy
Copy link

Hi, thanks for the work and I found the idea really interesting!

Since I wanted to make a reproduction of the experiments, I have a small question. To my knowledge, your method is to build the tree first and query the tree later. However, in the QuALITY dataset, there is one passage of around 5000 tokens for each question. In this case, do you build one tree for each question using the passage corresponding to that specific question?
Also, for the other datasets (NarrativeQA and QASPER), do you build a shared tree for all questions?

thanks again for your kind sharing!

@parthsarthi03
Copy link
Owner

Hi! Thanks for your interest in the work! To clarify, the tree-building process is passage-specific but question-independent. For each dataset, we build one tree per passage. Since each passage has multiple associated questions, the same tree is used to answer all questions for that passage.

@kerkathy
Copy link
Author

Thanks for your prompt and clear explanation 😄

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants