Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add KSEM papers #52

Closed
RicardoUsbeck opened this issue Jul 25, 2022 · 9 comments
Closed

Add KSEM papers #52

RicardoUsbeck opened this issue Jul 25, 2022 · 9 comments

Comments

@xixi019
Copy link
Collaborator

xixi019 commented Aug 16, 2022

@RicardoUsbeck https://link.springer.com/chapter/10.1007/978-3-031-10983-6_39 This paper is only tested on SimpleQuestionFB2M. Me and Longquan has disagreement about whether to add this dataset to our leaderboard. Add: 1. This dataset is still valid dataset and a benchmark. Not: 1. This dataset is dependent on FB2M, which is no longer used.

@LongquanJiang
Copy link
Collaborator

Not:
2. it is a dataset for simple questions. few recent qa studies used it to evaluate their method.
3. For Simple QA systems, their performance already reached to 100%, it is impossible to have any further improvement on it.

@xixi019
Copy link
Collaborator

xixi019 commented Aug 16, 2022

@RicardoUsbeck
Copy link
Contributor Author

I am fine with not adding the FB2M results

@xixi019
Copy link
Collaborator

xixi019 commented Sep 21, 2022

Ok, then all 4 papers apart from https://link.springer.com/chapter/10.1007/978-3-031-10983-6_39 (dependant on FB2M) are added. We can close this issue now

@RicardoUsbeck
Copy link
Contributor Author

Link to merge pull?

@xixi019
Copy link
Collaborator

xixi019 commented Sep 21, 2022

@RicardoUsbeck
Copy link
Contributor Author

#61
#59

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants