Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

User should not be able to run an unsupported test type for a particular task (ie: swap_entities for question-answering) #358

Closed
luca-martial opened this issue Apr 28, 2023 · 0 comments · Fixed by #378
Assignees
Labels
💡Enhancements Something can be improved

Comments

@luca-martial
Copy link
Contributor

swap_entities is only valid when testing NER. As we are adding support for more and more tasks (question-answering, summarization), it becomes more and more important to add some kind of check to make sure the user does not try to run an unsupported test type on a certain task (like question-answering). The solution does not necessarily have to be a check, it could be something more efficient if you can think of a solution

@luca-martial luca-martial added the 💡Enhancements Something can be improved label Apr 28, 2023
@luca-martial luca-martial linked a pull request May 5, 2023 that will close this issue
4 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
💡Enhancements Something can be improved
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants