You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Missing results causes AssertionError: Qrels and Run query ids do not match
You should make check_keys optional in evaluate because sometimes queries do not return any results for lexical-based systems.
Hi, I've added the make_comparable function to Run in v0.3.7.
run.make_comparable(qrels)
The run will be modified based on the qrels passed as an argument.
Query results not appearing in qrels will be removed from run to avoid unpredictable behavior or other bugs.
For convenience, I also added the boolean parameter make_comparable to evaluate and compare (it defaults to False).
Please, consider giving ranx a star if you like it.
Missing results causes AssertionError: Qrels and Run query ids do not match
You should make
check_keys
optional in evaluate because sometimes queries do not return any results for lexical-based systems.ranx/ranx/meta/evaluate.py
Line 128 in da0aa52
The text was updated successfully, but these errors were encountered: