We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Implement a procedure to measure agreement of a classifier with the labeled ambiguous data. For that purpose:
Annotation
data.py
cv.py
The text was updated successfully, but these errors were encountered:
Input data format for labeled data can be viewed here:
https://kitt.cl.uzh.ch/kitt/mantracrowd/disambig/vote_results.csv?AgreementThr=0.6
where AgreementThr designates agreement threshold
AgreementThr
Sorry, something went wrong.
No branches or pull requests
Implement a procedure to measure agreement of a classifier with the labeled ambiguous data. For that purpose:
Annotation
class should be modified to store ambiguous data as welldata.py
to deserialize labeled ambiguous data (from MTurk or expert) to a list ofAnnotation
objects.cv.py
The text was updated successfully, but these errors were encountered: