Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix rating parsing in RatingToArgillaMixin.to_argilla_record #227

Merged
merged 1 commit into from
Jan 9, 2024

Conversation

alvarobartt
Copy link
Member

Description

This PR solves a bug internally reported by @dvsrepo which was affecting the Argilla export of both the CritiqueTask and PreferenceTask when the max rating was equal or higher to 10, as those were not parsed into int and replaced with None instead. So on, this PR fixes that to pass the ratings_values over to the to_argilla_record within RatingToArgillaMixin so that the max rating value is calculated from it, as well as ensuring that the parsing to int is performed when the value is lower or equal to the max rating (before it was ignoring the equal ratings).

Kudos to @dvsrepo for reporting internally.

@alvarobartt alvarobartt added the fix label Jan 9, 2024
@alvarobartt alvarobartt added this to the 0.3.0 milestone Jan 9, 2024
@alvarobartt alvarobartt self-assigned this Jan 9, 2024
@gabrielmbmb gabrielmbmb merged commit 9d27b61 into main Jan 9, 2024
4 checks passed
@gabrielmbmb gabrielmbmb deleted the fix-ultrafeedback-export branch January 9, 2024 09:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants