Skip to content

Update harassment-abuse tag-consensus model penalty, update user enrollment, and re-tune diligence model#203

Merged
jbaxter merged 1 commit intomainfrom
jbaxter/2024_02_harassment_abuse
Feb 24, 2024
Merged

Update harassment-abuse tag-consensus model penalty, update user enrollment, and re-tune diligence model#203
jbaxter merged 1 commit intomainfrom
jbaxter/2024_02_harassment_abuse

Conversation

@jbaxter
Copy link
Copy Markdown
Collaborator

@jbaxter jbaxter commented Feb 24, 2024

  1. Raters who rate a note with a high harassment-abuse tag-consensus model note intercept will get an increased penalty to their raterAgreeRatio.
  2. Work in progress changes to user enrollment: treat earnedOutNoAcknowledge the same as earnedOutAcknowledged going forward, and start counting the number of times earned out going forward.
  3. Re-calibrate low diligence threshold so that it catches the same percent of notes prior to the harassment-abuse change.

1. Raters who rate a note with a high harassment-abuse tag-consensus model note intercept will get an increased penalty to their raterAgreeRatio.
2. Work in progress changes to user enrollment: treat earnedOutNoAcknowledge the same as earnedOutAcknowledged going forward, and start counting the number of times earned out going forward.
3. Re-calibrate low diligence threshold so that it catches the same percent of notes prior to the harassment-abuse change.
@jbaxter jbaxter merged commit c7db275 into main Feb 24, 2024
@jbaxter jbaxter deleted the jbaxter/2024_02_harassment_abuse branch June 27, 2024 23:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Development

Successfully merging this pull request may close these issues.

1 participant