This repository has been archived by the owner on Nov 3, 2023. It is now read-only.
[GenderBias] Add Controllable Gender Bias Task #3146
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
Your PR contains a change to a task. Please paste the results of the following command into a comment: python tests/datatests/test_new_tasks.py |
EricMichaelSmith
approved these changes
Oct 1, 2020
emilydinan
reviewed
Oct 2, 2020
| ====================== | ||
| Description: The task in this directory is not a task itself, but rather a wrapper. The task will flatten a specified other ParlAI task (that is, turn multi-turn episodes into single-turn examples), and append a control token that corresponds with the level of gender present in the label. If `--four-class` is specified as `True`, the control token will be one of the following: | ||
|
|
||
| - `f0m0` - no gender words in the label |
There was a problem hiding this comment.
would note which word lists were used to generate these labels
| type='bool', | ||
| default=True, | ||
| help='Use 4 class classification for gendered word list (f0m0/f0m1/f1m0/f1m1). ' | ||
| 'Set false to use 3-class classification (MALE/FEMALE/NEUTRAL)', |
There was a problem hiding this comment.
we've never used m/f/n so maybe let's get rid of this option
There was a problem hiding this comment.
will do - in that case @EricMichaelSmith make sure to update #3144 to remove the --four-class flag
emilydinan
approved these changes
Oct 5, 2020
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Patch description
Adds the
genderation_bias:controllable_tasktask, which, given an input task, flattens and classifies each label as having male, female, or neutral words, and subsequently adds a control token to indicate such.To use the teacher, simply run
parlai dd -t genderation_bias:controllable_task:<ORIGINAL_TASK>, and the teacher takes care of the rest!Testing steps
Tested with
parlai dd; I additionally included a test to ensure thatflatten_and_classify, the core of the teacher, works well.Logs