Add new dataset from bot adversarial dialog task #3190
Conversation
Your PR contains a change to a task. Please paste the results of the following command into a comment: python tests/datatests/test_new_tasks.py |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
nice, @jxmsML ! we will also need a projects folder as we link to it in the paper.
@@ -0,0 +1,16 @@ | |||
Task: Bot-Adversarial Dialogue Dataset | |||
=========================== | |||
Description: Dialogue datasets labeled with offensiveness from Bot-Adversarial Dialogue task |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can you add a placeholder here for adding the arxiv link for when the paper appears on arxiv? Can you also link to the projects folder?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
and also change the name of the techer
|
||
import unittest | ||
|
||
import parlai.utils.testing as testing_utils |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
nice tests!
lgtm, deferring to emily |
from parlai.core.build_data import download_models | ||
|
||
|
||
def download(datapath): |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
nice thanks jing
Patch description
Testing steps
parlai dd -t bot_adversarial_dialogue
parlai dd -t bot_adversarial_dialogue:HumanSafetyEvaluation
parlai eval_model -t bot_adversarial_dialogue:bad_num_turns=4 -dt test -mf zoo:bot_adversarial_dialogue/multi_turn/model -bs 128
parlai eval_model -t bot_adversarial_dialogue:bad_num_turns=4 -dt test -mf zoo:bot_adversarial_dialogue/multi_turn_v0/model -bs 128
Logs
Other information
Data tests (if applicable)
If you added a new teacher, you will be asked to run
python tests/datatests/test_new_tasks.py
. Please paste this log here.