The code in parlai/mturk/
has been deprecated. All code for running crowdsourcing tasks can now be found in parlai/crowdsourcing/
, and all crowdsourcing tasks now utilize the Mephisto platform.
Instructions on how to find all old parlai/mturk/
code can be found in the sections below.
These folders can be restored by switching to the final_mturk
tag of ParlAI:
git checkout final_mturk
The current Mephisto-based version of the ACUTE-Eval task can be found in parlai.crowdsourcing.tasks.acute_eval
. The obsolete pre-Mephisto version of this task can be restored by switching to the acute_eval
tag of ParlAI:
git checkout acute_eval
You can restore this task by switching to the convai2archive
tag of ParlAI:
git checkout convai2archive
You can restore this task by switching to the
mturk_archive
tag of ParlAI:
git checkout mturk_archive
If you just need to read the code, for reference, you may browse it here.
The current Mephisto-based version of the human+model image-chat task can be found in parlai.crowdsourcing.tasks.model_chat
. The obsolete pre-Mephisto version of this task can be restored by switching to the v0.10.0
tag of ParlAI:
git checkout v0.10.0
You can restore this task by switching to the
mturk_archive
tag of ParlAI:
git checkout mturk_archive
If you just need to read the code, for reference, you may browse it here.
You can restore this task by switching to the
mturk_archive
tag of ParlAI:
git checkout mturk_archive
If you just need to read the code, for reference, you may browse it here.
You can restore this task by switching to the
mturk_archive
tag of ParlAI:
git checkout mturk_archive
If you just need to read the code, for reference, you may browse it here.
You can restore this task by switching to the v0.10.0
tag of ParlAI:
git checkout v0.10.0
The current Mephisto-based version of the QA data collection task can be found in parlai.crowdsourcing.tasks.qa_data_collection
. The obsolete pre-Mephisto version of this task can be restored by switching to the qa_data_collection
tag of ParlAI:
git checkout qa_data_collection
You can restore this task by switching to the qualification_flow_example
tag of ParlAI:
git checkout qualification_flow_example
You can restore this task by switching to the react_task_demo
tag of ParlAI:
git checkout react_task_demo
You can restore this task by switching to the
mturk_archive
tag of ParlAI:
git checkout mturk_archive
If you just need to read the code, for reference, you may browse it here.
The current Mephisto-based version of the turn annotations task can be found in parlai.crowdsourcing.tasks.model_chat
. The obsolete pre-Mephisto version of this task can be restored by switching to the turn_annotations
tag of ParlAI:
git checkout turn_annotations
You can restore this task by switching to the
mturk_archive
tag of ParlAI:
git checkout mturk_archive
If you just need to read the code, for reference, you may browse it here.