Skip to content
This repository has been archived by the owner on Nov 3, 2023. It is now read-only.

Modelchat worker qual #4956

Merged
merged 11 commits into from Feb 24, 2023
Merged

Modelchat worker qual #4956

merged 11 commits into from Feb 24, 2023

Conversation

mojtaba-komeili
Copy link
Contributor

Patch description

  • Added allow list qualification to the model chat

@klshuster
Copy link
Contributor

probably good to have @EricMichaelSmith's review here but it all looks good to me

Copy link
Contributor

@EricMichaelSmith EricMichaelSmith left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Wow, we've had blocklisting forever but not allowlisting, great to have! Minor comments

parlai/crowdsourcing/tasks/model_chat/README.md Outdated Show resolved Hide resolved
parlai/crowdsourcing/tasks/model_chat/impl.py Outdated Show resolved Hide resolved
@@ -47,7 +50,17 @@ def run_task(cfg: DictConfig, task_directory: str, world_module=None):
soft_block_mturk_workers(cfg=cfg, db=db, soft_block_qual_name=soft_block_qual_name)

# Init
shared_state = SharedModelChatTaskState(world_module=world_module)
if cfg.mephisto.blueprint.allowed_worker_qualification is not None:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we add a TODO to bubble this functionality up to all ParlAI Mephisto tasks in the future?

@mojtaba-komeili
Copy link
Contributor Author

Thanks for the comments @EricMichaelSmith. Good suggestion for moving the functionality up to the parent. I added the TODO for now to avoid the potential unintended effects. But we can come back to it later.

@mojtaba-komeili mojtaba-komeili merged commit f6c9d04 into main Feb 24, 2023
@mojtaba-komeili mojtaba-komeili deleted the modelchat-worker-qual branch February 24, 2023 21:08
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants