Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add Jigsaw Toxicity Classification to Full Benchmark #36

Open
epavlick opened this issue Aug 10, 2021 · 4 comments
Open

Add Jigsaw Toxicity Classification to Full Benchmark #36

epavlick opened this issue Aug 10, 2021 · 4 comments
Labels
social_impact Benchmark Tasks for Bias and Social Impact

Comments

@epavlick
Copy link
Contributor

No description provided.

@epavlick epavlick added the social_impact Benchmark Tasks for Bias and Social Impact label Aug 10, 2021
@trishalaneeraj
Copy link
Collaborator

I can do this one.

@oskarvanderwal
Copy link

@trishalaneeraj, do you need any help?

@aneveol
Copy link

aneveol commented Sep 1, 2021

@trishalaneeraj We are discussing how to contribute to this issue in the bias, fairness and social impact evaluation subgroup. It would be great to coordinate on this. We have an upcoming meeting Monday September 6 at 10 pm CET (details are in slack channel)

@oskarvanderwal
Copy link

@aneveol and I will work on making Jigsaw ready for the prompt evaluation:

  • Write prompts for the dataset.
  • Write evaluation code.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
social_impact Benchmark Tasks for Bias and Social Impact
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@epavlick @trishalaneeraj @aneveol @oskarvanderwal