Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add function to look for derogatory names in the data #107

Open
gregbunce opened this issue Sep 18, 2023 · 4 comments
Open

add function to look for derogatory names in the data #107

gregbunce opened this issue Sep 18, 2023 · 4 comments
Assignees

Comments

@gregbunce
Copy link
Member

gregbunce commented Sep 18, 2023

it would be helpful to have a function that looks through the data names and scans for derogatory names in the data - think trailheads, trail names, place names, etc.. This could be a good opportunity to leverage AI.

@gregbunce
Copy link
Member Author

FYI: we do have a derogatory name in the trailheads data - it's a former name. I'm working on this now to clean it up.

@gregbunce
Copy link
Member Author

a possible solution to look at:
https://github.com/surge-ai/profanity

@steveoh
Copy link
Member

steveoh commented Sep 19, 2023

I think we'd probably stick to gcp or maybe aws.

https://cloud.google.com/natural-language/docs/moderating-text

@gregbunce
Copy link
Member Author

Moving this FY25 Q1 and hopefully things will settle down a bit by then to make some progress on it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: No status
Development

No branches or pull requests

2 participants