Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ban competitor / keywords #2121

Closed
Tracked by #2056
krrishdholakia opened this issue Feb 21, 2024 · 3 comments
Closed
Tracked by #2056

ban competitor / keywords #2121

krrishdholakia opened this issue Feb 21, 2024 · 3 comments

Comments

@krrishdholakia
Copy link
Contributor

krrishdholakia commented Feb 21, 2024

if we just allow a user to set a list of banned keywords, we can do quick checks during streaming for simple output moderation

this would be significantly faster than the user needing to set up an external api for just keyword checking.

@krrishdholakia
Copy link
Contributor Author

krrishdholakia commented Feb 22, 2024

Thinking

How would the user pass this?

Could be similar to how we do the other moderation stuff on proxy

litellm_settings: 
     banned_keywords: /path/to/banned_keywords.txt 

Expected format in .txt

competitor_1
competitor_2
banned_keyword_1
banned_keyword_2

@krrishdholakia
Copy link
Contributor Author

mounting files can be a pain, might be easier to start with just a list

litellm_settings: 
     banned_keywords: ["competitor_1", "competitor_2", "banned_keyword_1"]

@krrishdholakia
Copy link
Contributor Author

Closing as this is now live

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant