Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature]: Allow turning of request/response logging for langfuse/lunary/etc. #2586

Closed
krrishdholakia opened this issue Mar 19, 2024 · 1 comment
Assignees
Labels
enhancement New feature or request

Comments

@krrishdholakia
Copy link
Contributor

The Feature

Allow user to turn off logging the request / response when setting a callback

litellm.turn_off_message_logging = True 

Motivation, pitch

user request

Twitter / LinkedIn details

No response

@ishaan-jaff
Copy link
Contributor

ishaan-jaff commented Apr 27, 2024

This is done: #3330 @tjbck @Michelklingler @ianawilson

Here's how to enable it on the proxy: https://docs.litellm.ai/docs/proxy/logging#redacting-messages-response-content-from-langfuse-logging

model_list:
 - model_name: gpt-3.5-turbo
    litellm_params:
      model: gpt-3.5-turbo
litellm_settings:
  success_callback: ["langfuse"]
  turn_off_message_logging: True

@tjbck @Michelklingler @ianawilson curious, would you find it helpful if we managed your LiteLLM proxy deployment?

e.g. if it was available through aws marketplace

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants