Add state handlers / observability

[krrishdholakia]

When I call litellm there's always just 2 things I need to know - did the query succeed or fail?

If it succeeds I'll log it to PostHog

If it fails I'll log it to PostHog + Slack

Wonder if litellm can help simplify this for me.

[krrishdholakia]

Analytics.js has callbacks -> maybe having them as success_callback and failure_callback

Alt idea:

from litellm import completion_client
completion = completion_client(success_callback=["posthog"], failure_callback=["posthog","slack"]) 

response = completion(model="gpt-3.5-turbo", messages=messages)

[krrishdholakia]

Sketching this idea out a bit more - enabling custom functions as well

Use Case: I want to create a unified pricing dashboard on top of this. For that I need to know when it worked/didn't work - when it works -> i'm calculating the number of tokens used for input/output and then sending that data to my supabase table.

from litellm import completion_client
completion = completion_client(success_callback=["posthog"], failure_callback=["posthog","slack"]) 

def success_handler():
   print("it worked!")

def failure_handler():
   print("error occurred")

response = completion(model="gpt-3.5-turbo", messages=messages, success_callback_fn=success_handler, failure_callback_fn=failure_handler)

[krrishdholakia]

closing as this has been implemented.

https://litellm.readthedocs.io/en/latest/advanced/