feat: Alerts on User Consumption

[flxwu]

Describe the feature you'd like to request

Model Inference costs are the main running expense of any LLM-driven app.

User Journey 0: I want to immediately mitigate my costs and avoid a big bill from my model provider.
User Journey 1: I want to notify/adjust pricing for users with high usage
User Journey 2: I want to ban/suspend users with abusive behaviour (Abuse Detection)

Describe the solution you'd like to see

• Slack Alert
• Email
• Webhook
• ...

Additional information

No response

Contribute

• Yes, I can implement this and raise a PR