Skip to content

Latest commit

 

History

History
21 lines (13 loc) · 2.12 KB

File metadata and controls

21 lines (13 loc) · 2.12 KB
description
Gain real-time insights, track key metrics, and streamline debugging with our comprehensive observability suite.

Observability - Modern monitoring for LLMs

If you're working with an LLM - visibility across all your requests can be a BIG pain. How do you measure cost, latency, accuracy of your requests?

Portkey's observability features provide complete control over all your requests and Portkey's analytics dashboards provide the insights you're looking for. Fast.

Features

Logs

Portkey records all your multimodal requests and responses, making it easy to view, monitor and debug interactions.logs.md

Analytics

A comprehensive view of 21+ key metrics. Use it to analyse data, spot trends and make informed decisions.analytics.md

Tracing

Portkey supports request tracing to help you monitor your applications throughout the lifecycle of a request.traces.md

Filters

Streamline your data view with customizable filters. Zero in on data that matters most.filters.md

Custom Metadata

Enrich your LLM APIs with custom metadata. Assign unique tags for swift grouping and troubleshooting.metadata.md

Feedback

Add feedback values and weights to complete the loopfeedback.md

Budget Limits

Set up budget limits for your provider API keys and get confidence over your application's costs.budget-limits.md