v10.23.0

10.23.0 (2024-04-02)

Notice

• AI monitoring offers custom-built insights and tracing for the complete lifecycle of an LLM’s prompts and responses, from raw user input to repaired/polished responses. AI monitoring provides built-in integrations with popular LLMs and components of the AI development stack. This release provides instrumentation for AWS Bedrock. (a6f3364)
• New Relic AI monitoring is the industry’s first APM solution that provides end-to-end visibility for AI Large Language Model (LLM) applications. It enables end-to-end visibility into the key components of an AI LLM application. With AI monitoring, users can monitor, alert, and debug AI-powered applications for reliability, latency, performance, security and cost. AI monitoring also enables AI/LLM specific insights (metrics, events, logs and traces) which can easily integrate to build advanced guardrails for enterprise security, privacy and compliance. (a6f3364)
• When AI monitoring is enabled, the agent will now capture AI LLM related data. This data will be visible under a new APM tab called AI Responses. See our AI Monitoring documentation for more details. (a6f3364)

New features

• A new AI monitoring related public API method has been added - SetLlmTokenCountingCallback (a6f3364)
• Add auto-instrumentation for AWS Bedrock (a6f3364)
• deps: Updated Elastic.Clients.ElasticSearch instrumentation points to work with v8.12.1+ (453d15e)
• New configuration options are available specific to AI monitoring. (a6f3364)

Fixes

• Handle InvalidOperationException in StringsHelper.CleanUri() #2373 (#2374) (9f1a6af)