Observability with OpenTelemetry

[nirga]

Feature Description

Instrument apps built with the AI SDK with OpenTelemetry so that users can connect it to any observability tool they want - Datadog, Honeycomb, Traceloop, etc. and get full traces of their LLMs.

Use Case

Be able to debug prompts, completions as whole traces

Additional context

I'm the maintainer of OpenLLMetry where we built a set of extensions of OpenTelemetry for GenAI applications, supporting Python and Typescript.

[navkuun]

Hey @nirga currently trying to implement openLLMetry on my vercel ai sdk application, specifically I'm using vercels AI UI sdk and it doesn't seem to be logging the traces.

[nirga]

Hey @navkuun I'm curious to learn more. Are you on nextjs? Which version?

I'd try to do 2 things to debug it:

1. Changing log level to debug: https://www.traceloop.com/docs/openllmetry/configuration#control-logging
2. Manually instrumenting libraries: https://www.traceloop.com/docs/openllmetry/troubleshooting#3-ts-js-only-fix-known-instrumentation-issues

If you want, I'm also available on our community slack.