Open
Description
Feature Request
👋 I joined the SIG call a few months back to discuss contributing a GenAI agent to the opentelemetry-demo. In the GenAI SIG, we have created some Semantic Conventions around LLM calls (prompts + responses, model parameters, metrics) and Agents.
I'd like to contribute a LangGraph based agent to showcase these conventions. I already have a self contained agent demo, that uses an ephemeral SQLite DB through a web chat interface as a kind of SQL playground.
Recap from the SIG discussion:
- the tricky part is accessing an LLM in the demo
- therefore we should make it an optional component
- it should support multiple LLM providers (OpenAI, GCP VertexAI, etc.) so no one is locked in
- we can explore running local LLM inference within the demo (e.g. vLLM, llama.cpp) but it will be more expensive. Some inference providers already have OpenTelemetry native instrumentation.
Additional Context
I will send a PR to kick off discussion!