Skip to content

Surface Errors on Tool/LLM Spans in VercelAI SDK Integration #16748

Open
vercel/ai
#7033
@matejminar

Description

@matejminar

Description

We've noticed in the new Agent Monitoring that if there's an error thrown inside the execute tool span it's not visible in the UI.
We'd like to display some indicator on span itself (fire icon) + ideally link to sentry issue.

We also need a way to plot these errored spans on a chart so something like span.status:error would be helpful because it enables both usecases. But open to suggestions here.

Same goes for llm calls (e.g generate_text span). We need to validate if provider returns an error (like wrong model, quota exceeded, rate limited, etc.) this needs to be similarly surfaced on the span so that we can take action in UI.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions