Skip to content

Unnecessary LLM call for unused message summary title #10749

@felipemadero

Description

@felipemadero

When a user sends a message, summarizeMessage makes an LLM call to generate a summary.title. This title is stored but never displayed anywhere in the UI.

This wastes an LLM call per user message, noticeable with local models.

Metadata

Metadata

Assignees

Labels

perfIndicates a performance issue or need for optimization

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions