Skip to content

Move metadata calculation out of client#10589

Merged
pakrym-oai merged 6 commits intomainfrom
pakrym/move-metadata-calculation-out-of-client
Feb 4, 2026
Merged

Move metadata calculation out of client#10589
pakrym-oai merged 6 commits intomainfrom
pakrym/move-metadata-calculation-out-of-client

Conversation

@pakrym-oai
Copy link
Collaborator

Model client shouldn't be responsible for this.

.unwrap_or(compact::SUMMARIZATION_PROMPT)
}

pub(crate) async fn resolve_turn_metadata_header(&self) -> Option<String> {
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should we have an async blocking function here? It runs on each turn, will add latency

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

added a timeout

@pakrym-oai pakrym-oai merged commit 56ebfff into main Feb 4, 2026
48 of 53 checks passed
@pakrym-oai pakrym-oai deleted the pakrym/move-metadata-calculation-out-of-client branch February 4, 2026 05:59
@github-actions github-actions bot locked and limited conversation to collaborators Feb 4, 2026
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants