Skip to content

Conversation

@jif-oai
Copy link
Collaborator

@jif-oai jif-oai commented Dec 1, 2025

Add a warning message as a user turn to the model if the model does not behave as expected (here, for example, if the model opens too many unified_exec sessions)

pub(crate) const MAX_UNIFIED_EXEC_SESSIONS: usize = 64;

// Send a warning message to the models when it reaches this number of sessions.
pub(crate) const WARNING_UNIFIED_EXEC_SESSIONS: usize = 60;
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Shouldn't we use MAX_UNIFIED_EXEC_SESSIONS? or something relative to it?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We want something slightly lower on purpose. To avoid having to prune

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's use it relative to it at least so we have only one magic number?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Then we need a relative factor so same thing. I kind of like the idea of soft and hard limits

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I need to merge to move on but happy to discuss this mater further and I can do a follow-up PR if you don't agree

@jif-oai jif-oai merged commit 9ee855e into main Dec 2, 2025
26 checks passed
@jif-oai jif-oai deleted the jif/warning-message branch December 2, 2025 11:56
@github-actions github-actions bot locked and limited conversation to collaborators Dec 2, 2025
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants