-
Notifications
You must be signed in to change notification settings - Fork 6.6k
feat: add warning message for the model #7445
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
| pub(crate) const MAX_UNIFIED_EXEC_SESSIONS: usize = 64; | ||
|
|
||
| // Send a warning message to the models when it reaches this number of sessions. | ||
| pub(crate) const WARNING_UNIFIED_EXEC_SESSIONS: usize = 60; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Shouldn't we use MAX_UNIFIED_EXEC_SESSIONS? or something relative to it?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We want something slightly lower on purpose. To avoid having to prune
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Let's use it relative to it at least so we have only one magic number?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Then we need a relative factor so same thing. I kind of like the idea of soft and hard limits
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I need to merge to move on but happy to discuss this mater further and I can do a follow-up PR if you don't agree
# Conflicts: # codex-rs/core/src/features.rs
Add a warning message as a user turn to the model if the model does not behave as expected (here, for example, if the model opens too many
unified_execsessions)