Automatically disable thinking during context compression #6510
gillbilliee
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Add an option to automatically disable model thinking/reasoning when performing context compression. Models such as Qwen can consume the available thinking budget during compression without producing useful output, wasting tokens and increasing compression time. Compression should therefore default to thinking: off, independently of the model's normal reasoning setting.
All reactions