Replies: 1 comment
|
Short answer: compaction itself does not strip thinking — its input is the verbatim derived messages of the shadowed region, so reasoning survives into the summarization call if and only if your adapter persisted it as message content. The official DeepSeek adapter does exactly that; the gap you're seeing is almost certainly in the local Qwen adapter, so that's where to look. Evidence, all against HEAD (v0.1.6-alpha.2):
What to check in your adapter (adapter-specific, not verified here):
If thinking is dropped at ingest, the fix belongs in the adapter (persist reasoning into assistant message content) — there's no compaction-side switch that can recover thinking that was never stored. Paste a snippet of one |
Uh oh!
There was an error while loading. Please reload this page.
The fundamental issue I am having right now is when using Qwen3.8 27b, which is a model that tends to think a LOT, and in fact most of its useful output is done in thinking, Deepseek Harness only compacts the actual "output" tokens, which leads to it missing a lot of context, and ends up having it redo things it has already done in thinking. A good example is file generation, the model will build files through thinking and then add them to the directory but not necessarily comment on them in the output tokens. This leads to the compaction acting as if they never existed in the first place. If there is a general fix to this I would be happy to hear suggestions.
All reactions