Replies: 1 comment
|
This sounds like the initial repository context is too broad. If the first prompt already fills ~70% of the context window, then compaction is almost guaranteed to be lossy. At that point the model is summarizing a lot of code before it has even understood the actual task, which is a good recipe for wrong assumptions and hallucinations. I would try to avoid loading the whole codebase into the first turn. The better pattern is usually:
A first prompt could be something like: If OmO has a configurable context/compaction threshold, it would be useful to expose that. But I think the bigger issue is not just the threshold; it is that compaction is happening before the model has a task-specific understanding of what matters. So I would look for settings around:
If those settings do not exist today, this feels like a good feature request: the first prompt on a large repo should not automatically trigger aggressive compaction. A safer default would be lazy context loading plus explicit warnings when the initial context is too large. |
Uh oh!
There was an error while loading. Please reload this page.
Hi everyone,
I'm running into a major bottleneck when starting a new session with a medium-to-large codebase.
On the very first instruction/prompt, the initial context ingestion immediately shoots up to around 70% capacity. Because it's so high, the model instantly triggers context compaction before it even begins executing the actual work. As a result, the model starts hallucinating right from the start of the session due to the aggressive compaction.
Any advice or workarounds would be highly appreciated!
All reactions