Skip to content

Commit 96ffc5d

Browse files
committed
🤖 Document OpenAI Responses API limitation with /truncate
Clarifies that the /truncate command does not work with OpenAI models due to the Responses API's server-side conversation state management. Explains that OpenAI uses automatic truncation instead and provides workarounds for users (/clear, /compact, or relying on auto-truncation). _Generated with `cmux`_
1 parent b5d909c commit 96ffc5d

File tree

1 file changed

+15
-0
lines changed

1 file changed

+15
-0
lines changed

docs/context-management.md

Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -101,3 +101,18 @@ Remove oldest 50% of messages.
101101
- About as fast as `/clear`
102102
- `/truncate 100` is equivalent to `/clear`
103103
- **Irreversible** - messages are permanently removed
104+
105+
### OpenAI Responses API Limitation
106+
107+
⚠️ **`/truncate` does not work with OpenAI models** due to the Responses API architecture:
108+
109+
- OpenAI's Responses API stores conversation state server-side
110+
- Manual message deletion via `/truncate` doesn't affect the server-side state
111+
- Instead, OpenAI models use **automatic truncation** (`truncation: "auto"`)
112+
- When context exceeds the limit, the API automatically drops messages from the middle of the conversation
113+
114+
**Workarounds for OpenAI:**
115+
116+
- Use `/clear` to start a fresh conversation
117+
- Use `/compact` to intelligently summarize and reduce context
118+
- Rely on automatic truncation (enabled by default)

0 commit comments

Comments
 (0)