Question: How can I enable DeepSeek V4 Flash 0731 Max reasoning mode? #2474
Unanswered
BeCreatedP
asked this question in
Q&A
Replies: 1 comment
|
Thanks for the detailed report. |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Hi, thank you for adding DeepSeek V4 Flash 0731 and DSpark support in oMLX v0.5.4rc2.
I have a question about the reasoning-effort setting for this model.
In the model settings, the built-in
reasoning_effortselector currently provides:lowmediumhighDeepSeek V4 Flash 0731 also appears to have a Max reasoning mode in its official inference/encoding implementation.
What is the correct way to enable the official Max reasoning mode when running the model through oMLX?
For example, should I:
add a custom chat-template argument such as:
{ "enable_thinking": true, "reasoning_effort": "max" }use a particular system-prompt prefix;
modify the model’s tokenizer/chat-template configuration; or
use another supported setting?
I am not sure whether the current
highoption already maps to DeepSeek’s highest local reasoning mode, or whethermaxneeds to be selected separately.Environment:
I would appreciate clarification on the recommended configuration. Thank you.
All reactions