Repository navigation
Replies: 2 comments 5 replies
|
You do not need a PR. Start Studio with the local folder, then send hf download mayflowergmbh/Josev-2B --local-dir ~/models/josev-2b
UNSLOTH_SYSTEMONE_MODEL=~/models/josev-2b unsloth studio |
|
No PR needed. Besides the built-in entries in hf download mayflowergmbh/Josev-2B --local-dir "$HOME/.unsloth/studio/outputs/Josev-2B"The next time you open Settings → API, it is listed as Josev-2B under Decision API → Model, no restart needed. Pick it there and requests with
I checked the listing, the selection and the routing with Studio's backend test harness at that commit, on CPU-only Linux. Loading the weights needs a GPU, so that part is untested. A separate Decisions tab is a call for the maintainers, so a feature request issue is the place for that part. |

Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Hi! I'd like to use decision models available on Hugging Face, such as Josev-2B, rather than being limited to the models included in Unsloth's selector. I couldn't find documentation explaining how to add external decision models to what appears to be a built-in list. To clarify, I mean models trained with a decision head, not regular chat LLMs prompted to make decisions.
How can I add a model to the Decision API model list?
The training docs explain "Use in Decision API" after training, but how do I import an already published checkpoint? Does this require a PR to catalog.py or changes to laya_runtime.py?
Why is the Decision API tucked away under API settings?
For me personally a dedicated "Decisions" sidebar entry, like Audio or Image, would make more sense for downloading, selecting and testing these models.
That would also allow downloading a compatible decision model through the normal model browser and serve it through /v1/systemone. Like STT/TTS models downloaded in Audio tab, which already get their own inference workflow rather than being treated as chat models. Could decision models work similarly?
I've read the Decision API guide, but couldn't find the external-model import workflow. Am I missing something, or is this not supported yet?
To be clear: I am talking about UI/UX in Unsloth Studio.
All reactions