Replies: 1 comment
|
Good news, most of this changed after you posted. In #649 custom models discovered on an endpoint are now seeded at the catalog median instead of landing at the bottom, with a real size label the router can actually score. On a fresh install with nothing to measure against they fall back to Medium tier and mid ranks. So they should no longer be stuck and unroutable. You can also override the numbers by hand. Open the model from the Models page and edit Intelligence rank and Speed rank in its settings. But.... there's a gap: the size label, which is what actually dominates routing, is still not editable from the dashboard. So if a custom model is genuinely frontier class you can nudge the ranks but you cannot promote its tier. That is a fair thing to want and I will look at it. Please open an issue if you need it urgently. If you are on an older build, updating should fix most of what you hit here. |
Uh oh!
There was an error while loading. Please reload this page.
For custom-added models—specifically those where the "smart dimension" score defaults to 0 and cannot be easily modified—the models remain stuck with a low score, making it difficult for them to be routed to.
All reactions