Repository navigation
Numes × DSH: free models via local proxy with smart retries #13845
wwewtech
started this conversation in
Show Your Plugins!
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Just published v1.3.0 of
wwewtech/numes-deepseek-harness: an installable DSH bundle giving you genuinely$0-cost models in DSH through Numes's free tier.What it does in one line
An OpenAI-compatible local proxy (
127.0.0.1:8787/v1) routes DSH to Numes's:freeendpoints with hard zero-charge guards, never-give-up retries, and auto-discovery. One command installs the provider config.dsh plugin --profile desktop add github:wwewtech/numes-deepseek-harness node tools/numes-free-failover.mjs # → DSH shows 'Numes free (auto-failover)' in the model pickerFeatures
$0routing — every model id ends with:free; non-:freeids return 400 before any upstream traffic. Plusprovider.max_price {prompt:0,completion:0}stamped on every request as a defence-in-depth.5s→10s→15s→30s→1m→2m→5m→∞,Retry-Afteraware, smart abort on 401/402/403./statusdashboard — live chain, guard state, retry counters at a glance..mjsfile, Node 18+, nonpm install.Why I built it
Free model offers die silently. A working
:freeroute today can 404 tomorrow, and naive clients keep retrying the dead one. This proxy discovers new ones and walks the chain so DSH never stalls waiting for a model that no longer exists. Pair it with Numes's guarantee::freenever falls back to a paid endpoint; failed attempts cost nothing.What kind of project is this
Zero-dep single-file proxy you can read in 10 minutes. It's not a hosted service, not wrapped around a weird Numes integration. It uses DSH's built-in
llm-pi-aiadapter as the OpenAI-compatible route — you can copy the bundle patch and skip the proxy if you don't want the failover behavior.Have questions or wants more providers?
Discussion thread — wants for more Numes routes, integration with other free-pool marketplaces, or help running behind Tailscale/Docker.
All reactions