OpenBroker - broker for brokers or Devshards as a service. #1363
gonkalabs
started this conversation in
Show and Tell
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hey! Gonka Labs here.
We've just shipped OpenBroker, a platform that gives you direct access to gonka inference - pure devshards v1, v2 (and any future version) under wallet that is whitelisted to operate escrows. You get escrow capacity that scales elastically with your load, both devshard versions (and any future one), and throughput limited only by what the network itself can handle.
With OpenBroker - we make a community commitment to the overall observability and monitoring (Protocol-grade observability).
OpenBroker doubles as a live testbed where new devshard versions get exercised at production scale before they reach the wider network, and the observanility metrics we collect goes straight back to the protocol's contributors that we in-touch with to keep improving Gonka.
Full observability means that per-request metrics, public network stats and QOL inference metrics - are part of the product, not an afterthought. We work directly with the protocol's contributors to feed back the statistics, failure modes and performance data we see at real scale, so Gonka keeps getting better. It's also the environment where new devshard versions get shaken out at production load before they ship to everyone. If you've been using
node4to prototype or create your own Broker business and test against Gonka, OpenBroker is the next logical step and same "just hit an endpoint and go" experience, no diffrence (except that you can enroll and get access right away) - with bigger capacity, real telemetry, and both protocol versions available out of the box, all in a managed environment.The problem
Running inference on Gonka today means either:
node4node4 (whitelisted, rate-limited, built for demos not production), orSo, if you want to become a broker, you need to get whitelisted for escrow operations or get broker key and connect to node4.
Either way makes it very hard for new brokers to start operating, raising the bar and lowering potential inference demand.
The Solution
OpenBroker is "a few devshard containers (v1, v2) + many escrows" system that sits in front of the Gonka network and exposes a plain devshard infra with our whitelisted wallet. Just as inteded to be used by brokers, but without need to whitelist a wallet or enroll to get a broker key.
From the broker's side:
Register at https://openbroker.gonka.gg/register - email, org name, your
gonka1…wallet.Deposit GNK to your generated address (activation kicks in at 100 GNK).
Grab your API key (
obk-*) from the dashboard.Point any OpenAI client at:
That's it.
/v1/chat/completions,/v1/models, streaming + non-streaming, no rate limits, pure devshards.What you get
Scale we've tested
We've load-tested OpenBroker past 1,000,000,000 (1 billion) tokens in a single run (a little over 1 hour total test run time) across Qwen, MiniMax and Kimi models - no node4 fallback, escrows auto-rotating, v1/v2 traffic split live. Production-grade throughput is the goal.
Links
Would love feedback, feature requests, and bug reports. If you build something on top of OpenBroker, drop it in this thread 🙌
Beta Was this translation helpful? Give feedback.
All reactions