Repository navigation
jambu-gpu 0.2.0
GPUs that cannot keep billing, and a contract any application can integrate.
Lifecycle
- The watchdog retries a failed stop (destroys after 30 min of failures), re-arms on every restart, and runs under a supervisor.
- Inference traffic counts as activity; stopped instances are destroyed after
lifecycle.stopped_ttl(default 24h). gpu lsandgpu sweep(with a systemd timer) guard every project by its own rules and clean up orphans.- Failed setups always clean up; bad hosts are replaced automatically and remembered for a day.
Integration
- The model endpoint now requires a key, generated per instance.
gpu --json setup/gpu envreturnbase_url,api_keyandmodelfor any OpenAI SDK.- docs/INTEGRATION.md: commands, JSON, exit codes, lifecycle, recipes for TypeScript, Python and shell.
- examples/typescript-client: a one-file helper that ensures the GPU and heals the connection after an idle stop.
Validated on real Vast.ai hardware: see docs/ACCEPTANCE.md.
pip install jambu-gpu==0.2.0