Skip to content

jambu-gpu 0.2.0

Choose a tag to compare

@jgabriellima jgabriellima released this 26 Oct 00:45
· 19 commits to main since this release

GPUs that cannot keep billing, and a contract any application can integrate.

Lifecycle

  • The watchdog retries a failed stop (destroys after 30 min of failures), re-arms on every restart, and runs under a supervisor.
  • Inference traffic counts as activity; stopped instances are destroyed after lifecycle.stopped_ttl (default 24h).
  • gpu ls and gpu sweep (with a systemd timer) guard every project by its own rules and clean up orphans.
  • Failed setups always clean up; bad hosts are replaced automatically and remembered for a day.

Integration

  • The model endpoint now requires a key, generated per instance.
  • gpu --json setup / gpu env return base_url, api_key and model for any OpenAI SDK.
  • docs/INTEGRATION.md: commands, JSON, exit codes, lifecycle, recipes for TypeScript, Python and shell.
  • examples/typescript-client: a one-file helper that ensures the GPU and heals the connection after an idle stop.

Validated on real Vast.ai hardware: see docs/ACCEPTANCE.md.

pip install jambu-gpu==0.2.0