Skip to content

InferenceFlow v0.2.0 — Hardened MVP and Live Showcase

Pre-release
Pre-release

Choose a tag to compare

View all tags
@manishklach manishklach released this 23 Oct 07:15
v0.2.0
76551f4
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

InferenceFlow v0.2.0 — Hardened MVP and live showcase

MVP prerelease, October 23, 2026. This release adds security and accounting fixes, a reproducible execution recording, and the complete source of the deployed Sites showcase.

Execution and recovery

  • Worker generations and active epochs prevent stale workers from completing reassigned work. Artifact identities must match the dispatch they settle.
  • Provider creation and watchdog reconciliation recover interrupted provisioning operations. Provisioning remains disabled by default and subject to explicit operator approval and cost caps.
  • Scheduler wallet locking uses bounded batches and skips locked tenants so one busy tenant does not block unrelated work.
  • Callback delivery runs in a separate process, claims durable work, and performs network requests outside database transactions.

Billing and security

  • Refunds cancel or freeze affected work and record uncovered balances in an explicit debt journal.
  • Session and API-key rate limits share database-backed counters across API processes.
  • Production configuration requires strong bootstrap, metrics, HMAC, and encryption secrets. Key rotation supports separate HMAC and versioned encryption keys.
  • Metrics require authentication; the dashboard proxy accepts only intended API routes.
  • Regression tests cover concurrency, tenant isolation, billing, worker failures, lifecycle management, and the audit fixes.

Recorded flow and hosted showcase

  • Seven actual browser captures show sign-in, reservation, queuing, execution, results, and settled billing.
  • The walkthrough includes SDK/JSONL evidence, integration diagrams, a screenshot player, and a reproducible isolated local runner.
  • Four completed mock requests and one cancellation settled at 124 microUSD, with zero remaining reservations/debt and no reconciliation drift. These are synthetic fixture rates and byte-based mock counts, not GPU measurements.
  • The responsive Sites showcase includes replay controls, screenshot navigation, Python/cURL examples, and downloadable evidence. Full source and hosting identity are under sites/inferenceflow/.
  • Hosted showcase currently has owner-private access. Public GitHub visibility does not change its audience. The Site is a static product demonstration; backend services have their own deployment.

Validation

  • Python regression suite: 56 passed; one real-GPU test skipped.
  • Ruff and mypy passed; Next.js production build passed.
  • GitHub CI runs the suite against PostgreSQL 16, lint/type checks, and the dashboard build.
  • Desktop/mobile showcase checks covered both billing replay presets, screenshot dialog, code tabs/copy, navigation, and viewport overflow.
  • Docker Compose configuration validated. The current Windows Docker daemon was unavailable; the historical v0.1.0 Docker run is documented separately and is not evidence for this release's full container execution.

Upgrade and run

  1. Back up PostgreSQL and review .env.example, docs/security.md, and docs/ops.md before upgrading.
  2. Stop API, scheduler, worker, callback, and provider processes for a coordinated upgrade. Apply migrations through 0005 using alembic upgrade head (or the API container equivalent).
  3. Configure the required production secrets and key versions. Start the separate callback process along with the API, scheduler, and workers; use the supplied Compose topology and operations guide.
  4. Reconcile balances and verify readiness before accepting traffic. Use mock mode and seeded funds for local development.

For a fresh local platform, follow the root README's Docker quickstart. For the static Site only, run python -m http.server 8093 --bind 127.0.0.1 --directory sites/inferenceflow/dist from the repository root.

External validation still required

Rented NVIDIA GPU/vLLM execution, provider account provisioning, Stripe test-account Checkout/webhooks, and real OIDC flows require external infrastructure or credentials and have not been validated end to end. No paid capacity was provisioned and no real payment credentials were used. AMD and further cloud providers remain extension points. This prerelease does not establish production readiness or GPU performance claims.

The release source archives include the entire platform. The additional showcase ZIP contains the static Site, safe recorded evidence, and hosting metadata; it contains no runtime environment files or credentials.

Assets 3
Loading