basal-rs v0.1.12

Batch and Files API

• Add optional durable /v1/batches and /v1/files for native /v1/basal JSONL requests, with cancellation, partial results, recovery and a best-effort 24-hour expiry window.
• Keep standard /v1/basal and /v1/systemone traffic ahead of background work. System One is not yet a batch record format.
• Support SQLite locally and PostgreSQL, SQL Server or MongoDB for production metadata, with filesystem/S3 artifacts, bearer tokens and owner quotas.
• Add shared optional database: configuration, controlled automatic migrations and administration commands.

Native SDK support

Python, TypeScript/JavaScript and C# SDK 0.4.0, and Rust SDK 0.5.0, add uploads/downloads and full batch lifecycle operations, including idempotency keys and retention. SDK packages are versioned and published independently.

Getting started and limits

Batch setup · Database configuration · SDK examples

The feature is disabled by default. Enabling the API does not automatically enable background GPU inference: configure an explicit measured per-model batch_profile. Existing measurements cover the documented mini CUDA f16 solo scenarios, not every model, workload or multi-GPU topology. Online traffic may starve a batch until it expires. See the reports and documentation for qualification limits.