You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This commit was created on GitHub.com and signed with GitHub’s verified signature.
Fixed
A valid 8,000-character context with 32 labels OOM-killed the published image on the production x86 compute pool (exit 137). Groups of four and even a single 8K label also OOM-killed the 2 GiB Apple Silicon container.
Score labels one at a time; keep the first and last 750 characters of longer inference text. The wire contract still accepts 8K and returns all supplied scores, with documented information-loss/latency trade-offs.
Add tests for long-context truncation and 32-label requests.
Verified
Local 2 CPU / 2 GiB Docker test: 8K input with 32 labels returned HTTP 200, all 32 scores, in ~16s without OOM.
Packaged image builds and seven adapter tests pass. Follow-up x86 staging validation is required before merging Infrastructure#82.