Skip to content

Add k8s request fraction - #434

Merged
ibraheem-abe merged 7 commits into
stagingfrom
add-k8s-request-fraction
Jul 21, 2026
Merged

Add k8s request fraction#434
ibraheem-abe merged 7 commits into
stagingfrom
add-k8s-request-fraction

Conversation

@clementblaise

@clementblaise clementblaise commented Jul 21, 2026

Copy link
Copy Markdown
Collaborator

Changes

  • Fix Docker/K8s memory_mb semantics mismatch by making CPU/memory requests configurable fractions of task limits, allowing overcommit locally while keeping prod safety
  • Add CPU/memory requests to Kaniko build job containers
  • Fix orphaned eval pods surviving screener container restarts
  • Move blocking K8s exec/tar upload/download I/O off the event loop onto threads
  • Enlarge the default thread pool at startup to stop long-lived exec-stream threads from starving heartbeat/cancellation-check requests

@ibraheem-abe
ibraheem-abe merged commit caee945 into staging Jul 21, 2026
4 checks passed
@ibraheem-abe ibraheem-abe mentioned this pull request Jul 21, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants