Skip to content

v1.0.3

Choose a tag to compare

View all tags
@nvme101010 nvme101010 released this 12 Oct 18:26
· 211 commits to main since this release
v1.0.3
bf0cc5f
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Kubernetes polish. No sizing numbers change.

Deploy on Kubernetes

kubectl apply -k "https://github.com/nvme101010/LLM-Inference-Estimator//deploy/k8s?ref=v1.0.3"

What changed since 1.0.2

  • Readiness probe waits two seconds before its first check. Pods started so fast that the first probe hit before nginx bound its port, logging one harmless "connection refused" Warning event per pod. First verified on a real cluster (Docker Desktop, Kubernetes 1.36): both replicas Ready in about two seconds, running as uid 101 with a read-only root filesystem and two nginx workers.

Container: ghcr.io/nvme101010/llm-inference-estimator:1.0.3 (also 1.0 and latest), linux/amd64 and linux/arm64. Hosted page: https://nvme101010.github.io/LLM-Inference-Estimator/

Assets 2
Loading