Skip to content

v1.0.0 — Security hardening, docs site, release close-out

Choose a tag to compare

View all tags
@hamidmatiny hamidmatiny released this 27 Jul 21:48
· 27 commits to main since this release
v1.0.0
0e1a457

[1.0.0] — 2026-07-26

Release hardening: security scans, docs site, coverage extensions, demo/case-study honesty docs. Tag: v1.0.0.

Phase 15 — Security hardening, docs site, and v1.0.0 release

Feature commit cba0197; tag v1.0.0 includes the follow-up changelog hash fix.

  • Trivy (CRITICAL, ignore-unfixed) + Syft SBOM on built images: bentoml, ray-serve, triton, triton-engine, vllm, vllm-engine, gateway, cost-exporter
  • Semgrep (p/python, p/golang) across serving/gateway/pipelines Python + Go
  • Coverage gate ≥65% extended to gateway/internal and observability/cost-exporter; exemptions documented in CONTRIBUTING + KNOWN_GAPS
  • MkDocs Material site wiring existing READMEs + ADRs 001–006 (make docs-serve)
  • docs/DEMO_SCRIPT.md, docs/CASE_STUDY.md, docs/KNOWN_GAPS.md (commands verified against the live CPU stack)

Phase commits (0–15)

Phase Commit Summary
0 bd92ee4 Foundations, model contract, CI skeleton
1 e8d1e88 Reference models and benchmark harness
2 c7f7a02 BentoML adapter
3 181c72c Ray Serve adapter
4 3e35d86 Triton adapter
5 54c5bb0 vLLM adapter
6 372dc19 KServe adapter
7 c5c4fdf GPU Operator, device plugin, MIG
8 ba466fc Kueue multi-tenant GPU scheduling
9 856277f Karpenter GPU autoscaling and checkpoint-resume
10 559203d SageMaker Pipelines, Endpoints, Model Registry
11 eece3f6 Bedrock-aware gateway adapter
12 cf0c480 Kubeflow Pipelines + Training Operator → KServe
13 3d83fe3 Routing gateway and benchmark-driven selection
14 04beccb Observability — tracing, metrics, cost dashboards
15 cba0197 Security hardening, docs site, v1.0.0 release

Phase 14 — Observability (tracing, metrics, cost dashboards) — 04beccb

  • observability/: Prometheus (:9008), Grafana (:9009), Tempo (:9010), OTel collector, Alertmanager, blackbox
  • OTel on gateway + bentoml/ray-serve/triton/vllm; scrapes existing phase-0 /metrics
  • Cost-exporter reuses benchmark + Bedrock pricing-reference; LIVE vs PLACEHOLDER GPU panels (ADR-002)

Phase 13 — Routing gateway — 3d83fe3

  • gateway/ on :9007; ADR-006; explainable fallback; SageMaker/KServe excluded without recorded data

Phase 12 — Kubeflow → KServe — cf0c480

  • KFP train→eval→register; Training Operator + KServe handoff; validate-only CI

Phase 11 — Bedrock adapter — eece3f6

  • bedrock-gateway/ + static pricing-reference.json; moto CI

Phase 10 — SageMaker — 559203d

  • Pipelines / Registry / Endpoint helpers; moto CI; manual runbook

Phase 9 — Karpenter + checkpointing — 856277f

  • Spot NodePools; SIGTERM checkpoint library; ADR-005

Phase 8 — Kueue — ba466fc

  • Multi-tenant GPU queues; ADR-004

Phase 7 — GPU Operator / MIG — c5c4fdf

  • Operator values, MIG profiles, terraform GPU EKS plan-only; ADR-003

Phase 6 — KServe — 372dc19

  • Helm InferenceServices wrapping Triton/vLLM; validate-only

Phase 5 — vLLM — 54c5bb0

  • Host :9004; LLM-only shim; CPU k6 artifact

Phase 4 — Triton — 3e35d86

  • Host :9003 shim + internal engine; ONNX model repo

Phase 3 — Ray Serve — 181c72c

  • Host :9002; both reference models

Phase 2 — BentoML — c7f7a02

  • Host ports 9000–9099 convention; :9000 adapter

Phase 1 — Models + benchmark — e8d1e88

  • GPT-2 + ResNet-18 pins; k6 harness; serving/common client + conformance

Phase 0 — Foundations — bd92ee4

  • Contract OpenAPI/JSON Schema; ADR-001/002; CI skeleton; CPU compose placeholder
Assets 2
Loading