Skip to content

Releases: nebari-dev/llm-serving-pack

nebari-llm-serving-0.1.4

Choose a tag to compare

What's Changed

Other Changes

  • Frontend patching by @jbouder in #167
  • fix(frontend): derive primary/ring shades so branding overrides propagate by @jbouder in #169
  • fix: stop wiping API-key metadata ConfigMap on LLMModel reconcile by @jbouder in #166
  • feat: set generous request timeouts on LLMModel gateway routes by @jbouder in #168

Full Changelog: nebari-llm-serving-0.1.3...nebari-llm-serving-0.1.4

nebari-llm-serving-0.1.3

Choose a tag to compare

What's Changed

Other Changes

  • docs: surface PassthroughModel and make examples runnable and drift-proof by @dcmcand in #138
  • docs: address #137 follow-ups (helm install, key-manager API, anchors, gpu-operator note) by @dcmcand in #142
  • fix(operator): make per-model API-key auth work end-to-end on AI Gateway v0.5 (#116) by @dcmcand in #117
  • Branding Support by @jbouder in #145
  • fix(frontend): restore data:image URIs in sanitizeUrl by @jbouder in #146
  • chore(frontend): migrate to the renamed @base-ui/react package by @jbouder in #149
  • ci: enable artifact signing (grant id-token/attestations to reusable-workflow callers) by @dcmcand in #144
  • chore: enable Dependabot for npm and GitHub Actions by @jbouder in #153
  • fix(ci): pre-empt the Dependabot failures seen in provenance-collector by @jbouder in #160
  • build(deps): bump the patch-and-minor group across 1 directory with 15 updates by @dependabot[bot] in #156
  • build(deps): bump the github-actions group across 1 directory with 3 updates by @dependabot[bot] in #154
  • build(deps): bump the patch-and-minor group across 1 directory with 7 updates by @dependabot[bot] in #155
  • build(deps-dev): bump jsdom from 29.1.1 to 30.0.1 in /frontend by @dependabot[bot] in #157
  • build(deps-dev): bump @testing-library/jest-dom from 6.9.1 to 7.0.0 in /frontend by @dependabot[bot] in #158
  • build(deps-dev): bump vite from 7.3.5 to 8.2.0 in /frontend by @dependabot[bot] in #161
  • feat: adopt the Nebari Design registry header and theme hook by @jbouder in #165

New Contributors

Full Changelog: nebari-llm-serving-0.1.2...nebari-llm-serving-0.1.3

nebari-llm-serving-0.1.2

Choose a tag to compare

@github-actions github-actions released this 15 Jul 21:40
9fb01eb

What's Changed

Other Changes

  • ci: adopt shared reusable release workflows + pin-at-release OCI publishing by @dcmcand in #139
  • ci: forward QUAY_USERNAME secret to the build workflow by @dcmcand in #140
  • chore(release): 0.1.2 by @dcmcand in #141

Full Changelog: v0.1.1...nebari-llm-serving-0.1.2

v0.1.1

Choose a tag to compare

@dcmcand dcmcand released this 13 Jul 12:52
07592f9

What's Changed

  • Define LLMModel CRD types and generate manifests by @dcmcand in #17
  • Add common helpers for slug generation, labels, naming by @dcmcand in #18
  • Implement validating webhook for LLMModel by @dcmcand in #19
  • Update CRD types: add access.public, replace raw JSON overrides by @dcmcand in #20
  • Add OperatorConfig with env var parsing by @dcmcand in #21
  • Implement storage reconciler (PVC, init container with lock file, OCI) by @dcmcand in #22
  • Implement model service reconciler (Deployment, Service, SA, PodMonitor) by @dcmcand in #23
  • Implement NetworkPolicy reconciler (default-deny, allow Gateway/EPP/Prometheus) by @dcmcand in #24
  • Implement InferencePool + EPP reconciler by @dcmcand in #25
  • Implement routing reconciler (AIGatewayRoutes for external + internal) by @dcmcand in #26
  • Implement auth reconciler (SecurityPolicies, API key Secret, ReferenceGrant) by @dcmcand in #27
  • Implement main LLMModel controller orchestrating all reconcilers by @dcmcand in #28
  • Scaffold key manager with LLMModel watcher by @dcmcand in #32
  • Implement API key CRUD via K8s Secrets and ConfigMaps by @dcmcand in #33
  • Implement auth middleware for key manager by @dcmcand in #34
  • Implement key manager HTTP API handlers by @dcmcand in #35
  • Implement periodic key audit for group membership changes by @dcmcand in #36
  • Add web UI, wire main.go, create Dockerfiles by @dcmcand in #37
  • Add Helm chart with operator and key manager templates by @dcmcand in #38
  • Add dev environment, CI workflows, and getting started guide by @dcmcand in #39
  • Fix EPP crash by supplying EndpointPickerConfig by @dcmcand in #45
  • Enforce model group access on internal JWT endpoint by @dcmcand in #47
  • Add NebariApp route and landing-page tile for key-manager UI by @dcmcand in #46
  • fix(#59): collapse pack into a single namespace by @dcmcand in #60
  • fix(#61): use Keycloak JWKS path for internal SecurityPolicy by @dcmcand in #62
  • fix(#57,#58): sanitize username for k8s data keys; log handler errors by @dcmcand in #63
  • chart+docs: default keyManager.nebariApp.routing and add production install runbook by @dcmcand in #71
  • fix(#64): disambiguate external and internal HTTPRoutes by Host header by @dcmcand in #70
  • chore(release): cut v0.1.0-alpha.2 by @dcmcand in #72
  • feat(alpha.3): shared-hostname routing + operator-owned TLS cert and Gateway listeners by @dcmcand in #73
  • fix(alpha.4): scope per-model AIGatewayRoute to shared hostname by @dcmcand in #74
  • fix(alpha.5): pin per-model AIGatewayRoute to shared-listener sectionName by @dcmcand in #75
  • fix(alpha.6): narrow InferencePool selector to exclude EPP pod by @dcmcand in #76
  • fix(alpha.7): pass --served-model-name to vLLM by @dcmcand in #77
  • docs: rewrite install-production runbook from fresh-install validation by @dcmcand in #83
  • Update copyright year and owner in LICENSE file by @viniciusdc in #97
  • Enhance UI for Nebari Design by @jbouder in #94
  • Add healthCheck to key-manager NebariApp landing tile (themed) by @dcmcand in #103
  • Add healthCheck to key-manager NebariApp landing tile by @dcmcand in #101
  • Theming by @jbouder in #102
  • Add nvidia.com/gpu toleration to LLMModel requesting GPU resources by @marcelovilla in #99
  • feat: BYO TLS secrets, /dev/shm for tensor parallelism, configurable rollout strategy by @tylerpotts in #93
  • docs: capture k3s / on-prem GPU deltas in install-production runbook by @tylerpotts in #89
  • Add PassthroughModel CRD for external provider routing and key minting by @dcmcand in #96
  • chore: upgrade llm-d to release v0.7.0 by @dcmcand in #100
  • chore: bump GitHub Actions to Node 24-compatible majors by @jbouder in #119
  • docs: Astro/Starlight documentation site (supersedes #108) by @dcmcand in #120
  • chore: opt in to the packs.nebari.dev docs portal by @dcmcand in #126
  • docs: adopt @nebari/starlight shared theme plugin by @dcmcand in #127
  • ci(docs): move docs workflow actions off the Node 20 runtime by @dcmcand in #128
  • ci(docs): fix preview cleanup failing on unsupported per_page param by @dcmcand in #129
  • ci(docs): add manual workflow to purge preview deployments by @dcmcand in #130
  • docs: verify preview-cleanup lifecycle by @dcmcand in #131
  • chore(docs): bump @nebari/starlight to 0.2.1 by @jbouder in #132
  • docs: remove the preview-cleanup verification comment by @dcmcand in #133
  • feat(dev): align local dev stack with AI Gateway v0.5 + key-manager UI dev mode by @dcmcand in #115
  • React UI by @jbouder in #111

New Contributors

Full Changelog: https://github.com/nebari-dev/llm-serving-pack/commits/v0.1.1