feat: spawner app + native uv support + deploy lifecycle fix by dgokeeffe · Pull Request #52 · datasciencemonkey/coding-agents-databricks-apps

dgokeeffe · 2026-03-10T13:10:42Z

Summary

Spawner app (spawner/): One-click provisioning UI that creates personal coding-agents instances for any developer. Admin bootstraps once; users paste a PAT and get their own app deployed from a shared template.
Native uv support: Replaced requirements.txt/pip with pyproject.toml + uv.lock for both the main app and spawner, enabling the platform's native uv sync + uv run flow.
Deploy lifecycle fix: Discovered that Databricks Apps deploy API requires compute_status == ACTIVE (~80s after app creation), not app_status == RUNNING. Added polling + bumped gunicorn timeout to 300s to handle the full provision flow.
Misc fixes: Template app.yaml upload (pipe→file), deploy error surfacing, WebSocket transport detection, supply chain hardening.

Test plan

Spawner deployed and RUNNING on daveok workspace
Full provision flow tested via /api/provision — all 6 steps complete in ~114s
Spawned app reaches RUNNING and passes health check
Main coding-agents app deployed with native uv support

This pull request was AI-assisted by Isaac.

dgokeeffe · 2026-03-11T12:13:05Z

Updated: Spawner admin bootstrap + self-service provisioning

New commits add the full spawner app with:

Admin bootstrap — workspace admin PAT handles secret scopes, ACLs, deploy
SCIM identity — resolves PAT owner to derive coding-agents-{username} app name
Secret resource in app creation — no separate PATCH needed
UUID secret keys — each PAT stored with unique key
Spawned apps dashboard — /api/apps + UI table
Makefile with deploy/redeploy/run-polling targets
README documenting architecture, token model, and deploy steps

…nCode OpenCode intermittently sends empty text content blocks in messages, which Databricks Foundation Model API strictly rejects with "text content blocks must be non-empty" (OpenCode #5028). This adds a LiteLLM proxy running on localhost:4000 inside the container that strips these blocks before they reach the API. Simpler alternative to PR #52's fork approach — no fork maintenance, proven fix via LiteLLM PR #20384, preserves full AI Gateway/MLflow/UC governance. Changes: - setup_litellm.py: new setup script, starts LiteLLM proxy with health check - setup_opencode.py: route baseURL through localhost:4000 instead of direct - app.py: add litellm setup step (sequential, before parallel agent setup) - requirements.txt: add litellm>=1.60 - docs/plans: design document with analysis of PR #52 trade-offs Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Socket.IO reports connected=true even when falling back to HTTP long-polling through the Databricks Apps reverse proxy. The app was prematurely stopping the poll-worker, leaving users with no data transport when true WebSocket wasn't available. Now checks socket.io.engine.transport.name before deciding: - 'websocket' → stop poll-worker, use WS as primary - 'polling' → keep poll-worker active as primary transport - Listen for late 'upgrade' event if transport upgrades later Cherry-picked from PR #52 (dgokeeffe). Fixes #54 Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

… (#59) Socket.IO reports connected=true even when falling back to HTTP long-polling through the Databricks Apps reverse proxy. The app was prematurely stopping the poll-worker, leaving users with no data transport when true WebSocket wasn't available. Now checks socket.io.engine.transport.name before deciding: - 'websocket' → stop poll-worker, use WS as primary - 'polling' → keep poll-worker active as primary transport - Listen for late 'upgrade' event if transport upgrades later Cherry-picked from PR #52 (dgokeeffe). Fixes #54 Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

- Install OpenCode from dgokeeffe/opencode fork with native Databricks provider (auto-discovers models, shares Claude Code skills) - Add GitHub CLI (gh) setup with xterm.js-safe auth wrapper - Reduce select() timeout 500ms→50ms and poll interval 100ms→50ms - Add Makefile for deployment automation Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

Replace single global sessions_lock block in get_output_batch() with 3-step resolve/swap/join pattern matching get_output(). Snapshot session dict in cleanup_stale_sessions() to iterate with per-session locks. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

Socket.IO sets connected=true even when falling back to its own long-polling (Databricks Apps proxy blocks WS upgrade). This stopped the fast poll-worker, routing all output through slow long-polling. Now checks socket.io.engine.transport.name and only stops poll-worker when transport is true 'websocket'. Also listens for late upgrades. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

Copy prd-writer, test-generator, implementer, and build-feature agent definitions to ~/.claude/agents/ during setup. Stripped model overrides so agents inherit the Databricks model serving endpoint. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

- Admin token handles privileged ops (secret scopes, ACLs, deploy) - User PAT creates app (ownership) + stored as runtime secret - SCIM /Me resolves PAT owner to derive app name - Secret resource included in app creation (no separate PATCH) - Each PAT stored with unique UUID key - /api/apps endpoint lists all spawned coding-agents apps - Makefile for deploy/redeploy with run polling - README documenting architecture and token model Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

- Switch to uv run gunicorn in app.yaml (10-100x faster installs) - Delete requirements.txt, use pyproject.toml + uv.lock exclusively - Require Python >=3.12, add missing deps (gunicorn, flask-socketio) - Run setup scripts via uv run python for consistent Python 3.12 env - Strip DATABRICKS_TOKEN whitespace at startup to fix auth failures - Add ~/.local/bin to PATH in _run_step for uv/tool discovery Co-authored-by: Isaac

Co-authored-by: Isaac

Pipe-based workspace import writes empty content. Write to temp file first, then import with --file flag. Co-authored-by: Isaac

Co-authored-by: Isaac

New apps are UNAVAILABLE until first deploy, so waiting for RUNNING causes a deadlock. Retry the deploy call with backoff. Co-authored-by: Isaac

Deploy API requires compute_status=ACTIVE (~80s after app creation). Gunicorn timeout bumped to 300s to handle the full provision flow. Co-authored-by: Isaac

Falls back to direct model serving when no AI Gateway is configured. Co-authored-by: Isaac

Co-authored-by: Isaac

Prevents fitAddon.fit() from thrashing scroll position on every resize pixel. Adds explicit scrollback and scrollOnUserInput. Co-authored-by: Isaac

Previously skipped install if binary existed, leaving stale versions across redeployments. Co-authored-by: Isaac

Co-authored-by: Isaac

Random UUID secret keys caused re-provisions to store the PAT under a new key while the app still referenced the old one. Users had to enter their PAT twice because the first attempt's secret was orphaned. Co-authored-by: Isaac

Secret values stored via `echo | databricks secrets put-secret` include a trailing newline, causing invalid Authorization headers. Co-authored-by: Isaac

The Databricks Apps API returns state under `app_status`, not `status`. This caused the early-exit check to never detect running apps, and the spawned apps table to always show UNKNOWN. Co-authored-by: Isaac

Provision runs in a background thread so the endpoint returns immediately. UI polls /api/provision-status every 3s showing step-by-step progress with checkmarks. Apps table auto-refreshes every 10s and shows in-flight provisions. Supports multiple concurrent provisions. Co-authored-by: Isaac

Co-authored-by: Isaac

The list apps endpoint doesn't return app_status. Derive state from compute_status and active_deployment.status instead. Co-authored-by: Isaac

Co-authored-by: Isaac

xterm.js intercepts Ctrl+V/C as raw control characters on non-Mac platforms. Added attachCustomKeyEventHandler to let the browser handle Ctrl+V (paste), Ctrl+C (copy when text selected), and Ctrl+Shift+C/V. Also added clipboard section to shortcuts help with platform-aware labels (Cmd on Mac, Ctrl on Windows) and upload toast for image paste. Co-authored-by: Isaac

Runtime image ships an older CLI (v0.251.0). Added a setup step that fetches the latest release from GitHub API and installs it to ~/.local/bin, same pattern as the GitHub CLI install. Co-authored-by: Isaac

Co-authored-by: Isaac

dgokeeffe · 2026-03-17T11:51:23Z

Closing in favor of focused PRs: #68 (OpenCode/perf/WebSocket), #69 (TDD subagents), #70 (native uv), #71 (spawner), #72 (misc fixes)

dgokeeffe changed the title ~~feat: OpenCode fork, GitHub CLI, latency fix~~ feat: OpenCode fork integration, GitHub CLI, perf fixes Mar 10, 2026

This was referenced Mar 11, 2026

perf: Reduce PTY read latency and fix lock contention #53

Closed

fix: Correct WebSocket transport detection through Databricks proxy #54

Closed

feat: Add GitHub CLI setup with xterm.js-safe auth #55

Open

datasciencemonkey mentioned this pull request Mar 11, 2026

fix: Content-filter proxy + MCP servers for OpenCode on Databricks #56

Merged

12 tasks

datasciencemonkey mentioned this pull request Mar 11, 2026

fix: Check actual WebSocket transport before stopping poll-worker #59

Merged

dgokeeffe and others added 16 commits March 13, 2026 16:00

feat: add spawner app for one-click coding-agents provisioning

d8b9723

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

feat: add Databricks-themed UI for spawner app

acedf3e

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

fix: update spawner template app.yaml to use uv run

c20f64d

Co-authored-by: Isaac

fix: use uv run for post-commit workspace sync hook

ea05cb7

Co-authored-by: Isaac

feat: adopt native uv support for spawner app

ff64b31

Co-authored-by: Isaac

fix: surface deploy API error body in spawner

3e25f77

Co-authored-by: Isaac

fix: use temp file for template app.yaml upload

35ede0f

Pipe-based workspace import writes empty content. Write to temp file first, then import with --file flag. Co-authored-by: Isaac

fix: wait for app RUNNING state before deploying

1e770fa

Co-authored-by: Isaac

fix: retry deploy instead of waiting for RUNNING state

24bb421

New apps are UNAVAILABLE until first deploy, so waiting for RUNNING causes a deadlock. Retry the deploy call with backoff. Co-authored-by: Isaac

fix: wait for compute ACTIVE before deploy, bump gunicorn timeout

98b68cf

Deploy API requires compute_status=ACTIVE (~80s after app creation). Gunicorn timeout bumped to 300s to handle the full provision flow. Co-authored-by: Isaac

dgokeeffe force-pushed the feat/opencode-fork-gh-latency branch from d2fb8f5 to 98b68cf Compare March 13, 2026 10:53

dgokeeffe changed the title ~~feat: OpenCode fork integration, GitHub CLI, perf fixes~~ feat: spawner app + native uv support + deploy lifecycle fix Mar 13, 2026

dgokeeffe added 2 commits March 16, 2026 22:01

fix: remove DATABRICKS_GATEWAY_HOST from app.yaml

052028f

Falls back to direct model serving when no AI Gateway is configured. Co-authored-by: Isaac

fix: regenerate uv.lock to match pyproject.toml version

04cd44c

Co-authored-by: Isaac

dgokeeffe added 14 commits March 16, 2026 22:56

feat: bump databricks-sdk 0.97.0 → 0.100.0

2bacc35

Co-authored-by: Isaac

fix: debounce resize handler, add scrollback config

88a7b6a

Prevents fitAddon.fit() from thrashing scroll position on every resize pixel. Adds explicit scrollback and scrollOnUserInput. Co-authored-by: Isaac

fix: always upgrade Claude Code CLI on startup

e7d81e8

Previously skipped install if binary existed, leaving stale versions across redeployments. Co-authored-by: Isaac

fix: truncate app names exceeding 63-char limit

b606406

Co-authored-by: Isaac

fix: use deterministic secret key, skip re-provision

5c974b2

Random UUID secret keys caused re-provisions to store the PAT under a new key while the app still referenced the old one. Users had to enter their PAT twice because the first attempt's secret was orphaned. Co-authored-by: Isaac

fix: strip whitespace from ADMIN_TOKEN env var

9b43f49

Secret values stored via `echo | databricks secrets put-secret` include a trailing newline, causing invalid Authorization headers. Co-authored-by: Isaac

fix: use app_status instead of status in check_existing_app

cb91645

The Databricks Apps API returns state under `app_status`, not `status`. This caused the early-exit check to never detect running apps, and the spawned apps table to always show UNKNOWN. Co-authored-by: Isaac

fix: use opus model for spawned apps template

961f845

Co-authored-by: Isaac

fix: derive app state from compute + deployment status

92b7864

The list apps endpoint doesn't return app_status. Derive state from compute_status and active_deployment.status instead. Co-authored-by: Isaac

fix: show spinner during initial PAT verification step

7f7ff18

Co-authored-by: Isaac

feat: upgrade Databricks CLI to latest at startup

44253fe

Runtime image ships an older CLI (v0.251.0). Added a setup step that fetches the latest release from GitHub API and installs it to ~/.local/bin, same pattern as the GitHub CLI install. Co-authored-by: Isaac

feat: add redeploy-all endpoint and UI to spawner

d7276cd

Co-authored-by: Isaac

dgokeeffe closed this Mar 17, 2026

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat: spawner app + native uv support + deploy lifecycle fix#52

feat: spawner app + native uv support + deploy lifecycle fix#52
dgokeeffe wants to merge 32 commits intodatasciencemonkey:mainfrom
dgokeeffe:feat/opencode-fork-gh-latency

dgokeeffe commented Mar 10, 2026 •

edited

Loading

Uh oh!

dgokeeffe commented Mar 11, 2026

Uh oh!

dgokeeffe commented Mar 17, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Conversation

dgokeeffe commented Mar 10, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Test plan

Uh oh!

dgokeeffe commented Mar 11, 2026

Updated: Spawner admin bootstrap + self-service provisioning

Uh oh!

dgokeeffe commented Mar 17, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

dgokeeffe commented Mar 10, 2026 •

edited

Loading