Skip to content

Add obol-stack-dev skill and LLM routing integration tests#189

Closed
bussyjd wants to merge 2 commits into
mainfrom
dev-skill-integration-tests
Closed

Add obol-stack-dev skill and LLM routing integration tests#189
bussyjd wants to merge 2 commits into
mainfrom
dev-skill-integration-tests

Conversation

@bussyjd
Copy link
Copy Markdown
Collaborator

@bussyjd bussyjd commented Feb 19, 2026

Summary

  • obol-stack-dev skill — comprehensive developer skill for LLM smart-routing through llmspy, covering architecture, CLI wrappers, overlay generation, integration testing, and troubleshooting
  • Integration tests — full-cluster tests (//go:build integration) that deploy 3 OpenClaw instances and validate inference through all 3 provider paths (Ollama, Anthropic, OpenAI) via llmspy
  • README — expanded Model Providers section documenting obol model setup/status, added OpenClaw commands section

Skill structure

.agents/skills/obol-stack-dev/
├── SKILL.md                              # Entry point
└── references/
    ├── dev-environment.md                # Setup, building, env vars
    ├── llmspy-routing.md                 # 2-tier architecture, 3 provider paths
    ├── obol-cli.md                       # Command map, flag quirks, programmatic usage
    ├── overlay-generation.md             # values-obol.yaml generation
    ├── integration-testing.md            # Test matrix, helpers, writing new tests
    └── troubleshooting.md               # Every gotcha (auth, EOF, labels, flags)

Integration test results (all passing)

Test Provider Model Route Status
TestIntegration_OllamaInference Ollama ollama/gpt-oss:120b-cloud OpenClaw → llmspy → Ollama PASS
TestIntegration_AnthropicInference Anthropic ollama/claude-sonnet-4-5-20250929 OpenClaw → llmspy → Anthropic PASS
TestIntegration_OpenAIInference OpenAI ollama/gpt-4o-mini OpenClaw → llmspy → OpenAI PASS
TestIntegration_MultiInstance Ollama (x3) First available 3 instances side-by-side PASS

All tests go through obol CLI verbs: obol openclaw sync, obol model setup, obol openclaw token, obol openclaw delete --force.

Test plan

  • Unit tests pass: go test ./internal/openclaw/
  • Integration tests pass: go test -tags integration -v -timeout 15m ./internal/openclaw/
  • Cleanup works: test namespaces deleted after each test
  • Verify skill is discoverable by agents via .claude/skills/ symlink

- Add `obol-stack-dev` skill with full reference docs for LLM
  smart-routing through llmspy (architecture, CLI wrappers, overlay
  generation, integration testing, troubleshooting)
- Add integration tests (`//go:build integration`) that deploy 3
  OpenClaw instances through obol CLI verbs and validate inference
  through Ollama, Anthropic, and OpenAI via llmspy
- Expand README model providers section and add OpenClaw commands
Add the standard Claude Code header, a Build/Test/Run Commands section
with unit test, integration test, and cluster management instructions,
and expand the References section with test files, CI/CD workflows,
and the developer skill directory. Fix Go version from 1.21 to 1.25.
@OisinKyne OisinKyne closed this Feb 19, 2026
@OisinKyne OisinKyne deleted the dev-skill-integration-tests branch February 20, 2026 12:32
OisinKyne added a commit that referenced this pull request Jun 2, 2026
OisinKyne added a commit that referenced this pull request Jun 2, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants