Skip to content

v0.1.0 — agentcore-harness-builder

Choose a tag to compare

@timwukp timwukp released this 14 Jun 05:27
5c2f343

agentcore-harness-builder v0.1.0 — initial release

A battle-tested Kiro skill that builds production-ready AWS Bedrock AgentCore Harness agents end to end.

Lives in this repo at skills/skills/agentcore-harness-builder/.

What's in v0.1.0

  • Phased workflow — preflight → design → author config → create → wire memory → observability → invoke → assess.
  • 14 reference filesharness-config, model-and-prompt, tools, skills, memory, advanced-config, observability, evaluations, optimizations, identity, policy, payments, registry, browser-auth (human-in-the-loop SSO via Live View), plus gotchas (consolidated hard-learned facts) and decision-guide (Harness vs Runtime vs Bedrock Agents).
  • 8 helper scripts (all --dry-run capable) — preflight.py (version check + live shape introspection), validate_config.py, create_harness.py, update_harness.py (introspection-driven optionalValue per-field wrapping), wire_memory.py (3-step incl. IAM grant + namespace→glob conversion), setup_observability.py, invoke_harness.py, test_offline.py (41-test self-check).
  • Assets — verified harness.json.template, iam_execution_role.json, skill.md.template, requirements.txt.
  • Evalsevals/evals.json with realistic prompts the skill should trigger on.

Battle-tested

Used to build a real Amazon Quick POC web-UI test agent and run it end-to-end against a real Amazon Quick Suite (workshop) console:

  • Result: PARTIAL — 12 PASS / 1 FAIL / 8 PARTIAL across 21 steps.
  • 11 cookbook corrections captured (real UI labels/URLs/dialogs/permission options that diverged from the test plan).
  • 21 screenshots, schema-valid JSON report.
  • Surfaced a managed-harness Browser limitation: Live View "Take control" → Release tears down the automation context. Mitigation (interact in Live View without clicking Take control + agent must reconnect after the human's login) is documented in references/browser-auth.md. Filed upstream as aws/bedrock-agentcore-sdk-python#518.

Quality gates (all green)

  • quick_validate → "Skill is valid!"
  • scripts/test_offline.py → 41 passed / 0 failed
  • python3 -m py_compile scripts/*.py → clean
  • All field shapes verified against live boto3 1.43.29 service_model introspection (the SDK's bundled control-plane model is the source of truth where the public docs lag in this preview API).

Install

# Option A — install the source folder into your local skills dir
git clone https://github.com/timwukp/agent-skills-best-practice.git
cp -r agent-skills-best-practice/skills/skills/agentcore-harness-builder \
      ~/.kiro/skills/

# Option B — download the .skill bundle from this release and unpack
#   (the .skill is a zip; unpack into ~/.kiro/skills/)
unzip agentcore-harness-builder.skill -d ~/.kiro/skills/

Coverage scope (be honest)

This v0.1.0 is A+ for Harness as the chassis. v0.2.0 will broaden coverage to fully earn an agentcore-builder reading. See PR #14 for the audit + roadmap.

Planned in v0.2.0

  • Track A — Runtime build path: BedrockAgentCoreApp, @app.entrypoint, /ping contract (incl. the time_of_last_update caveat), serve_ag_ui/serve_a2a, agentcore deploy.
  • Track B — Gateway creation: CreateGateway / CreateGatewayTarget / CreateGatewayRule, inbound + outbound auth, plus a create_gateway.py script.
  • Track C — Console Harness Playground reference.
  • Track D — Executable boto3 examples added to identity.md / policy.md / payments.md / registry.md.
  • Track E — Deeper Code Interpreter coverage.
  • Re-run quality gates; refresh .skill asset.

Acknowledgments

  • Battle-test target: Amazon Quick Suite workshop environment.
  • Companion artifact: the validated Quick POC support agent built using this skill — timwukp/amazon-quick-poc-support-agent.
  • Authoritative sources: AWS Bedrock AgentCore Developer Guide + live boto3 1.43.29 service_model (the source of truth when public docs and reality diverge).