spec: Create conformance test suite

[mickdarling]

Summary

Create test suite for verifying MCP-AQL conformance at Level 1 and Level 2.

Status

Spec Directory: tests/ exists but empty

Test Categories

Level 1 (Basic Conformance)

• introspect operation implemented (operations query)
• introspect operation implemented (types query)
• Correct endpoint routing
• Response format validation (discriminated unions)
• Error handling
• snake_case parameter naming

Level 2 (Full Conformance)

• All Level 1 tests
• Both endpoint modes (CRUDE and Single)
• Field selection
• Batch operations

Tasks

• Define test framework
• Create Level 1 test cases
• Create Level 2 test cases
• Add CI integration
• Document test execution

Related

• Spec: tests/ directory
• Adapter Guide: docs/adapter/development-guide.md

[mickdarling]

🏷️ Triage Decision: SPLIT

Classification: Split between spec and mcpaql-adapter repos

Spec repo keeps:

• Conformance LEVEL definitions (Level 1 Basic, Level 2 Full)
• Test CATEGORY specifications
• Pass/Fail criteria

mcpaql-adapter receives:

• Test framework selection and setup
• Actual test case implementations
• CI integration
• Test execution documentation

Rationale: The spec defines conformance LEVELS and REQUIREMENTS. The test SUITE (executable code) belongs in the implementation repo.

Action:

1. Rename/refocus this issue to "spec: Define conformance level requirements"
2. Create linked issue in mcpaql-adapter: "impl: Create conformance test suite"

---

Triaged by mcpaql-issue-triage-agent

[mickdarling]

Linked Implementation Issue: MCPAQL/mcpaql-adapter#18

The test suite implementation will be tracked in the mcpaql-adapter repo.

[mickdarling]

Implementation Progress (2026-01-29)

Created docs/conformance-testing.md with conformance level definitions:

Level 1: Basic Conformance

• Introspect operation (operations query)
• Introspect operation (types query)
• Endpoint routing
• Response format (discriminated unions)
• Error handling
• snake_case parameter naming

Level 2: Full Conformance

• All Level 1 requirements
• Both endpoint modes (CRUDE and Single)
• Field selection
• Batch operations
• Cross-cutting parameter support

Certification

Implementations may claim:

• "MCP-AQL Level 1 Conformant"
• "MCP-AQL Level 2 Conformant"

Badge format included for README display.

Implementation Note

Actual test suite code will be in mcpaql-adapter#18 per triage decision.

---

Automated update via mcpaql-issue-triage-agent