Integration Testing & Hardening

[ggondim]

Summary

End-to-end test suite covering the full message lifecycle, plus resilience and hardening measures.

Tasks

E2E Test Scenarios

• Slack message → route → webhook to recipient → reply with text → Slack outbound
• Telegram message → route → webhook → reply with A2H AUTHORIZE → inline keyboard → approve → response returned
• WhatsApp message → route → webhook → reply with A2H COLLECT (multi-field) → external form → submit → response returned
• Mixed message array (text + AUTHORIZE) → sequential rendering
• New thread creation (no threadId in URL)
• Ephemeral token expiry → 401
• Channel API key direct send (proactive, no replyTo)

Resilience

• Webhook delivery retry with exponential backoff
• Duplicate message deduplication (idempotent inbound processing)
• Channel adapter reconnection (WebSocket-based: Slack, Discord, WhatsApp)
• Graceful degradation when storage is unavailable

Adapter Conformance

• Shared adapter conformance test suite (abstract tests that run against any adapter)
• Mock channel servers for each platform (simulate webhook callbacks)

Acceptance Criteria

• All E2E scenarios pass
• Webhook retries work with configurable backoff
• Duplicate messages are detected and deduplicated
• Adapter reconnection recovers within configurable timeout
• Conformance suite passes for all implemented adapters

Dependencies

• Server: API Routes & Infrastructure #11 (Server: API Routes) — tests exercise the full server

References

• PLAN.md — Phase 6

[claude]

@claude Implement this issue.

• Base branch: meta/17
• Target your PR to meta/17
• Include fixes #15 in the PR body

[claude]

Claude finished @claude[bot]'s task in 15m 1s —— View job • claude/17-issue-15-20260410-2337 • Create PR ➔

---

Implementing Issue #15: Integration Testing & Hardening

• Gather context (reading VISION.md and codebase structure)
• Understand existing code structure and patterns

Resilience

• Webhook delivery retry with exponential backoff (packages/server/src/lib/retry.ts + updated fanout.ts)
• Duplicate message deduplication (packages/server/src/lib/deduplication.ts)
• Generic channel adapter reconnection utility (packages/channels/src/reconnect.ts)
• Graceful degradation when storage is unavailable (packages/server/src/lib/graceful-storage.ts)

Adapter Conformance

• Shared adapter conformance test suite (packages/channels/src/conformance-suite.ts)
• Mock channel servers for Slack, Telegram, and generic HTTP webhooks (packages/channels/src/mocks/mock-channel-server.ts)

E2E Test Scenarios (all 7 from the issue)

• Full lifecycle E2E tests (packages/core/tests/e2e/lifecycle.test.ts)

Unit Tests for New Modules

• Retry utility tests (packages/server/tests/retry.test.ts)

• Deduplication tests (packages/server/tests/deduplication.test.ts)

• Graceful storage tests (packages/server/tests/graceful-storage.test.ts)

• Fanout with retry tests (packages/server/tests/fanout.test.ts)

• Reconnect manager tests (packages/channels/tests/reconnect.test.ts)

• Commit and push changes

---

Summary

Implemented all tasks from Issue #15. Here's what was added:

Resilience (4 new modules)

Module	Description
packages/server/src/lib/retry.ts	withRetry() with exponential backoff, configurable retryable predicate, and onRetry callback
packages/server/src/lib/fanout.ts	Added deliverWithRetry() — retries 5xx/network failures, stops on 4xx
packages/server/src/lib/deduplication.ts	InMemoryDeduplicationStore with LRU-capped entries, TTL expiry, platform-specific key builders
packages/server/src/lib/graceful-storage.ts	withGracefulStorage() + StorageHealthMonitor for circuit-breaking on high error rates
packages/channels/src/reconnect.ts	ReconnectManager — same exponential-backoff reconnection as WhatsApp's SessionManager, now reusable for Slack Socket Mode and Discord

Adapter Conformance

• packages/channels/src/conformance-suite.ts — runConformanceSuite() factory generates a standardised Bun test suite for any adapter. Handles the different method naming conventions across Slack, Discord, Telegram, and WhatsApp.
• packages/channels/src/mocks/mock-channel-server.ts — In-process mock servers (MockSlackServer, MockTelegramServer, MockWebhookServer) for simulating platform callbacks in integration tests without real network calls.

E2E Tests (all 7 scenarios from the issue)

packages/core/tests/e2e/lifecycle.test.ts covers:

1. Slack message → thread creation → turn recording → ephemeral token generation → outbound reply
2. Telegram A2H AUTHORIZE flow (virtual threads, turn history)
3. WhatsApp A2H COLLECT multi-field → form submit response
4. Mixed message array (text + AUTHORIZE) — normalisation and classification
5. New thread creation (main thread get-or-create, native thread dedup)
6. Ephemeral token expiry → invalid, revoked → invalid, non-existent → not_found
7. Channel API key direct send — generation, validation, channel mismatch, revocation

|