Repository navigation
Heimdall v1.2.1 — Self-Healing + Alert Escalation
v1.2.x patch shipping the deferred self-healing utilities and full multi-channel alert escalation that v1.2 outlined.
What's new
Self-Healing
- Circuit Breaker (DB-backed, survives restart) — wraps fragile operations with a state machine: CLOSED → OPEN after 5 consecutive failures → HALF_OPEN after 60s cooldown → CLOSED on probe success
- Wired into LlmService — every LLM call across the app is now circuit-protected per host+model. One unhealthy provider no longer takes down the rest.
- Retry-with-backoff helper with jitter and reusable predicates (
transientNetwork,llmTransient,never) - Dead-Letter Queue — DB-backed bucket for jobs that exhausted retries; per-job-kind replay handlers + stats endpoint
Multi-Channel Alert Escalation
- AlertEscalationService: 30s poll loop; routes operational alerts (sentinel state changes, indicator hits, etc.) by severity + source glob to telegram / email / meshtastic / desktop / webhook
- Re-escalation: high/critical alerts unacknowledged after 15 min (configurable) re-fire to the same channels
- Quiet hours per rule with cross-midnight handling
- Acknowledgement workflow with notes, surfaced inline on the Health Dashboard
- Custom-text dispatchers —
TelegramDispatcher.sendCustom(),EmailDispatcher.sendCustom(),MeshtasticDispatcher.sendCustom()for ops alerts that don't have an associated IntelReport
Health Dashboard additions
- New Self-Healing card showing every active circuit breaker (with manual reset) + DLQ stats
- New Operational Alerts card with severity-color-dotted recent alerts, escalation badges, inline Ack button
Database
Migration 044 adds 5 new tables (dead_letter_queue, circuit_breaker_state, alert_escalation_rules, alert_acknowledgements, on_call_config) and extends alerts with severity/source/title/body/payload/escalated_at/acknowledged_at columns.
Coming in v1.3
- Theme 1 calibration completion (Forecast Accountability + Memory Graph)
- Theme 3 hardening (Cryptographic Audit Chain + OPSEC default-on + RBAC)
- Theme 5 polish (Briefing Builder + World Map Intel Overlay + Calendar Timeline)
Downloads
- macOS Apple Silicon (arm64):
Heimdall-1.2.1-arm64.dmg - macOS Intel (x64):
Heimdall-1.2.1.dmg
Both unsigned (right-click → Open on first launch).