Skip to content

Heimdall v1.2.1 — Self-Healing + Alert Escalation

Choose a tag to compare

@ankurCES ankurCES released this 27 Apr 02:16
· 41 commits to main since this release

v1.2.x patch shipping the deferred self-healing utilities and full multi-channel alert escalation that v1.2 outlined.

What's new

Self-Healing

  • Circuit Breaker (DB-backed, survives restart) — wraps fragile operations with a state machine: CLOSED → OPEN after 5 consecutive failures → HALF_OPEN after 60s cooldown → CLOSED on probe success
  • Wired into LlmService — every LLM call across the app is now circuit-protected per host+model. One unhealthy provider no longer takes down the rest.
  • Retry-with-backoff helper with jitter and reusable predicates (transientNetwork, llmTransient, never)
  • Dead-Letter Queue — DB-backed bucket for jobs that exhausted retries; per-job-kind replay handlers + stats endpoint

Multi-Channel Alert Escalation

  • AlertEscalationService: 30s poll loop; routes operational alerts (sentinel state changes, indicator hits, etc.) by severity + source glob to telegram / email / meshtastic / desktop / webhook
  • Re-escalation: high/critical alerts unacknowledged after 15 min (configurable) re-fire to the same channels
  • Quiet hours per rule with cross-midnight handling
  • Acknowledgement workflow with notes, surfaced inline on the Health Dashboard
  • Custom-text dispatchers — TelegramDispatcher.sendCustom(), EmailDispatcher.sendCustom(), MeshtasticDispatcher.sendCustom() for ops alerts that don't have an associated IntelReport

Health Dashboard additions

  • New Self-Healing card showing every active circuit breaker (with manual reset) + DLQ stats
  • New Operational Alerts card with severity-color-dotted recent alerts, escalation badges, inline Ack button

Database

Migration 044 adds 5 new tables (dead_letter_queue, circuit_breaker_state, alert_escalation_rules, alert_acknowledgements, on_call_config) and extends alerts with severity/source/title/body/payload/escalated_at/acknowledged_at columns.

Coming in v1.3

  • Theme 1 calibration completion (Forecast Accountability + Memory Graph)
  • Theme 3 hardening (Cryptographic Audit Chain + OPSEC default-on + RBAC)
  • Theme 5 polish (Briefing Builder + World Map Intel Overlay + Calendar Timeline)

Downloads

  • macOS Apple Silicon (arm64): Heimdall-1.2.1-arm64.dmg
  • macOS Intel (x64): Heimdall-1.2.1.dmg

Both unsigned (right-click → Open on first launch).