Skip to content

fuzefront-applications: 470 restarts (up from 28) — diagnose as its own defect, not as collateral of #750 #902

Description

@izzywdev

@claude

fuzefront-applications is in a restart storm in prod: 470 restarts. Please diagnose it as its own defect, from the container's own crash output.

Read this first — how this relates to #750 and #831

fuzefront-applications is mentioned in #750, but only in passing, as collateral: that issue's body lists it as "fuzefront-applications (Error, 28 restarts)" among other pods failing to roll out, while #750's title, root cause, and acceptance criteria are all about fuzefront-backend and the migration-015/022 root-org fault. The literal #750 defect was fixed by #751, and the reintroduced sibling in migration 026 by #831.

So the open question this issue exists to answer: is fuzefront-applications still crashing for a reason of its own, or is it downstream of the unresolved root-org repoint/reparent decision in #750?

Two facts say it deserves its own diagnosis rather than being folded into #750:

Do not close this as a duplicate of #750 without evidence. If the evidence shows it genuinely is the same root-org blocker, say so explicitly here with the exit code and logs that demonstrate it, and link it — that is a valid outcome, but it must be demonstrated, not assumed.

What was measured

Pod Namespace Restarts Measured
fuzefront-applications fuzefront 470 2026-09-01, pre-outage

Ownership is established by argocd/projects/fuzefront.yaml in FuzeInfra, whose sourceRepos is exactly https://github.com/izzywdev/FuzeFront.git, with destinations restricted to the fuzefront namespace. FuzeInfra runs the Argo instance and the cluster; it does not edit consumer charts or application code.

Important: the cluster is currently unreachable

The prod k3s API is refusing connections on 6443 as of 2026-09-02. The 470 figure was measured on 2026-09-01, before the outage. Do not treat a failure to reach the cluster today as evidence the problem is gone, and do not wait idle for it — the source-level work below can start now.

What to do

Diagnose from the container, not from the infrastructure.

  1. The container's exit code and termination reason (lastState.terminated.reason / .exitCode).
  2. The container's own stdout/stderr from the crashing boot — the previous container's logs, not the current one's.
  3. Whether it dies before or after binding its port, and specifically whether the fatal line is a migration guard throwing on an absent ROOT_ORG_ID (the Backend CrashLoopBackOff in prod: migration 015 infers "root org present" from a slug conflict, then FK-violates #750/fix(db): migration 026 reintroduced the #750 root-org crashloop #831 class) or something unrelated.
  4. Whether the deployed image actually contains the applications-services 011 guard fix, or predates it.

Do NOT

Acceptance criteria

  1. The crash cause for fuzefront-applications specifically is identified from its own exit code and previous-boot logs, and written down here.
  2. It is stated explicitly, with evidence, whether this is independent of Backend CrashLoopBackOff in prod: migration 015 infers "root org present" from a slug conflict, then FK-violates #750 or downstream of it.
  3. If independent: a fix lands as a merged PR that Argo syncs.
  4. fuzefront-applications reaches a stable Running 1/1 — stable meaning the restart count stops increasing over a sustained observation window. A restart counter resets when a pod is replaced; a fresh low number is not proof of a fix.
  5. Verified against the live cluster with FuzeInfra's cluster-query workflow (repository_dispatch type cluster-query) — see docs/consuming-repos/CLUSTER_QUERY.md in FuzeInfra. Do not report done from a manifest diff alone. Blocked until the prod cluster is reachable again; do the source work first.

STATE:

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions