Skip to content

Releases: kshitizj03/rootcause

Data release v2

Choose a tag to compare

@kshitizj03 kshitizj03 released this 19 Oct 18:35
34d36e3

The data behind every number in RootCause: the 20 recorded OpenTelemetry Demo incidents and every scored run. Supersedes data-v1.

New in v2: agents v1 and v0 on Nemotron 3.5 Super, agent v1 on GLM 5.3 Flash (5 runs on each of the 20 incidents), and the Gemini vague-alert ablation (3 runs each).

Use it: rootcause fetch-data downloads this archive, checks its SHA-256 against rootcause/config.py and unpacks it into data/. Offline: rootcause fetch-data --from rootcause-data-v2.zip.

Contents (1,297 files, 25 MB zipped):

  • snapshots/: the 20 scored incidents (metrics, traces and logs, the alert and onset in meta.json, the answer in truth.json, the recording checks in validation.json) and index.jsonl.
  • runs/<solver>/: one JSON record per run, with the answer, its score and, for the agents, the full transcript of tool calls and model turns.
    • Complete: the heuristic; agents v0 and v1 on Gemini 3.5 Flash-Lite, Nemotron 3 Super and Nemotron 3.5 Super; agent v1 on GLM 5.3 Flash; the Nemotron no-priors, vague-alert and 30-step ablations; the Gemini vague-alert ablation; Laya and Hunch.
    • Partial (still running when this was cut, marked partial in the report): the Gemini no-priors ablation (16 of 60 runs).

SHA-256: 8e4fed789945e70eaf956ba8f0953624a295d1f18aaa76078fa730c2982464b8

Licensed under Apache-2.0, like the code. The incidents were recorded on the OpenTelemetry Demo (Apache-2.0); see NOTICE.

Data release v1

Choose a tag to compare

@kshitizj03 kshitizj03 released this 18 Oct 07:38
8af0dd3

The data behind every number in RootCause: the 20 recorded OpenTelemetry Demo incidents and every scored run.

Use it: rootcause fetch-data downloads this archive, checks its SHA-256 against rootcause/config.py and unpacks it into data/. Offline: rootcause fetch-data --from rootcause-data-v1.zip.

Contents (990 files, 20 MB zipped):

  • snapshots/: the 20 scored incidents (metrics, traces and logs, the alert and onset in meta.json, the answer in truth.json, the recording checks in validation.json) and index.jsonl.
  • runs/<solver>/: one JSON record per run, with the answer, its score and, for the agents, the full transcript of tool calls and model turns.
    • Complete: the heuristic; agents v0 and v1 on Gemini 3.5 Flash-Lite and on Nemotron 3 Super; the Nemotron no-priors, vague-alert and 30-step ablations; Laya and Hunch.
    • Partial (still running when this was cut, marked partial in the report): agent v1 on GLM 5.3 Flash (61 of 100 runs) and the Gemini vague-alert ablation (8 runs). A later release will add them complete.

SHA-256: dd00357cc87e856e3f2a35acbcf157198f8bf6e9407f027ee6eced09706d8459

Licensed under Apache-2.0, like the code. The incidents were recorded on the OpenTelemetry Demo (Apache-2.0); see NOTICE.