Skip to content

fix(tests): gzip the trace data inside the stale dftracer fixtures#63

Merged
izzet merged 1 commit into
llnl:developfrom
izzet:fix/gzip-stale-trace-fixtures
Jul 26, 2026
Merged

fix(tests): gzip the trace data inside the stale dftracer fixtures#63
izzet merged 1 commit into
llnl:developfrom
izzet:fix/gzip-stale-trace-fixtures

Conversation

@izzet

@izzet izzet commented Jul 26, 2026

Copy link
Copy Markdown
Collaborator

dftracer-posix.tar.gz and dftracer-dlio-prev.tar.gz shipped uncompressed .pfw traces. The dftracer-utils indexer reads .pfw.gz, so both fixtures loaded as zero events — the analyzer returned an empty analysis and exited 0.

CI never noticed because the e2e assertions are structural (view counts, layer counts, checkpoint glob) and all hold true on an empty result. Two of the six matrix entries have been passing against no data.

Repacked both so the traces inside are .pfw.gz. Contents are otherwise untouched — only the compression changed.

preset / data before after
posix on dftracer-posix 0 2,056
dlio-prev on dftracer-dlio-prev 0 18,039

Verification

pytest -m full — 165 passed, 22 deselected, in a clean non-editable venv.

Note

This does not add an assertion that a non-zero event count was read, so the underlying detection gap remains open. Worth a follow-up.

dftracer-posix.tar.gz and dftracer-dlio-prev.tar.gz shipped uncompressed
.pfw traces. The dftracer-utils indexer reads .pfw.gz, so both fixtures
loaded as zero events -- the analyzer returned an empty analysis with
exit 0, and the e2e assertions (view counts, layer counts) hold on an
empty result, so CI stayed green while testing nothing.

Repacked both so the traces inside are .pfw.gz. Contents are otherwise
untouched; only the compression changed.

  preset=posix     on dftracer-posix       0 -> 2,056 events
  preset=dlio-prev on dftracer-dlio-prev   0 -> 18,039 events
@izzet
izzet force-pushed the fix/gzip-stale-trace-fixtures branch from b4d0299 to 16629d0 Compare July 26, 2026 01:07
@izzet izzet self-assigned this Jul 26, 2026
@izzet izzet added enhancement New feature or request bug Something isn't working and removed enhancement New feature or request labels Jul 26, 2026
@izzet
izzet merged commit 94dda5e into llnl:develop Jul 26, 2026
4 checks passed
@izzet
izzet deleted the fix/gzip-stale-trace-fixtures branch July 26, 2026 01:28
izzet added a commit to izzet/dfanalyzer that referenced this pull request Jul 26, 2026
The dftracer-utils indexer reads .pfw.gz. An uncompressed .pfw is globbed
by resolve_trace_inputs but parses to nothing, so uploading one produced
an empty analysis with no error -- the same silent-empty failure llnl#63 fixed
in the test fixtures.

Verified on the 8 traces from the dlio-prev fixture: as .pfw.gz they load
18,039 events / 8 processes; as plain .pfw the same data loads 0 events /
0 processes and the run still exits 0.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant