Skip to content

ci: Re-add GNN test hashes - #5997

Merged
benjaminhuth merged 1 commit into
acts-project:mainfrom
benjaminhuth:ci/gnn-add-hash-checks-again
Sep 1, 2026
Merged

ci: Re-add GNN test hashes#5997
benjaminhuth merged 1 commit into
acts-project:mainfrom
benjaminhuth:ci/gnn-add-hash-checks-again

Conversation

@benjaminhuth

@benjaminhuth benjaminhuth commented Sep 1, 2026

Copy link
Copy Markdown
Member

Restore GNN hashes, which are reproducible again with TF32 disabled

@github-actions github-actions Bot added this to the next milestone Sep 1, 2026
@github-actions github-actions Bot added Infrastructure Changes to build tools, continous integration, ... Component - Examples Affects the Examples module Changes Performance labels Sep 1, 2026
@benjaminhuth
benjaminhuth force-pushed the ci/gnn-add-hash-checks-again branch from 6c5a1b1 to f23456c Compare September 1, 2026 11:22
benjaminhuth added a commit to benjaminhuth/acts that referenced this pull request Sep 1, 2026
664c82a (acts-project#5903) dropped the GNN GPU reference hashes because the
heterogeneous GPU pool (T4 + A4000) produced a different
ntuple_finding_gnn.root on the A4000 for test_gnn_module_map[gpu-onnx],
blamed on ONNX Runtime enabling TF32 GEMMs on Ampere by default.

Confirmed experimentally in acts-project#5997: the T4 reproduces
the reference hashes with or without TF32 (no TF32 hardware to begin
with), and forcing NVIDIA_TF32_OVERRIDE=0 makes the A4000 reproduce
them too, on all four gpu-marked GNN tests. No other source of drift
was found, so the existing reference hashes did not need updating.

Restore the six removed root_file_hashes.txt entries and the
assert_root_hash calls in test_gnn_metric_learning and
test_gnn_module_map, and set NVIDIA_TF32_OVERRIDE=0 in the gnn_gpu job
env.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01X1p4KwFbkMWfy4zt6TCyfT
@benjaminhuth
benjaminhuth force-pushed the ci/gnn-add-hash-checks-again branch from f23456c to 9ef8fad Compare September 1, 2026 12:56
benjaminhuth added a commit to benjaminhuth/acts that referenced this pull request Sep 1, 2026
664c82a (acts-project#5903) dropped the GNN GPU reference hashes because the
heterogeneous GPU pool (T4 + A4000) produced a different
ntuple_finding_gnn.root on the A4000 for test_gnn_module_map[gpu-onnx],
blamed on ONNX Runtime enabling TF32 GEMMs on Ampere by default.

Confirmed experimentally in acts-project#5997: the T4 reproduces
the reference hashes with or without TF32 (no TF32 hardware to begin
with), and forcing NVIDIA_TF32_OVERRIDE=0 makes the A4000 reproduce
them too, on all four gpu-marked GNN tests. No other source of drift
was found, so the existing reference hashes did not need updating.

Restore the six removed root_file_hashes.txt entries and the
assert_root_hash calls in test_gnn_metric_learning and
test_gnn_module_map, and set NVIDIA_TF32_OVERRIDE=0 in the gnn_gpu job
env.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01X1p4KwFbkMWfy4zt6TCyfT
@benjaminhuth
benjaminhuth force-pushed the ci/gnn-add-hash-checks-again branch from 9ef8fad to 88bd31a Compare September 1, 2026 12:58
664c82a (acts-project#5903) dropped the GNN GPU reference hashes because the
heterogeneous GPU pool (T4 + A4000) produced a different
ntuple_finding_gnn.root on the A4000 for test_gnn_module_map[gpu-onnx],
blamed on ONNX Runtime enabling TF32 GEMMs on Ampere by default.

Confirmed experimentally in acts-project#5997: the T4 reproduces
the reference hashes with or without TF32 (no TF32 hardware to begin
with), and forcing NVIDIA_TF32_OVERRIDE=0 makes the A4000 reproduce
them too, on all four gpu-marked GNN tests. No other source of drift
was found, so the existing reference hashes did not need updating.

Restore the six removed root_file_hashes.txt entries and the
assert_root_hash calls in test_gnn_metric_learning and
test_gnn_module_map, and set NVIDIA_TF32_OVERRIDE=0 in the gnn_gpu job
env.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01X1p4KwFbkMWfy4zt6TCyfT
@benjaminhuth
benjaminhuth force-pushed the ci/gnn-add-hash-checks-again branch from 88bd31a to 39bd368 Compare September 1, 2026 12:59
@paulgessinger paulgessinger changed the title ci(TEMP): GNN GPU hash diagnostic run, do not merge ci: GNN GPU hash diagnostic run, do not merge Sep 1, 2026
@benjaminhuth benjaminhuth changed the title ci: GNN GPU hash diagnostic run, do not merge ci: Re-add GNN test hashes Sep 1, 2026
@github-actions github-actions Bot removed the Component - Examples Affects the Examples module label Sep 1, 2026
@github-actions

github-actions Bot commented Sep 1, 2026

Copy link
Copy Markdown
Contributor

Public API surface diff

No change to the public API surface. ✅

@benjaminhuth
benjaminhuth added this pull request to the merge queue Sep 1, 2026
@github-actions

github-actions Bot commented Sep 1, 2026

Copy link
Copy Markdown
Contributor

📊: Physics performance monitoring for 39bd368

Full contents

physmon summary

@sonarqubecloud

sonarqubecloud Bot commented Sep 1, 2026

Copy link
Copy Markdown

Merged via the queue into acts-project:main with commit 65e572f Sep 1, 2026
42 checks passed
@andiwand andiwand modified the milestones: next, v47.7.0 Sep 5, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Changes Performance Infrastructure Changes to build tools, continous integration, ...

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants