Skip to content

Conversation

@dnikolaev-amd
Copy link

@dnikolaev-amd dnikolaev-amd commented Jul 1, 2025

This PR will fix test_transformers.py and skip one test:

  • Add missed lines in test_transformers.py to fix NameError: name '_cur_sdpa_kernel_backends' is not defined
  • skip test_transformers.py::TestAttnBias::test_causal_variants_causal_variant_CausalVariant_UPPER_LEFT_shape3_cuda on Navi4x (tested on gfx1200 and gfx1201). Test failed on shape (1, 1, 23, 56, 15) only on Naxi4x only in release/2.5. Test uses hipBlas, but switching to hipBlasLT doesn't help

release/2.6 has significant changes in SDPBackend.MATH backend and the test passes

Fixes SWDEV-522844

@rocm-repo-management-api
Copy link

rocm-repo-management-api bot commented Jul 1, 2025

Jenkins build for 4eb5066c7e862210b7fed7175f561d944e8a6c18 commit finished as FAILURE
Links: Blue Ocean view / Build artifacts

@dnikolaev-amd dnikolaev-amd changed the title fix and skip test_causal_variants on Navi4x [release/2.5] fix and skip test_causal_variants on Navi4x Jul 1, 2025
from torch.backends.cuda import (
can_use_efficient_attention,
can_use_flash_attention,
cudnn_sdp_enabled,
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

are these imports not used? safe to remove?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There are no errors about unknown names in the tests
Also, I can't find any mention of these names:

  • cudnn_sdp_enabled
  • enable_cudnn_sdp
  • enable_flash_sdp
  • enable_math_sdp
  • enable_mem_efficient_sdp
  • flash_sdp_enabled
  • math_sdp_enabled
  • mem_efficient_sdp_enabled

@rocm-repo-management-api
Copy link

Jenkins build for 4eb5066c7e862210b7fed7175f561d944e8a6c18 commit is in progress
Links: Blue Ocean view / Build artifacts

@pruthvistony pruthvistony merged commit aade718 into release/2.5 Jul 21, 2025
0 of 5 checks passed
@pruthvistony pruthvistony deleted the dnikolaev/fix_test_causal_variants_navi4x_rel2.5 branch July 21, 2025 17:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants