Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Disable JAX iterator tests in ASAN build #4920

Merged
merged 2 commits into from
Jun 23, 2023

Conversation

awolant
Copy link
Contributor

@awolant awolant commented Jun 22, 2023

Category:

Bug fix

Description:

Running frameworks iterators tests with sanitizers enabled takes a long time, may timeout the job and does not provide that much value.
This PR disables JAX iterator tests when sanitizer is enabled.

Additional information:

Affected modules and functionalities:

JAX iterator tests.

Key points relevant for the review:

Did I run CI pipeline with ASAN?

Tests:

  • Existing tests apply
  • New tests added
    • Python tests
    • GTests
    • Benchmark
    • Other
  • N/A

Checklist

Documentation

  • Existing documentation applies
  • Documentation updated
    • Docstring
    • Doxygen
    • RST
    • Jupyter
    • Other
  • N/A

DALI team only

Requirements

  • Implements new requirements
  • Affects existing requirements
  • N/A

REQ IDs: N/A

JIRA TASK: N/A

Signed-off-by: Albert Wolant <awolant@nvidia.com>
@dali-automaton
Copy link
Collaborator

CI MESSAGE: [8711952]: BUILD STARTED

@dali-automaton
Copy link
Collaborator

CI MESSAGE: [8717952]: BUILD STARTED

# it takes very long time to run it with sanitizers on and provides little value so turn it off
if [ -z "$DALI_ENABLE_SANITIZERS" ]; then
# General tests for iterators
${python_invoke_test} -m '(?:^|[\b_\./-])[Tt]est.*jax*' test_fw_iterators.py
Copy link
Contributor

@JanuszL JanuszL Jun 22, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think that works fine, the bellow never happens. I would keep it as a basic test for integration.

Comment on lines 13 to 16
# it takes very long time to run it with sanitizers on and provides little value so turn it off
if [ -z "$DALI_ENABLE_SANITIZERS" ]; then
# General tests for iterators
${python_invoke_test} -m '(?:^|[\b_\./-])[Tt]est.*jax*' test_fw_iterators.py
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
# it takes very long time to run it with sanitizers on and provides little value so turn it off
if [ -z "$DALI_ENABLE_SANITIZERS" ]; then
# General tests for iterators
${python_invoke_test} -m '(?:^|[\b_\./-])[Tt]est.*jax*' test_fw_iterators.py
# General tests for iterators
${python_invoke_test} -m '(?:^|[\b_\./-])[Tt]est.*jax*' test_fw_iterators.py
# it takes very long time to run it with sanitizers on and provides little value so turn it off
if [ -z "$DALI_ENABLE_SANITIZERS" ]; then

@dali-automaton
Copy link
Collaborator

CI MESSAGE: [8711952]: BUILD FAILED

@dali-automaton
Copy link
Collaborator

CI MESSAGE: [8717952]: BUILD FAILED

Signed-off-by: Albert Wolant <awolant@nvidia.com>
@awolant awolant closed this Jun 23, 2023
@awolant awolant reopened this Jun 23, 2023
@awolant
Copy link
Contributor Author

awolant commented Jun 23, 2023

!build

@dali-automaton
Copy link
Collaborator

CI MESSAGE: [8728335]: BUILD STARTED

@awolant awolant force-pushed the skip_jax_test_in_asan_pipeline branch from d68bcad to 6fa06eb Compare June 23, 2023 11:54
@NVIDIA NVIDIA deleted a comment from dali-automaton Jun 23, 2023
@dali-automaton
Copy link
Collaborator

CI MESSAGE: [8728335]: BUILD PASSED

@awolant awolant merged commit 06b7383 into NVIDIA:main Jun 23, 2023
JanuszL pushed a commit to JanuszL/DALI that referenced this pull request Oct 13, 2023
* Disable JAX iterator tests in ASAN build

Signed-off-by: Albert Wolant <awolant@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants