Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

6640 fixes data analyzer device fallback #6658

Merged
merged 2 commits into from
Jun 26, 2023
Merged

Conversation

wyli
Copy link
Member

@wyli wyli commented Jun 26, 2023

Fixes #6640

Description

the issue was when device_count==0 fallback to CPU didn't work

[2023-06-26T12:57:56.270Z] 2023-06-26 12:57:56,044 - INFO - test_fl compute data statistics on train...
[2023-06-26T12:57:56.270Z] 2023-06-26 12:57:56,044 - INFO - Found 0 GPUs for data analyzing!
[2023-06-26T12:57:56.270Z] Finished test: test_shape_5 (tests.test_varautoencoder.TestVarAutoEncoder) (0.007s)
[2023-06-26T12:57:56.270Z] Starting test: test_get_data_stats_0 (tests.test_fl_monai_algo_stats.TestFLMonaiAlgo)...
[2023-06-26T12:57:56.526Z] 
  0%|          | 0/2 [00:00<?, ?it/s]2023-06-26 12:57:56,326 - INFO - Unable to process data /home/jenkins/agent/workspace/Monai-pytorch-versions/tests/testing_data/anatomical.nii on cuda:0. No CUDA GPUs are available
[2023-06-26T12:57:56.526Z] 2023-06-26 12:57:56,326 - INFO - DataAnalyzer `device` set to GPU execution hit an exception. Falling back to `cpu`.
[2023-06-26T13:19:27.823Z] 
 50%|█████     | 1/2 [00:00<00:00,  3.17it/s]Sending interrupt signal to process
[2023-06-26T13:19:27.824Z] Killing processes

Types of changes

  • Non-breaking change (fix or new feature that would not break existing functionality).
  • Breaking change (fix or new feature that would cause existing functionality to change).
  • New tests added to cover the changes.
  • Integration tests passed locally by running ./runtests.sh -f -u --net --coverage.
  • Quick tests passed locally by running ./runtests.sh --quick --unittests --disttests.
  • In-line docstrings updated.
  • Documentation updated, tested make html command in the docs/ folder.

wyli added 2 commits June 26, 2023 13:41
Signed-off-by: Wenqi Li <wenqil@nvidia.com>
Signed-off-by: Wenqi Li <wenqil@nvidia.com>
Copy link
Contributor

@KumoLiu KumoLiu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@wyli
Copy link
Member Author

wyli commented Jun 26, 2023

/integration-test
/build

@wyli wyli enabled auto-merge (squash) June 26, 2023 14:10
@wyli wyli merged commit b8fbfc2 into Project-MONAI:dev Jun 26, 2023
32 of 37 checks passed
@wyli wyli deleted the temp-test branch June 26, 2023 17:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

tests.test_fl_monai_algo_stats.TestFLMonaiAlgo
3 participants