Skip to content

[WIP][PYTHON][TESTS] Reduce the required resources in PyTorch related tests#40769

Closed
zhengruifeng wants to merge 5 commits intoapache:masterfrom
zhengruifeng:torch_test_reduce_resource
Closed

[WIP][PYTHON][TESTS] Reduce the required resources in PyTorch related tests#40769
zhengruifeng wants to merge 5 commits intoapache:masterfrom
zhengruifeng:torch_test_reduce_resource

Conversation

@zhengruifeng
Copy link
Contributor

What changes were proposed in this pull request?

PyTorch distributor run on barrier mode, when the resources is not enough for some reason, test_parity_torch_distributor can wait for hours.

Why are the changes needed?

for tests

Does this PR introduce any user-facing change?

No

How was this patch tested?

CI

@zhengruifeng
Copy link
Contributor Author

@HyukjinKwon do we have a timeout parameter for python unittest?

The issue happens occasionally, I want to fail the test if it is too long (maybe 10min) so that reviews at least will be aware of that the failure is unrelated

@HyukjinKwon
Copy link
Member

We don't have. We have utils.eventually but I think it cannot be used in this case. Would need to implement it separately.

@zhengruifeng zhengruifeng force-pushed the torch_test_reduce_resource branch 2 times, most recently from 6dcb7bb to afac7f1 Compare April 14, 2023 02:01
@github-actions github-actions bot added the BUILD label Apr 14, 2023
@zhengruifeng zhengruifeng force-pushed the torch_test_reduce_resource branch from afac7f1 to fd03938 Compare April 14, 2023 03:11
@zhengruifeng zhengruifeng force-pushed the torch_test_reduce_resource branch from fd03938 to 03b403c Compare April 14, 2023 03:31
@zhengruifeng zhengruifeng marked this pull request as draft April 14, 2023 08:02
@zhengruifeng zhengruifeng deleted the torch_test_reduce_resource branch April 14, 2023 12:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

Comments