Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[examples tests on multigpu] resolving require_torch_non_multi_gpu_but_fix_me #10561

Merged
merged 4 commits into from
Mar 8, 2021

Conversation

stas00
Copy link
Contributor

@stas00 stas00 commented Mar 6, 2021

A while ago I added @require_torch_non_multi_gpu_but_fix_me to quickly allow us to start running example tests on multigpu, so this PR resolves that temporary band-aid.

This PR:

  • fixes a few tests to make them run on multi-gpu
  • removes the decorator where it's not needed after testing that it works
  • leaves the dropped legacy tests untouched - since they don't run on CI
  • eliminates @require_torch_non_multi_gpu_but_fix_me from existence since it's no longer needed
  • the only test I couldn't figure out is [examples] run_glue_deebert.py distrbuted fails #10560 but it's not worse off than it was - added some refactoring to it and prepared it for multi-gpu if someone knows how to fix it

Note: 2 slow tests in examples/test_examples.py currently fail because of yet another missed thing in ported run_seq2seq.py - but these should be resolved by #10551 once that one is merged, so we can merge this PR after it.

@LysandreJik

@stas00 stas00 changed the title [multi-gpu tests] resolving require_torch_non_multi_gpu_but_fix_me [examples tests on multigpu] resolving require_torch_non_multi_gpu_but_fix_me Mar 6, 2021
Copy link
Member

@LysandreJik LysandreJik left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks for taking care of it @stas00. Feel free to merge once #10551 is merged.

@stas00 stas00 merged commit f284089 into huggingface:master Mar 8, 2021
@stas00 stas00 deleted the multi-gpu-ok-tests branch March 8, 2021 19:11
Iwontbecreative pushed a commit to Iwontbecreative/transformers that referenced this pull request Jul 15, 2021
…t_fix_me (huggingface#10561)

* batch 1

* this is tpu

* deebert attempt

* the rest
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants