Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Don't init TPU device twice #4916

Merged
merged 1 commit into from
Jun 10, 2020
Merged

Don't init TPU device twice #4916

merged 1 commit into from
Jun 10, 2020

Conversation

LysandreJik
Copy link
Member

@LysandreJik LysandreJik commented Jun 10, 2020

closes #4893

The TPU device was initialized twice when using a the xla_spawn.py script. Removing this initialization solves the issue.

@patrickvonplaten, is this necessary for the benchmarking script?

@codecov
Copy link

codecov bot commented Jun 10, 2020

Codecov Report

Merging #4916 into master will increase coverage by 0.00%.
The diff coverage is 100.00%.

Impacted file tree graph

@@           Coverage Diff           @@
##           master    #4916   +/-   ##
=======================================
  Coverage   77.12%   77.13%           
=======================================
  Files         128      128           
  Lines       21650    21649    -1     
=======================================
+ Hits        16698    16699    +1     
+ Misses       4952     4950    -2     
Impacted Files Coverage Δ
src/transformers/file_utils.py 74.19% <100.00%> (+0.69%) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update ef2dcdc...acb4cb4. Read the comment docs.

@patrickvonplaten
Copy link
Contributor

Oh, my bad! Not sure why I left it there

@LysandreJik
Copy link
Member Author

No worries!

@LysandreJik LysandreJik merged commit 466aa57 into master Jun 10, 2020
@LysandreJik LysandreJik deleted the tpu-init-only-once branch June 10, 2020 19:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

🐛 TPU Training broken due to recent changes
2 participants