Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dev22 - DDP engines update #1399

Merged
merged 12 commits into from
Feb 6, 2022
Merged

Dev22 - DDP engines update #1399

merged 12 commits into from
Feb 6, 2022

Conversation

Scitator
Copy link
Member

@Scitator Scitator commented Feb 6, 2022

Pull Request FAQ

Description

Related Issue

Type of Change

  • Examples / docs / tutorials / contributors update
  • Bug fix (non-breaking change which fixes an issue)
  • Improvement (non-breaking change which improves an existing feature)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to change)

PR review

Anyone in the community is free to review the PR once the tests have passed.
If we didn't discuss your PR in Github issues there's a high chance it will not be merged.

Checklist

  • Have you updated tests for the new functionality?
  • Have you added your new classes/functions to the docs?
  • Have you updated the CHANGELOG?
  • Have you run colab minimal CI/CD with latest requirements? Please attach the notebook link.
  • Have you run colab minimal CI/CD with minimal requirements? Please attach the notebook link.
  • Have you checked XLA integration? Please attach the notebook link.

@pep8speaks
Copy link

pep8speaks commented Feb 6, 2022

Hello @Scitator! Thanks for updating this PR. We checked the lines you've touched for PEP 8 issues, and found:

There are currently no PEP 8 issues detected in this Pull Request. Cheers! 🍻

Comment last updated at 2022-02-06 15:26:11 UTC

try:
unwrapped_model = runner.engine.unwrap_model(runner.model)
unwrapped_model.load_state_dict(load_checkpoint(resume_logpath))
except:
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

[pep8] reported by reviewdog 🐶
B901 blind except: statement

try:
unwrapped_model = runner.engine.unwrap_model(runner.model)
unwrapped_model.load_state_dict(load_checkpoint(resume_logpath))
except:
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

[pep8] reported by reviewdog 🐶
E722 do not use bare 'except'

try:
unwrapped_model = runner.engine.unwrap_model(runner.model)
unwrapped_model.load_state_dict(load_checkpoint(resume_logpath))
except:
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

[pep8] reported by reviewdog 🐶
B001 Do not use bare except:, it also catches unexpected events like memory errors, interrupts, system exit, and so on. Prefer except Exception:. If you're sure what you're doing, be explicit and write except BaseException:.

@review-notebook-app
Copy link

Check out this pull request on  ReviewNB

See visual diffs & provide feedback on Jupyter Notebooks.


Powered by ReviewNB

@@ -138,6 +145,9 @@ def spawn(fn: Callable, *args, **kwargs):
world_size: int = 8
return xmp.spawn(fn, args=(world_size,), nprocs=world_size, start_method="fork")

def setup(self, local_rank: int, world_size: int):
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

[pep8] reported by reviewdog 🐶
D102 Missing docstring in public method

@Scitator Scitator merged commit 4ca33a0 into master Feb 6, 2022
@mergify mergify bot deleted the dev22-5 branch February 6, 2022 15:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants