Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Propagate PYTHONPATH like NCCL env variables #91

Closed
jeffra opened this issue Feb 20, 2020 · 0 comments · Fixed by #93
Closed

Propagate PYTHONPATH like NCCL env variables #91

jeffra opened this issue Feb 20, 2020 · 0 comments · Fixed by #93
Assignees
@jeffra
Labels
enhancement New feature or request

Comments

@jeffra
Copy link
Collaborator

jeffra commented Feb 20, 2020

DeepSpeed run should propagate python path just like we are doing NCCL vars.
@jeffra jeffra added the enhancement New feature or request label Feb 20, 2020
@jeffra jeffra self-assigned this Feb 20, 2020
@jeffra jeffra mentioned this issue Feb 20, 2020
Merged
@jeffra jeffra linked a pull request Feb 20, 2020 that will close this issue
Include pythonpath and local dir in launch env #93
Merged
samyam pushed a commit that referenced this issue Nov 24, 2020
@tjruwase
Add request queues to aio handle (#91)
b2cb5e5 
* Support GPU tensors

* Disable test_pipe.py to debug CI

* Add Request queues to Handle to support multiple asynchronous calls

* Enable distributed tests

* Remove debug print
rraminen pushed a commit to rraminen/DeepSpeed that referenced this issue Apr 28, 2021
@jeffra @samyam @tjruwase
Megatron + ZeRO-3 (microsoft#91)
2cd968f 
Co-authored-by: Samyam Rajbhandari <samyamr@microsoft.com>
Co-authored-by: Shaden Smith <Shaden.Smith@microsoft.com>
Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>
Co-authored-by: Samyam Rajbhandari <samyamr@microsoft.com>
Co-authored-by: Shaden Smith <Shaden.Smith@microsoft.com>
Co-authored-by: Olatunji Ruwase <olruwase@microsoft.com>
delock pushed a commit to delock/DeepSpeedSYCLSupport that referenced this issue Nov 8, 2022
@guoyejun
update submodule deepspeedexamples (microsoft#91)
d837b98 
commit 7ebfd3fcce6008cf67ba85af4e8b7f5e24cea9b0 (HEAD, origin/xpu-main, origin/HEAD)
Author: Guo Yejun <yejun.guo@intel.com>
Date:   Thu Oct 13 23:12:04 2022 +0800

    pretrain_gpt2.py: do pytorch profiler at the last iteration (#23)

    and don't add the last iteration time into average since the pt
    profiler might impact performance.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jeffra jeffra

Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Include pythonpath and local dir in launch env microsoft/DeepSpeed
1 participant
@jeffra