Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Distributed unit tests. #4

Closed
ShadenSmith opened this issue Feb 4, 2020 · 2 comments · Fixed by #6
Closed

Distributed unit tests. #4

ShadenSmith opened this issue Feb 4, 2020 · 2 comments · Fixed by #6
Assignees
Labels
enhancement New feature or request

Comments

@ShadenSmith
Copy link
Contributor

DeepSpeed needs an easy way to write distributed, multi-GPU unit tests.

@ShadenSmith ShadenSmith added the enhancement New feature or request label Feb 4, 2020
@ShadenSmith ShadenSmith self-assigned this Feb 4, 2020
@ShadenSmith
Copy link
Contributor Author

This is addressed by PR #6.

@jeffra jeffra linked a pull request Feb 4, 2020 that will close this issue
@jeffra
Copy link
Contributor

jeffra commented Feb 4, 2020

Complete

@jeffra jeffra closed this as completed Feb 4, 2020
rraminen pushed a commit to rraminen/DeepSpeed that referenced this issue Apr 28, 2021
jeffra pushed a commit that referenced this issue Jul 22, 2021
liamcli pushed a commit to determined-ai/DeepSpeed that referenced this issue Sep 27, 2021
Merge latest changes from DeepSpeed
delock referenced this issue in delock/DeepSpeedSYCLSupport Sep 21, 2022
…t#60)

commit a8c119455d2ab3e58f9f6714f023fa0c0c0be817 (HEAD -> xpu-main, origin/xpu-main, origin/HEAD)
Author: Guo Yejun <yejun.guo@intel.com>
Date:   Thu Jul 21 01:18:39 2022 -0700

    add locate data

commit 79ee62539d76c3fefd5b1277b46077217eed71c7
Author: Liangliang-Ma <1906710196@qq.com>
Date:   Fri Aug 26 17:12:26 2022 +0800

    megatron with zero offload scripts (#6)

commit 38cb62ae4a8b468f27e3dddf929e3e53d302bb44
Author: Guo Yejun <yejun.guo@intel.com>
Date:   Fri Aug 19 08:32:34 2022 -0700

    ds_zero2_config_bf16.json&gpt-3.6b.sh: update bs per tile from 1 to 8

commit 65e6bb5e33d5a1244ce665b826f278244f5d0790
Author: Guo Yejun <yejun.guo@intel.com>
Date:   Tue Aug 2 20:49:38 2022 +0800

    ds_zero2_config_bf16.json: use the correct option flops_profiler (#4)
jeffra added a commit that referenced this issue Nov 9, 2022
Co-authored-by: cmikeh2 <connorholmes@microsoft.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants