Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Benchmarks: Add benchmark: Megatron-LM/Megatron-Deepspeed GPT pretrain benchmark #582

Merged
merged 23 commits into from
Dec 7, 2023

Conversation

yukirora
Copy link
Contributor

@yukirora yukirora commented Dec 4, 2023

Description
Megatron-LM/Megatron-Deepspeed GPT pretrain benchmark

@yukirora yukirora requested a review from a team as a code owner December 4, 2023 02:13
Copy link

codecov bot commented Dec 4, 2023

Codecov Report

Attention: 65 lines in your changes are missing coverage. Please review.

Comparison is base (254ea7f) 86.36% compared to head (5a47989) 85.98%.

Files Patch % Lines
...bench/benchmarks/model_benchmarks/megatron_gpt3.py 76.89% 61 Missing ⚠️
...perbench/benchmarks/model_benchmarks/model_base.py 55.55% 4 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main     #582      +/-   ##
==========================================
- Coverage   86.36%   85.98%   -0.38%     
==========================================
  Files          96       97       +1     
  Lines        6573     6845     +272     
==========================================
+ Hits         5677     5886     +209     
- Misses        896      959      +63     
Flag Coverage Δ
cpu-python3.6-unit-test 71.99% <76.36%> (+0.20%) ⬆️
cpu-python3.7-unit-test 71.99% <76.36%> (+0.20%) ⬆️
cpu-python3.8-unit-test 72.40% <76.36%> (+0.18%) ⬆️
cuda-unit-test 84.00% <76.36%> (-0.30%) ⬇️
directx-unit-test 35.31% <31.63%> (-0.17%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@cp5555 cp5555 added benchmarks SuperBench Benchmarks model-benchmarks Model Benchmark Test for SuperBench Benchmarks labels Dec 4, 2023
@cp5555 cp5555 requested a review from guoshzhao December 5, 2023 08:08
@cp5555 cp5555 mentioned this pull request Dec 5, 2023
30 tasks
@yukirora yukirora enabled auto-merge (squash) December 5, 2023 13:23
@yukirora yukirora mentioned this pull request Dec 6, 2023
29 tasks
@yukirora yukirora merged commit dd5a632 into main Dec 7, 2023
22 of 23 checks passed
@yukirora yukirora deleted the yutji/megatron-ds branch December 7, 2023 01:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
benchmarks SuperBench Benchmarks model-benchmarks Model Benchmark Test for SuperBench Benchmarks
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants