Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release - SuperBench v0.4.0 #278

Merged
merged 11 commits into from
Dec 30, 2021
Merged

Release - SuperBench v0.4.0 #278

merged 11 commits into from
Dec 30, 2021

Conversation

abuccts
Copy link
Member

@abuccts abuccts commented Dec 29, 2021

Description

Cherry-pick bug fixes from v0.4.0 to main.

Major Revisions

Co-authored-by: Yuting Jiang v-yutjiang@microsoft.com

abuccts and others added 11 commits December 29, 2021 14:44
__Description__

Fix issues for Ansible and benchmarks:
* Cleanup Ansible runner private data dir to avoid out of disk space issue when node number is large.
* Support both absolute and relative paths when fecth results.
* Use a deterministic image in Ansible test to avoid image update.
* Update logging format.
* Delete torch models and inputs after export.
__Description__

Refine test cases for microbenchmark:
* Refine test fixture, add BenchmarkTestCase class.
* Refine test data.
* Resolve no numa issue for test_ib_loopback_util case.
**Description**
Build openmpi with ucx support in rocm dockerfiles.
**Description**
Fix fio build issue (Illegal instruction).
Refer to axboe/fio#970
**Description**
Unify metric and add doc for cuBLAS and cuDNN functions.
…t summary (#274)

**Description**
Add 'monitor/' prefix to monitor metrics in result summary.
**Description**
Fix bug of detecting if gpu_index is none.
**Description**
Fix bugs in data diagnosis.

**Major Revision**
- fix package import issue of file_handler
- deal with monitor metrics
- fix typo in output_path
…stfile (#270)

**Description**
Launch mpi on the sorted first host in the hostfile.
…n configs (#276)

**Description**
Update inference and network benchmarks in configs.
__Description__

Upgrade version and release note.

__Major Revision__

- Upgrade package versions
- Add release note for v0.4.0
@abuccts abuccts requested review from cp5555 and a team as code owners December 29, 2021 06:49
@codecov
Copy link

codecov bot commented Dec 29, 2021

Codecov Report

Merging #278 (d04bfd6) into main (682ed06) will increase coverage by 0.71%.
The diff coverage is 100.00%.

Impacted file tree graph

@@            Coverage Diff             @@
##             main     #278      +/-   ##
==========================================
+ Coverage   87.81%   88.53%   +0.71%     
==========================================
  Files          75       75              
  Lines        4350     4368      +18     
==========================================
+ Hits         3820     3867      +47     
+ Misses        530      501      -29     
Flag Coverage Δ
cpu-unit-test 72.26% <65.90%> (+0.11%) ⬆️
cuda-unit-test 88.46% <100.00%> (+0.69%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
superbench/__init__.py 100.00% <100.00%> (ø)
superbench/analyzer/data_diagnosis.py 92.14% <100.00%> (+2.43%) ⬆️
...nchmarks/micro_benchmarks/_export_torch_to_onnx.py 95.83% <100.00%> (+0.71%) ⬆️
...nch/benchmarks/micro_benchmarks/cublas_function.py 85.52% <100.00%> (ø)
...ench/benchmarks/micro_benchmarks/cudnn_function.py 85.52% <100.00%> (+0.19%) ⬆️
...arks/micro_benchmarks/ib_validation_performance.py 89.58% <100.00%> (+2.60%) ⬆️
superbench/runner/ansible.py 98.07% <100.00%> (+0.20%) ⬆️
superbench/runner/runner.py 91.66% <100.00%> (+4.95%) ⬆️
superbench/common/utils/network.py 38.70% <0.00%> (-25.81%) ⬇️
superbench/analyzer/file_handler.py 82.17% <0.00%> (-1.99%) ⬇️
... and 5 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 682ed06...d04bfd6. Read the comment docs.

@abuccts abuccts merged commit ff563b6 into main Dec 30, 2021
@abuccts abuccts deleted the xiongyf/cherrypick-0.4 branch December 30, 2021 08:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants