Skip to content

Commit

Permalink
- prepared CM v2.1.0 release
Browse files Browse the repository at this point in the history
- updated script docs
  • Loading branch information
gfursin committed Apr 16, 2024
1 parent eec1bee commit b8fb1e7
Show file tree
Hide file tree
Showing 258 changed files with 1,055 additions and 48 deletions.
2 changes: 1 addition & 1 deletion .github/workflows/test-qaic-compute-sdk-build.yml
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@ jobs:
- name: Install dependencies
run: |
python3 -m pip install cmind
cm pull repo mlcommons@ck
cm pull repo mlcommons@cm4mlops
cm run script --tags=get,sys-utils-cm --quiet
- name: Test QAIC Compute SDK for compilation
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/test-qaic-software-kit.yml
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,7 @@ jobs:
- name: Install dependencies
run: |
python3 -m pip install cmind
cm pull repo mlcommons@ck
cm pull repo mlcommons@cm4mlops
cm run script --tags=get,sys-utils-cm --quiet
- name: Test Software Kit for compilation on Ubuntu 20.04
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/automation/script/module_misc.py
Original file line number Diff line number Diff line change
Expand Up @@ -261,6 +261,10 @@ def doc(i):
# '{{CM_README_TOC}}',
# '</details>',
# '',
'**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/{}).**'.format(meta['alias']),
'',
'',
'',
'Automatically generated README for this automation recipe: **{}**'.format(meta['alias']),
]

Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/activate-python-venv/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/activate-python-venv).**



Automatically generated README for this automation recipe: **activate-python-venv**

Category: **Python automation**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/add-custom-nvidia-system/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/add-custom-nvidia-system).**



Automatically generated README for this automation recipe: **add-custom-nvidia-system**

Category: **MLPerf benchmark support**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/app-image-classification-onnx-py/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/app-image-classification-onnx-py).**



Automatically generated README for this automation recipe: **app-image-classification-onnx-py**

Category: **Modular AI/ML application pipeline**
Expand Down
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/app-image-classification-tf-onnx-cpp).**



Automatically generated README for this automation recipe: **app-image-classification-tf-onnx-cpp**

Category: **Modular AI/ML application pipeline**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/app-image-classification-torch-py/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/app-image-classification-torch-py).**



Automatically generated README for this automation recipe: **app-image-classification-torch-py**

Category: **Modular AI/ML application pipeline**
Expand Down
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/app-image-classification-tvm-onnx-py).**



Automatically generated README for this automation recipe: **app-image-classification-tvm-onnx-py**

Category: **Modular AI/ML application pipeline**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/app-image-corner-detection/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/app-image-corner-detection).**



Automatically generated README for this automation recipe: **app-image-corner-detection**

Category: **Modular application pipeline**
Expand Down
6 changes: 5 additions & 1 deletion cm-mlops/script/app-loadgen-generic-python/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/app-loadgen-generic-python).**



Automatically generated README for this automation recipe: **app-loadgen-generic-python**

Category: **Modular MLPerf inference benchmark pipeline**
Expand Down Expand Up @@ -127,7 +131,7 @@ ___
- Workflow:
1. ***Read "deps" on other CM scripts***
* get,ml-model,cmc
- *Warning: no scripts found*
- CM script: [get-ml-model-abtf-ssd-pytorch](https://github.com/mlcommons/cm4abtf/tree/master/script/get-ml-model-abtf-ssd-pytorch)
* `_custom,huggingface`
- Workflow:
1. ***Read "deps" on other CM scripts***
Expand Down
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/app-mlperf-inference-ctuning-cpp-tflite).**



Automatically generated README for this automation recipe: **app-mlperf-inference-ctuning-cpp-tflite**

Category: **Modular MLPerf inference benchmark pipeline**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/app-mlperf-inference-dummy/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/app-mlperf-inference-dummy).**



Automatically generated README for this automation recipe: **app-mlperf-inference-dummy**

Category: **Modular MLPerf benchmarks**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/app-mlperf-inference-intel/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/app-mlperf-inference-intel).**



Automatically generated README for this automation recipe: **app-mlperf-inference-intel**

Category: **Modular MLPerf benchmarks**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/app-mlperf-inference-mlcommons-cpp/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/app-mlperf-inference-mlcommons-cpp).**



Automatically generated README for this automation recipe: **app-mlperf-inference-mlcommons-cpp**

Category: **Modular MLPerf inference benchmark pipeline**
Expand Down
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/app-mlperf-inference-mlcommons-python).**



Automatically generated README for this automation recipe: **app-mlperf-inference-mlcommons-python**

Category: **Modular MLPerf inference benchmark pipeline**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/app-mlperf-inference-nvidia/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/app-mlperf-inference-nvidia).**



Automatically generated README for this automation recipe: **app-mlperf-inference-nvidia**

Category: **Reproduce MLPerf benchmarks**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/app-mlperf-inference-qualcomm/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/app-mlperf-inference-qualcomm).**



Automatically generated README for this automation recipe: **app-mlperf-inference-qualcomm**

Category: **Modular MLPerf benchmarks**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/app-mlperf-inference/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/app-mlperf-inference).**



Automatically generated README for this automation recipe: **app-mlperf-inference**

Category: **Modular MLPerf inference benchmark pipeline**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/app-mlperf-training-nvidia/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/app-mlperf-training-nvidia).**



Automatically generated README for this automation recipe: **app-mlperf-training-nvidia**

Category: **Modular MLPerf training benchmark pipeline**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/app-mlperf-training-reference/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/app-mlperf-training-reference).**



Automatically generated README for this automation recipe: **app-mlperf-training-reference**

Category: **Modular MLPerf training benchmark pipeline**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/app-stable-diffusion-onnx-py/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/app-stable-diffusion-onnx-py).**



Automatically generated README for this automation recipe: **app-stable-diffusion-onnx-py**

Category: **Modular AI/ML application pipeline**
Expand Down
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/benchmark-any-mlperf-inference-implementation).**



Automatically generated README for this automation recipe: **benchmark-any-mlperf-inference-implementation**

Category: **MLPerf benchmark support**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/benchmark-program-mlperf/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/benchmark-program-mlperf).**



Automatically generated README for this automation recipe: **benchmark-program-mlperf**

Category: **Modular MLPerf inference benchmark pipeline**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/benchmark-program/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/benchmark-program).**



Automatically generated README for this automation recipe: **benchmark-program**

Category: **DevOps automation**
Expand Down
5 changes: 5 additions & 0 deletions cm-mlops/script/build-docker-image/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/build-docker-image).**



Automatically generated README for this automation recipe: **build-docker-image**

Category: **Docker automation**
Expand Down Expand Up @@ -153,6 +157,7 @@ ___
#### New environment keys auto-detected from customize

* `CM_DOCKER_BUILD_ARGS`
* `CM_DOCKER_BUILD_CMD`
* `CM_DOCKER_CACHE_ARG`
* `CM_DOCKER_IMAGE_NAME`
* `CM_DOCKER_IMAGE_REPO`
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/build-dockerfile/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/build-dockerfile).**



Automatically generated README for this automation recipe: **build-dockerfile**

Category: **Docker automation**
Expand Down
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/build-mlperf-inference-server-nvidia).**



Automatically generated README for this automation recipe: **build-mlperf-inference-server-nvidia**

Category: **MLPerf benchmark support**
Expand Down
6 changes: 5 additions & 1 deletion cm-mlops/script/calibrate-model-for.qaic/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/calibrate-model-for.qaic).**



Automatically generated README for this automation recipe: **calibrate-model-for.qaic**

Category: **AI/ML optimization**
Expand Down Expand Up @@ -251,8 +255,8 @@ ___
- CM script: [get-preprocessed-dataset-squad](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-preprocessed-dataset-squad)
* get,ml-model
* CM names: `--adr.['model-src']...`
- CM script: [get-ml-model-abtf-ssd-pytorch](https://github.com/mlcommons/cm4abtf/tree/master/script/get-ml-model-abtf-ssd-pytorch)
- CM script: [get-ml-model-3d-unet-kits19](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-ml-model-3d-unet-kits19)
- CM script: [get-ml-model-abtf-ssd-pytorch](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-ml-model-abtf-ssd-pytorch)
- CM script: [get-ml-model-bert-base-squad](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-ml-model-bert-base-squad)
- CM script: [get-ml-model-bert-large-squad](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-ml-model-bert-large-squad)
- CM script: [get-ml-model-dlrm-terabyte](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-ml-model-dlrm-terabyte)
Expand Down
6 changes: 5 additions & 1 deletion cm-mlops/script/compile-model-for.qaic/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/compile-model-for.qaic).**



Automatically generated README for this automation recipe: **compile-model-for.qaic**

Category: **AI/ML optimization**
Expand Down Expand Up @@ -395,8 +399,8 @@ ___
- CM script: [calibrate-model-for.qaic](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/calibrate-model-for.qaic)
* get,ml-model
* CM names: `--adr.['model-src']...`
- CM script: [get-ml-model-abtf-ssd-pytorch](https://github.com/mlcommons/cm4abtf/tree/master/script/get-ml-model-abtf-ssd-pytorch)
- CM script: [get-ml-model-3d-unet-kits19](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-ml-model-3d-unet-kits19)
- CM script: [get-ml-model-abtf-ssd-pytorch](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-ml-model-abtf-ssd-pytorch)
- CM script: [get-ml-model-bert-base-squad](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-ml-model-bert-base-squad)
- CM script: [get-ml-model-bert-large-squad](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-ml-model-bert-large-squad)
- CM script: [get-ml-model-dlrm-terabyte](https://github.com/mlcommons/ck/tree/master/cm-mlops/script/get-ml-model-dlrm-terabyte)
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/compile-program/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/compile-program).**



Automatically generated README for this automation recipe: **compile-program**

Category: **DevOps automation**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/convert-csv-to-md/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/convert-csv-to-md).**



Automatically generated README for this automation recipe: **convert-csv-to-md**

Category: **DevOps automation**
Expand Down
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/convert-ml-model-huggingface-to-onnx).**



Automatically generated README for this automation recipe: **convert-ml-model-huggingface-to-onnx**

Category: **AI/ML models**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/copy-to-clipboard/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/copy-to-clipboard).**



Automatically generated README for this automation recipe: **copy-to-clipboard**

Category: **DevOps automation**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/create-conda-env/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/create-conda-env).**



Automatically generated README for this automation recipe: **create-conda-env**

Category: **DevOps automation**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/create-fpgaconvnet-app-tinyml/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/create-fpgaconvnet-app-tinyml).**



Automatically generated README for this automation recipe: **create-fpgaconvnet-app-tinyml**

Category: **TinyML automation**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/create-fpgaconvnet-config-tinyml/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/create-fpgaconvnet-config-tinyml).**



Automatically generated README for this automation recipe: **create-fpgaconvnet-config-tinyml**

Category: **TinyML automation**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/create-patch/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/create-patch).**



Automatically generated README for this automation recipe: **create-patch**

Category: **DevOps automation**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/destroy-terraform/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/destroy-terraform).**



Automatically generated README for this automation recipe: **destroy-terraform**

Category: **Cloud automation**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/detect-cpu/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/detect-cpu).**



Automatically generated README for this automation recipe: **detect-cpu**

Category: **Platform information**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/detect-os/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/detect-os).**



Automatically generated README for this automation recipe: **detect-os**

Category: **Platform information**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/detect-sudo/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/detect-sudo).**



Automatically generated README for this automation recipe: **detect-sudo**

Category: **DevOps automation**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/download-and-extract/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/download-and-extract).**



Automatically generated README for this automation recipe: **download-and-extract**

Category: **DevOps automation**
Expand Down
4 changes: 4 additions & 0 deletions cm-mlops/script/download-file/README.md
Original file line number Diff line number Diff line change
@@ -1,3 +1,7 @@
**Note that this script is archived and moved [here](https://github.com/mlcommons/cm4mlops/tree/main/script/download-file).**



Automatically generated README for this automation recipe: **download-file**

Category: **DevOps automation**
Expand Down
Loading

0 comments on commit b8fb1e7

Please sign in to comment.