forked from microsoft/onnxruntime
-
Notifications
You must be signed in to change notification settings - Fork 0
/
README.txt
35 lines (28 loc) · 1.39 KB
/
README.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
onnx_test_runner [options...] <data_root>
Options:
-j [models]: Specifies the number of models to run simultaneously.
-c [runs]: Specifies the number of Session::Run() to invoke simultaneously for each model.
-n [test_case_name]: Specifies a single test case to run.
-p [PLANNER_TYPE]: PLANNER_TYPE could be 'seq' or 'simple'. Default: 'simple'.
-e [EXECUTION_PROVIDER]: EXECUTION_PROVIDER could be 'cpu', 'cuda', 'dnnl', 'tensorrt', 'nuphar' or 'acl'. Default: 'cpu'.
-h: help
The debug version of this program depends on dbghelp.dll. Please make sure it's in your PATH.
How to run node tests:
1. Install onnx from onnxruntime\cmake\external\onnx
2. Execute test data generator:
backend-test-tools generate-data -o <some_empty_folder>
e.g.
backend-test-tools generate-data -o C:\testdata
backend-test-tools is a tool under C:\Python35\Scripts (If your python was installed to C:\Python35)
3. compile onnx_test_runner and run
onnx_test_runner <test_data_dir>
e.g.
onnx_test_runner C:\testdata\node
How to run model tests:
1. Download the test data from Azure
You can get the latest url from tools/ci_build/github/azure-pipelines/templates/set-test-data-variables-step.yml
After downloading, please unzip the downloaded file
2. compile onnx_test_runner and run
onnx_test_runner <test_data_dir>
e.g.
onnx_test_runner C:\testdata