Completeness of benchmark_results.json Output #57
Description
Going forward, the benchmark_results.json file produced by endpoints will be treated as the superset of MLPerf results. At present, the file contains limited information, and we need to ensure that it captures a complete and comprehensive set of benchmark outputs.
The current contents:
anandhusooraj@mlc2:~/endp$ cat benchmark_results.json
{
"config": {
"endpoint": "http://localhost:1143",
"mode": "perf",
"target_qps": 600.0
},
"results": {
"total": 600,
"successful": 600,
"failed": 0,
"elapsed_time": 22.76142382621765,
"qps": 26.360389603961966
}
}