Performance Regression or Improvement: Pytorch image classification on 50k images of size 224 x 224 with resnet 152 with Tesla T4 GPU:mean_load_model_latency_milli_secs #26001
Description
Performance change found in the
test: Pytorch image classification on 50k images of size 224 x 224 with resnet 152 with Tesla T4 GPU:apache_beam.testing.benchmarks.inference.pytorch_image_classification_benchmarks for the metric: mean_load_model_latency_milli_secs.
For more information on how to triage the alerts, please look at
Triage performance alert issues section of the README.
timestamp: Mon Mar 27 18:25:38 2023, metric_value: `112130.83928571429`
timestamp: Sun Mar 26 18:21:12 2023, metric_value: `91840.19642857143`
timestamp: Sat Mar 25 18:27:50 2023, metric_value: `98015.64285714286`
timestamp: Fri Mar 24 18:30:46 2023, metric_value: `111115.73214285714`
timestamp: Thu Mar 23 18:28:27 2023, metric_value: `101139.98214285714`
timestamp: Wed Mar 22 18:35:18 2023, metric_value: `101077.625`
timestamp: Tue Mar 21 18:34:17 2023, metric_value: `110228.39285714286`
timestamp: Mon Mar 20 18:38:44 2023, metric_value: `116172.33928571429`
timestamp: Fri Mar 17 18:54:55 2023, metric_value: `111758.16071428571`
timestamp: Wed Mar 15 18:39:24 2023, metric_value: `110663.89090909091`
timestamp: Tue Mar 14 18:20:28 2023, metric_value: `106096.67857142857` <---- Anomaly
timestamp: Mon Mar 13 18:52:40 2023, metric_value: `124759.4`
timestamp: Sun Mar 12 18:17:56 2023, metric_value: `134102.17857142858`
timestamp: Sat Mar 11 18:19:42 2023, metric_value: `136957.125`
timestamp: Fri Mar 10 18:21:33 2023, metric_value: `152183.0892857143`
timestamp: Thu Mar 9 18:26:05 2023, metric_value: `156150.64285714287`
timestamp: Wed Mar 8 18:25:08 2023, metric_value: `147711.76785714287`
timestamp: Tue Mar 7 18:23:57 2023, metric_value: `146152.57142857142`
timestamp: Tue Mar 7 01:20:20 2023, metric_value: `152064.64285714287`
timestamp: Mon Mar 6 18:24:23 2023, metric_value: `140394.9655172414`
timestamp: Sun Mar 5 18:22:04 2023, metric_value: `136059.73214285713`