From e7d312451004171ed2a10562354940c975c54245 Mon Sep 17 00:00:00 2001 From: Scott Todd Date: Wed, 10 Jul 2024 17:59:13 -0700 Subject: [PATCH] Bump goldentime values for mi250 sdxl benchmarks. (#17860) Seeing some variance causing CI failures with unrelated changes: * https://github.com/iree-org/iree/actions/runs/9879301822/job/27286342282#step:15:46 * `VAE Decode Benchmark Time: 295.0 ms (golden time 291.0 ms)` * `Prompt Encoder Benchmark Time: 17.2 ms (golden time 17.0 ms)` * https://github.com/iree-org/iree/actions/runs/9877397187/job/27279465007 * `VAE Decode Benchmark Time: 295.0 ms (golden time 291.0 ms)` * `Prompt Encoder Benchmark Time: 17.1 ms (golden time 17.0 ms)` Aside: we might want to move the benchmarks to a `pkgci_benchmarks.yml` workflow instead of chaining them on to the end of `pkgci_regression_test.yml`. ci-exactly: build_packages,regression_test Signed-off-by: saienduri --- .github/workflows/pkgci_regression_test.yml | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/.github/workflows/pkgci_regression_test.yml b/.github/workflows/pkgci_regression_test.yml index f2dab0bb3f9d..0b3e54ee5f6c 100644 --- a/.github/workflows/pkgci_regression_test.yml +++ b/.github/workflows/pkgci_regression_test.yml @@ -283,8 +283,8 @@ jobs: pytest SHARK-TestSuite/iree_tests/benchmarks/sdxl/benchmark_sdxl_rocm.py \ --goldentime-rocm-e2e-ms 1336.0 \ --goldentime-rocm-unet-ms 340.0 \ - --goldentime-rocm-clip-ms 17.0 \ - --goldentime-rocm-vae-ms 291.0 \ + --goldentime-rocm-clip-ms 17.5 \ + --goldentime-rocm-vae-ms 300.0 \ --goldendispatch-rocm-unet 1714 \ --goldendispatch-rocm-clip 1569 \ --goldendispatch-rocm-vae 248 \