Compiler performance smoke tests are currently broken

[jamieQ]

Description

the swift-ci job that run when you invoke @swift-ci Please smoke test compiler performance appears to currently be broken (and likely has been for some time). as shown here, at least one of the projects in the suite is trying to check out a non-existent commit from the target repository, which causes the job to fail.

a potential fix is to adjust each configuration to ensure the commits reference release tags in the repo (which hopefully should 'always' exist).

Reproduction

invoke the job on an open PR to see the issue

Expected behavior

the job should successfully check out the performance testing suite targets (and ideally run to completion)

Environment

n/a

Additional information

No response

[finagolfin]

The source compat suite is open source: can you submit a fix, if you know what the problem is?

[xedin]

*could you please

[jamieQ]

attempt at a minimal solution to this is here: swiftlang/swift-source-compat-suite#965