Buildkite failing on all EUI upgrades

[nickofthyme]

Buildkite has consistently failed to prepare working directory for PRs generated by @renovate-bot to upgrade eui. While other upgrade PRs like #2030 and others are unaffected.

See

• https://buildkite.com/elastic/datavis-ci/builds/1939
• https://buildkite.com/elastic/datavis-ci/builds/2119

Error displays as...

Preparing working directory | 5s
-- | --
  | # Creating "/var/lib/buildkite-agent/builds/kb-dv-n2-2-ffdebb6a10f29713/elastic/datavis-ci"
  | $ cd /var/lib/buildkite-agent/builds/kb-dv-n2-2-ffdebb6a10f29713/elastic/datavis-ci
  | # Using git-mirrors experiment 🧪
  | $ cd /var/lib/gitmirrors
  | # Updating existing repository mirror to find commit dd7dc2ccd8041c222f67555e0854098adf98a3bd
  | $ git --git-dir /var/lib/gitmirrors/https---github-com-elastic-elastic-charts-git remote set-url origin https://github.com/elastic/elastic-charts.git
  | $ git --git-dir /var/lib/gitmirrors/https---github-com-elastic-elastic-charts-git fetch origin elastic-eui-77.x
  | fatal: couldn't find remote ref elastic-eui-77.x
  | ⚠️ Warning: Checkout failed! exit status 128 (Attempt 1/3 Retrying in 2s)
  | # Removing /var/lib/buildkite-agent/builds/kb-dv-n2-2-ffdebb6a10f29713/elastic/datavis-ci
  | # Creating "/var/lib/buildkite-agent/builds/kb-dv-n2-2-ffdebb6a10f29713/elastic/datavis-ci"
  | $ cd /var/lib/buildkite-agent/builds/kb-dv-n2-2-ffdebb6a10f29713/elastic/datavis-ci
  | # Using git-mirrors experiment 🧪
  | $ cd /var/lib/gitmirrors
  | # Updating existing repository mirror to find commit dd7dc2ccd8041c222f67555e0854098adf98a3bd
  | $ git --git-dir /var/lib/gitmirrors/https---github-com-elastic-elastic-charts-git remote set-url origin https://github.com/elastic/elastic-charts.git
  | $ git --git-dir /var/lib/gitmirrors/https---github-com-elastic-elastic-charts-git fetch origin elastic-eui-77.x
  | fatal: couldn't find remote ref elastic-eui-77.x
  | ⚠️ Warning: Checkout failed! exit status 128 (Attempt 2/3 Retrying in 2s)
  | # Removing /var/lib/buildkite-agent/builds/kb-dv-n2-2-ffdebb6a10f29713/elastic/datavis-ci
  | # Creating "/var/lib/buildkite-agent/builds/kb-dv-n2-2-ffdebb6a10f29713/elastic/datavis-ci"
  | $ cd /var/lib/buildkite-agent/builds/kb-dv-n2-2-ffdebb6a10f29713/elastic/datavis-ci
  | # Using git-mirrors experiment 🧪
  | $ cd /var/lib/gitmirrors
  | # Updating existing repository mirror to find commit dd7dc2ccd8041c222f67555e0854098adf98a3bd
  | $ git --git-dir /var/lib/gitmirrors/https---github-com-elastic-elastic-charts-git remote set-url origin https://github.com/elastic/elastic-charts.git
  | $ git --git-dir /var/lib/gitmirrors/https---github-com-elastic-elastic-charts-git fetch origin elastic-eui-77.x
  | fatal: couldn't find remote ref elastic-eui-77.x
  | ⚠️ Warning: Checkout failed! exit status 128 (Attempt 3/3)
  | # Removing /var/lib/buildkite-agent/builds/kb-dv-n2-2-ffdebb6a10f29713/elastic/datavis-ci
  | # Creating "/var/lib/buildkite-agent/builds/kb-dv-n2-2-ffdebb6a10f29713/elastic/datavis-ci"
  | $ cd /var/lib/buildkite-agent/builds/kb-dv-n2-2-ffdebb6a10f29713/elastic/datavis-ci
  | 🚨 Error: exit status 128

[nickofthyme]

Just opened this to track for now.

[markov00]

it is strange but the way it pulls the PR is different. On a working PR it pulls like fetch origin refs/pull/2030/head

# Updating existing repository mirror to find commit 74b00a0abcc944917175cc77f267ec5cd26e68ad
--
  | $ git --git-dir /var/lib/gitmirrors/https---github-com-elastic-elastic-charts-git remote set-url origin https://github.com/elastic/elastic-charts.git
  | # Fetch and mirror pull request head from GitHub
  | $ git --git-dir /var/lib/gitmirrors/https---github-com-elastic-elastic-charts-git fetch origin refs/pull/2030/head

where on EUI tries fetch origin elastic-eui-77.x

Updating existing repository mirror to find commit dd7dc2ccd8041c222f67555e0854098adf98a3bd
--
  | $ git --git-dir /var/lib/gitmirrors/https---github-com-elastic-elastic-charts-git remote set-url origin https://github.com/elastic/elastic-charts.git
  | $ git --git-dir /var/lib/gitmirrors/https---github-com-elastic-elastic-charts-git fetch origin elastic-eui-77.x
  | fatal: couldn't find remote ref elastic-eui-77.x