422 Error thrown from GitHub

[johan-lindqvist]

I'm using the Mend Renovate hosted app on github.com.

• I'm using the Mend Renovate hosted app.

Was this something which used to work for you, and then stopped?

It used to work, and then stopped

Describe your problem.

How are you running Renovate?
Mend Renovate hosted app on github.com

If you're self-hosting Renovate, tell us what version of Renovate you run.
No response

If you're self-hosting Renovate, select which platform you are using.
None

Was this something which used to work for you, and then stopped?
It used to work, and then stopped

Describe the bug
Getting 422 error from GitHub. Not sure when this started happening but it seems to have been in the latest 2 weeks since the last package update we got from renovate was around 2 weeks ago.

Attached logs with the 422 errors, not sure if I can repro this easily, hopefully you can see the issue in the logs otherwise I'll try to make a repro.

Have you created a minimal reproduction repository?
I have explained in the description why a minimal reproduction is impossible

Relevant debug logs.

Logs

DEBUG: 422 Error thrown from GitHub(branch="renovate/microsoft.azure.cosmos-3.x")
{
  "err": {
    "name": "HTTPError",
    "code": "ERR_NON_2XX_3XX_RESPONSE",
    "timings": {
      "start": 1684135990742,
      "socket": 1684135990743,
      "lookup": 1684135990750,
      "connect": 1684135990750,
      "secureConnect": 1684135990762,
      "upload": 1684135990762,
      "response": 1684135991038,
      "end": 1684135991039,
      "phases": {
        "wait": 1,
        "dns": 7,
        "tcp": 0,
        "tls": 12,
        "request": 0,
        "firstByte": 276,
        "download": 1,
        "total": 297
      }
    },
    "message": "Response code 422 (Unprocessable Entity)",
    "stack": "HTTPError: Response code 422 (Unprocessable Entity)\n    at Request.<anonymous> (/home/ubuntu/renovateapp/node_modules/got/dist/source/as-promise/index.js:118:42)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)",
    "options": {
      "headers": {
        "user-agent": "Renovate Bot (GitHub App 2740)",
        "accept": "application/json, application/vnd.github.machine-man-preview+json",
        "authorization": "***********",
        "content-type": "application/json",
        "content-length": "105",
        "accept-encoding": "gzip, deflate, br"
      },
      "url": "https://api.github.com/repos/<org>/<repo>/git/refs",
      "hostType": "github",
      "username": "",
      "password": "",
      "method": "POST",
      "http2": false
    },
    "response": {
      "statusCode": 422,
      "statusMessage": "Unprocessable Entity",
      "body": {
        "message": "Reference update failed",
        "documentation_url": "https://docs.github.com/rest/reference/git#create-a-reference"
      },
      "headers": {
        "server": "GitHub.com",
        "date": "Mon, 15 May 2023 07:33:11 GMT",
        "content-type": "application/json; charset=utf-8",
        "content-length": "121",
        "x-github-media-type": "github.v3; param=machine-man-preview",
        "x-github-api-version-selected": "2022-11-28",
        "x-ratelimit-limit": "15000",
        "x-ratelimit-remaining": "14828",
        "x-ratelimit-reset": "1684137293",
        "x-ratelimit-used": "172",
        "x-ratelimit-resource": "core",
        "access-control-expose-headers": "ETag, Link, Location, Retry-After, X-GitHub-OTP, X-RateLimit-Limit, X-RateLimit-Remaining, X-RateLimit-Used, X-RateLimit-Resource, X-RateLimit-Reset, X-OAuth-Scopes, X-Accepted-OAuth-Scopes, X-Poll-Interval, X-GitHub-Media-Type, X-GitHub-SSO, X-GitHub-Request-Id, Deprecation, Sunset",
        "access-control-allow-origin": "*",
        "strict-transport-security": "max-age=31536000; includeSubdomains; preload",
        "x-frame-options": "deny",
        "x-content-type-options": "nosniff",
        "x-xss-protection": "0",
        "referrer-policy": "origin-when-cross-origin, strict-origin-when-cross-origin",
        "content-security-policy": "default-src 'none'",
        "vary": "Accept-Encoding, Accept, X-Requested-With",
        "x-github-request-id": "A19E:35A0:7C3DEBF:8072B4A:6461E036",
        "connection": "close"
      },
      "httpVersion": "1.1",
      "retryCount": 0
    }
  }
}
DEBUG: Platform-native commit: unknown error(branch="renovate/microsoft.azure.cosmos-3.x")
{
  "branchName": "renovate/microsoft.azure.cosmos-3.x",
  "err": {
    "hostType": "github",
    "err": {
      "name": "HTTPError",
      "code": "ERR_NON_2XX_3XX_RESPONSE",
      "timings": {
        "start": 1684135990742,
        "socket": 1684135990743,
        "lookup": 1684135990750,
        "connect": 1684135990750,
        "secureConnect": 1684135990762,
        "upload": 1684135990762,
        "response": 1684135991038,
        "end": 1684135991039,
        "phases": {
          "wait": 1,
          "dns": 7,
          "tcp": 0,
          "tls": 12,
          "request": 0,
          "firstByte": 276,
          "download": 1,
          "total": 297
        }
      },
      "message": "Response code 422 (Unprocessable Entity)",
      "stack": "HTTPError: Response code 422 (Unprocessable Entity)\n    at Request.<anonymous> (/home/ubuntu/renovateapp/node_modules/got/dist/source/as-promise/index.js:118:42)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)",
      "options": {
        "headers": {
          "user-agent": "Renovate Bot (GitHub App 2740)",
          "accept": "application/json, application/vnd.github.machine-man-preview+json",
          "authorization": "***********",
          "content-type": "application/json",
          "content-length": "105",
          "accept-encoding": "gzip, deflate, br"
        },
        "url": "https://api.github.com/repos/<org>/<repo>/git/refs",
        "hostType": "github",
        "username": "",
        "password": "",
        "method": "POST",
        "http2": false
      },
      "response": {
        "statusCode": 422,
        "statusMessage": "Unprocessable Entity",
        "body": {
          "message": "Reference update failed",
          "documentation_url": "https://docs.github.com/rest/reference/git#create-a-reference"
        },
        "headers": {
          "server": "GitHub.com",
          "date": "Mon, 15 May 2023 07:33:11 GMT",
          "content-type": "application/json; charset=utf-8",
          "content-length": "121",
          "x-github-media-type": "github.v3; param=machine-man-preview",
          "x-github-api-version-selected": "2022-11-28",
          "x-ratelimit-limit": "15000",
          "x-ratelimit-remaining": "14828",
          "x-ratelimit-reset": "1684137293",
          "x-ratelimit-used": "172",
          "x-ratelimit-resource": "core",
          "access-control-expose-headers": "ETag, Link, Location, Retry-After, X-GitHub-OTP, X-RateLimit-Limit, X-RateLimit-Remaining, X-RateLimit-Used, X-RateLimit-Resource, X-RateLimit-Reset, X-OAuth-Scopes, X-Accepted-OAuth-Scopes, X-Poll-Interval, X-GitHub-Media-Type, X-GitHub-SSO, X-GitHub-Request-Id, Deprecation, Sunset",
          "access-control-allow-origin": "*",
          "strict-transport-security": "max-age=31536000; includeSubdomains; preload",
          "x-frame-options": "deny",
          "x-content-type-options": "nosniff",
          "x-xss-protection": "0",
          "referrer-policy": "origin-when-cross-origin, strict-origin-when-cross-origin",
          "content-security-policy": "default-src 'none'",
          "vary": "Accept-Encoding, Accept, X-Requested-With",
          "x-github-request-id": "A19E:35A0:7C3DEBF:8072B4A:6461E036",
          "connection": "close"
        },
        "httpVersion": "1.1",
        "retryCount": 0
      }
    },
    "message": "external-host-error",
    "stack": "Error: external-host-error\n    at handleGotError (/home/ubuntu/renovateapp/node_modules/renovate/dist/util/http/github.js:93:16)\n    at GithubHttp.request (/home/ubuntu/renovateapp/node_modules/renovate/dist/util/http/github.js:244:19)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n    at async GithubHttp.requestJson (/home/ubuntu/renovateapp/node_modules/renovate/dist/util/http/index.js:195:21)\n    at async ensureBranchSha (/home/ubuntu/renovateapp/node_modules/renovate/dist/modules/platform/github/index.js:595:5)\n    at async pushFiles (/home/ubuntu/renovateapp/node_modules/renovate/dist/modules/platform/github/index.js:1392:9)\n    at async commitFiles (/home/ubuntu/renovateapp/node_modules/renovate/dist/modules/platform/github/index.js:1408:24)\n    at async processBranch (/home/ubuntu/renovateapp/node_modules/renovate/dist/workers/repository/update/branch/index.js:404:25)\n    at async writeUpdates (/home/ubuntu/renovateapp/node_modules/renovate/dist/workers/repository/process/write.js:120:21)\n    at async update (/home/ubuntu/renovateapp/node_modules/renovate/dist/workers/repository/process/extract-update.js:157:15)\n    at async Object.renovateRepository (/home/ubuntu/renovateapp/node_modules/renovate/dist/workers/repository/index.js:61:25)\n    at async renovateRepository (/home/ubuntu/renovateapp/app/worker/index.js:260:26)\n    at async /home/ubuntu/renovateapp/app/worker/index.js:454:5"
  }
}```

</details>

[rarkins]

Please provide the full debug logs for this particular branch in the lead-up to this

[johan-lindqvist]

Whole job log with both 500 internal server error and 422 error
job-log-full.txt

[johan-lindqvist]

Branch filtered log with 422 error

DEBUG: syncBranchState()(branch="renovate/microsoft.azure.cosmos-3.x")
DEBUG: syncBranchState(): update baseBranchSha(branch="renovate/microsoft.azure.cosmos-3.x")
DEBUG: getBranchPr(renovate/microsoft.azure.cosmos-3.x)(branch="renovate/microsoft.azure.cosmos-3.x")
DEBUG: findPr(renovate/microsoft.azure.cosmos-3.x, undefined, open)(branch="renovate/microsoft.azure.cosmos-3.x")
DEBUG: findPr(renovate/microsoft.azure.cosmos-3.x, undefined, closed)(branch="renovate/microsoft.azure.cosmos-3.x")
DEBUG: branchExists=false(branch="renovate/microsoft.azure.cosmos-3.x")
DEBUG: dependencyDashboardCheck=undefined(branch="renovate/microsoft.azure.cosmos-3.x")
DEBUG: recreateClosed is false(branch="renovate/microsoft.azure.cosmos-3.x")
DEBUG: findPr(renovate/microsoft.azure.cosmos-3.x, chore(deps): update dependency microsoft.azure.cosmos to v3.33.0, !open)(branch="renovate/microsoft.azure.cosmos-3.x")
DEBUG: prAlreadyExisted=false(branch="renovate/microsoft.azure.cosmos-3.x")
DEBUG: Checking schedule(at any time, null)(branch="renovate/microsoft.azure.cosmos-3.x")
DEBUG: No schedule defined(branch="renovate/microsoft.azure.cosmos-3.x")
DEBUG: Branch needs creating(branch="renovate/microsoft.azure.cosmos-3.x")
DEBUG: Using reuseExistingBranch: false(branch="renovate/microsoft.azure.cosmos-3.x")
DEBUG: Setting current branch to main(branch="renovate/microsoft.azure.cosmos-3.x")
DEBUG: latest commit(branch="renovate/microsoft.azure.cosmos-3.x")
{
  "branchName": "main",
  "latestCommitDate": "2023-05-12T13:33:52+02:00"
}
DEBUG: manager.getUpdatedPackageFiles() reuseExistingBranch=false(branch="renovate/microsoft.azure.cosmos-3.x")
DEBUG: Starting search at index 2179(packageFile="src/<project>/<project>.csproj", branch="renovate/microsoft.azure.cosmos-3.x")
{
  "depName": "Microsoft.Azure.Cosmos"
}
DEBUG: Found match at index 2179(packageFile="src/<project>/<project>.csproj", branch="renovate/microsoft.azure.cosmos-3.x")
{
  "depName": "Microsoft.Azure.Cosmos"
}
DEBUG: Found NuGet.config at NuGet.config(branch="renovate/microsoft.azure.cosmos-3.x")
DEBUG: clearing registry URLs(branch="renovate/microsoft.azure.cosmos-3.x")
DEBUG: Adding registry URL https://api.nuget.org/v3/index.json(branch="renovate/microsoft.azure.cosmos-3.x")
DEBUG: Adding registry URL https://nuget.pkg.github.com/<org>/index.json(branch="renovate/microsoft.azure.cosmos-3.x")
DEBUG: Contents updated(packageFile="src/<project>/<project>.csproj", branch="renovate/microsoft.azure.cosmos-3.x")
{
  "depName": "Microsoft.Azure.Cosmos"
}
DEBUG: nuget.updateArtifacts(src/<project>/<project>.csproj)(branch="renovate/microsoft.azure.cosmos-3.x")
DEBUG: No lock file found for package or dependents(branch="renovate/microsoft.azure.cosmos-3.x")
{
  "packageFileName": "src/<project>/<project>.csproj"
}
DEBUG: Updated 1 package files(branch="renovate/microsoft.azure.cosmos-3.x")
DEBUG: Getting updated lock files(branch="renovate/microsoft.azure.cosmos-3.x")
DEBUG: Writing package.json files(branch="renovate/microsoft.azure.cosmos-3.x")
{
  "packageFiles": [
    "package.json"
  ]
}
DEBUG: Writing package-lock.json(branch="renovate/microsoft.azure.cosmos-3.x")
DEBUG: Writing any updated package files(branch="renovate/microsoft.azure.cosmos-3.x")
DEBUG: No updated lock files in branch(branch="renovate/microsoft.azure.cosmos-3.x")
DEBUG: 1 file(s) to commit(branch="renovate/microsoft.azure.cosmos-3.x")
DEBUG: Preparing files for committing to branch renovate/microsoft.azure.cosmos-3.x(branch="renovate/microsoft.azure.cosmos-3.x")
DEBUG: Setting git author name: Renovate Bot(branch="renovate/microsoft.azure.cosmos-3.x")
DEBUG: Setting git author email: bot@renovateapp.com(branch="renovate/microsoft.azure.cosmos-3.x")
DEBUG: git commit(branch="renovate/microsoft.azure.cosmos-3.x")
{
  "deletedFiles": [],
  "ignoredFiles": [],
  "result": {
    "author": null,
    "branch": "renovate/microsoft.azure.cosmos-3.x",
    "commit": "668f7318e66d64d659e3a2f6bec0d2d9e8424f86",
    "root": false,
    "summary": {
      "changes": 1,
      "insertions": 1,
      "deletions": 1
    }
  }
}
DEBUG: HEAD https://api.github.com/repos/<org>/<repo>/git/refs/heads/renovate/microsoft.azure.cosmos-3.x = (code=ERR_NON_2XX_3XX_RESPONSE, statusCode=404 retryCount=0, duration=199)(branch="renovate/microsoft.azure.cosmos-3.x")
DEBUG: POST https://api.github.com/repos/<org>/<repo>/git/refs = (code=ERR_NON_2XX_3XX_RESPONSE, statusCode=422 retryCount=0, duration=297)(branch="renovate/microsoft.azure.cosmos-3.x")
DEBUG: 422 Error thrown from GitHub(branch="renovate/microsoft.azure.cosmos-3.x")
{
  "err": {
    "name": "HTTPError",
    "code": "ERR_NON_2XX_3XX_RESPONSE",
    "timings": {
      "start": 1684135990742,
      "socket": 1684135990743,
      "lookup": 1684135990750,
      "connect": 1684135990750,
      "secureConnect": 1684135990762,
      "upload": 1684135990762,
      "response": 1684135991038,
      "end": 1684135991039,
      "phases": {
        "wait": 1,
        "dns": 7,
        "tcp": 0,
        "tls": 12,
        "request": 0,
        "firstByte": 276,
        "download": 1,
        "total": 297
      }
    },
    "message": "Response code 422 (Unprocessable Entity)",
    "stack": "HTTPError: Response code 422 (Unprocessable Entity)\n    at Request.<anonymous> (/home/ubuntu/renovateapp/node_modules/got/dist/source/as-promise/index.js:118:42)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)",
    "options": {
      "headers": {
        "user-agent": "Renovate Bot (GitHub App 2740)",
        "accept": "application/json, application/vnd.github.machine-man-preview+json",
        "authorization": "***********",
        "content-type": "application/json",
        "content-length": "105",
        "accept-encoding": "gzip, deflate, br"
      },
      "url": "https://api.github.com/repos/<org>/<repo>/git/refs",
      "hostType": "github",
      "username": "",
      "password": "",
      "method": "POST",
      "http2": false
    },
    "response": {
      "statusCode": 422,
      "statusMessage": "Unprocessable Entity",
      "body": {
        "message": "Reference update failed",
        "documentation_url": "https://docs.github.com/rest/reference/git#create-a-reference"
      },
      "headers": {
        "server": "GitHub.com",
        "date": "Mon, 15 May 2023 07:33:11 GMT",
        "content-type": "application/json; charset=utf-8",
        "content-length": "121",
        "x-github-media-type": "github.v3; param=machine-man-preview",
        "x-github-api-version-selected": "2022-11-28",
        "x-ratelimit-limit": "15000",
        "x-ratelimit-remaining": "14828",
        "x-ratelimit-reset": "1684137293",
        "x-ratelimit-used": "172",
        "x-ratelimit-resource": "core",
        "access-control-expose-headers": "ETag, Link, Location, Retry-After, X-GitHub-OTP, X-RateLimit-Limit, X-RateLimit-Remaining, X-RateLimit-Used, X-RateLimit-Resource, X-RateLimit-Reset, X-OAuth-Scopes, X-Accepted-OAuth-Scopes, X-Poll-Interval, X-GitHub-Media-Type, X-GitHub-SSO, X-GitHub-Request-Id, Deprecation, Sunset",
        "access-control-allow-origin": "*",
        "strict-transport-security": "max-age=31536000; includeSubdomains; preload",
        "x-frame-options": "deny",
        "x-content-type-options": "nosniff",
        "x-xss-protection": "0",
        "referrer-policy": "origin-when-cross-origin, strict-origin-when-cross-origin",
        "content-security-policy": "default-src 'none'",
        "vary": "Accept-Encoding, Accept, X-Requested-With",
        "x-github-request-id": "A19E:35A0:7C3DEBF:8072B4A:6461E036",
        "connection": "close"
      },
      "httpVersion": "1.1",
      "retryCount": 0
    }
  }
}
DEBUG: Platform-native commit: unknown error(branch="renovate/microsoft.azure.cosmos-3.x")
{
  "branchName": "renovate/microsoft.azure.cosmos-3.x",
  "err": {
    "hostType": "github",
    "err": {
      "name": "HTTPError",
      "code": "ERR_NON_2XX_3XX_RESPONSE",
      "timings": {
        "start": 1684135990742,
        "socket": 1684135990743,
        "lookup": 1684135990750,
        "connect": 1684135990750,
        "secureConnect": 1684135990762,
        "upload": 1684135990762,
        "response": 1684135991038,
        "end": 1684135991039,
        "phases": {
          "wait": 1,
          "dns": 7,
          "tcp": 0,
          "tls": 12,
          "request": 0,
          "firstByte": 276,
          "download": 1,
          "total": 297
        }
      },
      "message": "Response code 422 (Unprocessable Entity)",
      "stack": "HTTPError: Response code 422 (Unprocessable Entity)\n    at Request.<anonymous> (/home/ubuntu/renovateapp/node_modules/got/dist/source/as-promise/index.js:118:42)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)",
      "options": {
        "headers": {
          "user-agent": "Renovate Bot (GitHub App 2740)",
          "accept": "application/json, application/vnd.github.machine-man-preview+json",
          "authorization": "***********",
          "content-type": "application/json",
          "content-length": "105",
          "accept-encoding": "gzip, deflate, br"
        },
        "url": "https://api.github.com/repos/<org>/<repo>/git/refs",
        "hostType": "github",
        "username": "",
        "password": "",
        "method": "POST",
        "http2": false
      },
      "response": {
        "statusCode": 422,
        "statusMessage": "Unprocessable Entity",
        "body": {
          "message": "Reference update failed",
          "documentation_url": "https://docs.github.com/rest/reference/git#create-a-reference"
        },
        "headers": {
          "server": "GitHub.com",
          "date": "Mon, 15 May 2023 07:33:11 GMT",
          "content-type": "application/json; charset=utf-8",
          "content-length": "121",
          "x-github-media-type": "github.v3; param=machine-man-preview",
          "x-github-api-version-selected": "2022-11-28",
          "x-ratelimit-limit": "15000",
          "x-ratelimit-remaining": "14828",
          "x-ratelimit-reset": "1684137293",
          "x-ratelimit-used": "172",
          "x-ratelimit-resource": "core",
          "access-control-expose-headers": "ETag, Link, Location, Retry-After, X-GitHub-OTP, X-RateLimit-Limit, X-RateLimit-Remaining, X-RateLimit-Used, X-RateLimit-Resource, X-RateLimit-Reset, X-OAuth-Scopes, X-Accepted-OAuth-Scopes, X-Poll-Interval, X-GitHub-Media-Type, X-GitHub-SSO, X-GitHub-Request-Id, Deprecation, Sunset",
          "access-control-allow-origin": "*",
          "strict-transport-security": "max-age=31536000; includeSubdomains; preload",
          "x-frame-options": "deny",
          "x-content-type-options": "nosniff",
          "x-xss-protection": "0",
          "referrer-policy": "origin-when-cross-origin, strict-origin-when-cross-origin",
          "content-security-policy": "default-src 'none'",
          "vary": "Accept-Encoding, Accept, X-Requested-With",
          "x-github-request-id": "A19E:35A0:7C3DEBF:8072B4A:6461E036",
          "connection": "close"
        },
        "httpVersion": "1.1",
        "retryCount": 0
      }
    },
    "message": "external-host-error",
    "stack": "Error: external-host-error\n    at handleGotError (/home/ubuntu/renovateapp/node_modules/renovate/dist/util/http/github.js:93:16)\n    at GithubHttp.request (/home/ubuntu/renovateapp/node_modules/renovate/dist/util/http/github.js:244:19)\n    at process.processTicksAndRejections (node:internal/process/task_queues:95:5)\n    at async GithubHttp.requestJson (/home/ubuntu/renovateapp/node_modules/renovate/dist/util/http/index.js:195:21)\n    at async ensureBranchSha (/home/ubuntu/renovateapp/node_modules/renovate/dist/modules/platform/github/index.js:595:5)\n    at async pushFiles (/home/ubuntu/renovateapp/node_modules/renovate/dist/modules/platform/github/index.js:1392:9)\n    at async commitFiles (/home/ubuntu/renovateapp/node_modules/renovate/dist/modules/platform/github/index.js:1408:24)\n    at async processBranch (/home/ubuntu/renovateapp/node_modules/renovate/dist/workers/repository/update/branch/index.js:404:25)\n    at async writeUpdates (/home/ubuntu/renovateapp/node_modules/renovate/dist/workers/repository/process/write.js:120:21)\n    at async update (/home/ubuntu/renovateapp/node_modules/renovate/dist/workers/repository/process/extract-update.js:157:15)\n    at async Object.renovateRepository (/home/ubuntu/renovateapp/node_modules/renovate/dist/workers/repository/index.js:61:25)\n    at async renovateRepository (/home/ubuntu/renovateapp/app/worker/index.js:260:26)\n    at async /home/ubuntu/renovateapp/app/worker/index.js:454:5"
  }
}
DEBUG: Setting current branch to main(branch="renovate/microsoft.azure.cosmos-3.x")
DEBUG: latest commit(branch="renovate/microsoft.azure.cosmos-3.x")
{
  "branchName": "main",
  "latestCommitDate": "2023-05-12T13:33:52+02:00"
}

[rarkins]

@zharinov any guesses what's going on here?

[johan-lindqvist]

Any updates on this? Still a problem for us

Are we spamming the endpoint somehow?

[johan-lindqvist]

I generated a new PAT and used that instead and it started working. Strange error message to get though, not very helpful 😒

[zharinov]

We've also made couple PRs that could resolve your issue. Speaking of token, it looks strange Renovate didn't fail early because of this. Anyway, it's great it works for you now 👍