upload-sourcemaps sometimes hangs forever

[laurentgoudet]

We are uploading our client-side sourcemaps as part of a CI pipeline using the Sentry CLI. It works well 99% of the time, but, occasionally, it just gets stuck forever (> 2 hours, whereas it usually takes ~30 seconds to complete), right after printing > Bundled <x> files for upload (see debug logs below), causing our release flow to be interrupted.

VERSION 4ed027b7d78c7ff7b504f69d7b910042175d4e86
  DEBUG   2020-10-01 02:24:27.894649389 +00:00 sentry-cli version: 1.57.0, platform: "linux", architecture: "x86_64"
  INFO    2020-10-01 02:24:27.894709165 +00:00 sentry-cli was invoked with the following command line: "/root/gaf/webapp/node_modules/@sentry/cli/sentry-cli" "--log-level=debug" "--auth-token" "<redacted>" "releases" "--org" "freelancercom" "-p" "webapp-browser" "files" "4ed027b7d78c7ff7b504f69d7b910042175d4e86" "upload-sourcemaps" "dist/projects/browser/dev" "--url-prefix" "~/assets/" "--rewrite"

> Found 386 release files

> Analyzing 386 sources

> Rewriting sources

> Adding source map references

  DEBUG   2020-10-01 02:24:30.163790100 +00:00 request POST https://sentry.io/api/0/projects/freelancercom/webapp-browser/releases/

  DEBUG   2020-10-01 02:24:30.163823582 +00:00 using token authentication
  DEBUG   2020-10-01 02:24:30.163840787 +00:00 json body: {"version":"4ed027b7d78c7ff7b504f69d7b910042175d4e86","projects":["webapp-browser"]}
  DEBUG   2020-10-01 02:24:30.163852439 +00:00 retry number 0, max retries: 0

  DEBUG   2020-10-01 02:24:30.359379200 +00:00 > POST /api/0/projects/freelancercom/webapp-browser/releases/ HTTP/1.1
  DEBUG   2020-10-01 02:24:30.359432022 +00:00 > Host: sentry.io
  DEBUG   2020-10-01 02:24:30.359444170 +00:00 > Accept: */*

  DEBUG   2020-10-01 02:24:30.359455177 +00:00 > Connection: TE
  DEBUG   2020-10-01 02:24:30.359465648 +00:00 > TE: gzip
  DEBUG   2020-10-01 02:24:30.359476013 +00:00 > User-Agent: sentry-cli/1.57.0

  DEBUG   2020-10-01 02:24:30.360027932 +00:00 > Authorization: Bearer <redacted>***
  DEBUG   2020-10-01 02:24:30.360067259 +00:00 > Content-Type: application/json

  DEBUG   2020-10-01 02:24:30.360079179 +00:00 > Content-Length: 84

  DEBUG   2020-10-01 02:24:30.654448132 +00:00 < HTTP/1.1 208 Unknown Status Code
  DEBUG   2020-10-01 02:24:30.654500438 +00:00 < Server: nginx

  DEBUG   2020-10-01 02:24:30.654516655 +00:00 < Date: Thu, 01 Oct 2020 02:24:30 GMT
  DEBUG   2020-10-01 02:24:30.654528854 +00:00 < Content-Type: application/json
  DEBUG   2020-10-01 02:24:30.654540398 +00:00 < Content-Length: 5194
  DEBUG   2020-10-01 02:24:30.654552016 +00:00 < Connection: keep-alive
  DEBUG   2020-10-01 02:24:30.654571268 +00:00 < Access-Control-Allow-Headers: X-Sentry-Auth, X-Requested-With, Origin, Accept, Content-Type, Authentication, Authorization, Content-Encoding
  DEBUG   2020-10-01 02:24:30.654582164 +00:00 < X-Content-Type-Options: nosniff
  DEBUG   2020-10-01 02:24:30.654592955 +00:00 < Content-Language: en
  DEBUG   2020-10-01 02:24:30.654603718 +00:00 < Access-Control-Expose-Headers: X-Sentry-Error, Retry-After
  DEBUG   2020-10-01 02:24:30.654614988 +00:00 < Vary: Accept-Language, Cookie
  DEBUG   2020-10-01 02:24:30.654625694 +00:00 < X-XSS-Protection: 1; mode=block
  DEBUG   2020-10-01 02:24:30.654636217 +00:00 < Allow: GET, POST, HEAD, OPTIONS
  DEBUG   2020-10-01 02:24:30.654646903 +00:00 < Access-Control-Allow-Origin: *
  DEBUG   2020-10-01 02:24:30.654656790 +00:00 < Access-Control-Allow-Methods: GET, POST, HEAD, OPTIONS
  DEBUG   2020-10-01 02:24:30.654667727 +00:00 < X-Frame-Options: deny

  DEBUG   2020-10-01 02:24:30.654679303 +00:00 < X-Served-By: web-c401c6a4
  DEBUG   2020-10-01 02:24:30.654691310 +00:00 < Strict-Transport-Security: max-age=31536000; includeSubDomains; preload
  DEBUG   2020-10-01 02:24:30.654720738 +00:00 response status: 208

  DEBUG   2020-10-01 02:24:30.654741171 +00:00 body: <redacted>

  DEBUG   2020-10-01 02:24:30.704497258 +00:00 request GET https://sentry.io/api/0/organizations/freelancercom/chunk-upload/
  DEBUG   2020-10-01 02:24:30.704544358 +00:00 using token authentication
  DEBUG   2020-10-01 02:24:30.704560781 +00:00 retry number 0, max retries: 0

  DEBUG   2020-10-01 02:24:30.704738375 +00:00 > GET /api/0/organizations/freelancercom/chunk-upload/ HTTP/1.1
  DEBUG   2020-10-01 02:24:30.704753750 +00:00 > Host: sentry.io
  DEBUG   2020-10-01 02:24:30.704763253 +00:00 > Accept: */*
  DEBUG   2020-10-01 02:24:30.704772479 +00:00 > Connection: TE

  DEBUG   2020-10-01 02:24:30.704782066 +00:00 > TE: gzip
  DEBUG   2020-10-01 02:24:30.704792142 +00:00 > User-Agent: sentry-cli/1.57.0
  DEBUG   2020-10-01 02:24:30.704821779 +00:00 > Authorization: Bearer b39c3ff3***

  DEBUG   2020-10-01 02:24:30.796402169 +00:00 < HTTP/1.1 200 OK
  DEBUG   2020-10-01 02:24:30.796450145 +00:00 < Server: nginx

  DEBUG   2020-10-01 02:24:30.796465268 +00:00 < Date: Thu, 01 Oct 2020 02:24:30 GMT
  DEBUG   2020-10-01 02:24:30.796478162 +00:00 < Content-Type: application/json
  DEBUG   2020-10-01 02:24:30.796490539 +00:00 < Content-Length: 288
  DEBUG   2020-10-01 02:24:30.796501736 +00:00 < Connection: keep-alive
  DEBUG   2020-10-01 02:24:30.796515931 +00:00 < Access-Control-Allow-Headers: X-Sentry-Auth, X-Requested-With, Origin, Accept, Content-Type, Authentication, Authorization, Content-Encoding
  DEBUG   2020-10-01 02:24:30.796526419 +00:00 < X-Content-Type-Options: nosniff
  DEBUG   2020-10-01 02:24:30.796537762 +00:00 < Content-Language: en
  DEBUG   2020-10-01 02:24:30.796548395 +00:00 < Access-Control-Expose-Headers: X-Sentry-Error, Retry-After
  DEBUG   2020-10-01 02:24:30.796558691 +00:00 < Vary: Accept-Language, Cookie
  DEBUG   2020-10-01 02:24:30.796568577 +00:00 < X-XSS-Protection: 1; mode=block
  DEBUG   2020-10-01 02:24:30.796578827 +00:00 < Allow: GET, POST, HEAD, OPTIONS
  DEBUG   2020-10-01 02:24:30.796589681 +00:00 < Access-Control-Allow-Origin: *
  DEBUG   2020-10-01 02:24:30.796600650 +00:00 < Access-Control-Allow-Methods: GET, POST, HEAD, OPTIONS
  DEBUG   2020-10-01 02:24:30.796611836 +00:00 < X-Frame-Options: deny
  DEBUG   2020-10-01 02:24:30.796622857 +00:00 < X-Served-By: web-c401c6a4
  DEBUG   2020-10-01 02:24:30.796634059 +00:00 < Strict-Transport-Security: max-age=31536000; includeSubDomains; preload

  DEBUG   2020-10-01 02:24:30.796662360 +00:00 response status: 200
  DEBUG   2020-10-01 02:24:30.796678103 +00:00 body: {"maxFileSize":2147483648,"hashAlgorithm":"sha1","concurrency":8,"chunkSize":8388608,"maxRequestSize":33554432,"url":"https://sentry.io/api/0/organizations/freelancercom/chunk-upload/","chunksPerRequest":64,"accept":["debug_files","release_files","pdbs","sources"],"compression":["gzip"]}

> Bundled 386 files for upload

[kamilogorek]

Fixed in #896