feat(http): Support for per-host http concurrency limits

[zharinov]

Closes #6358

[zharinov]

Just received stats like this with queue of size 3:

DEBUG: http statistics (repository=zharinov/renovate-test-got-queue)
       "hostStats": [
         "api.github.com, 4 requests, 387ms request average, 0ms queue average",
         "repo.maven.apache.org, 1259 requests, 383ms request average, 2540ms queue average"
       ],
       "totalRequests": 1263

[rarkins]

@zharinov I think a good test would be a repo with >20 dependencies and then limit registry.npmjs.org to 2 concurrent requests

[viceice]

@zharinov I think a good test would be a repo with >20 dependencies and then limit registry.npmjs.org to 2 concurrent requests

Maybe ours (forked of cause) 😏

[zharinov]

Here is the reason I'm not receiving PR from 16.04 to 20.04:

renovate/lib/datasource/docker/index.ts

Line 26 in 7cec2f6

major: { enabled: false },

I guess, we can make workaround or something

UPD. Ah, commented to wrong PR instead of this one...

[rarkins]

Yes, fixing Ubuntu and Node versioning are our pre-requisites for removing that restriction :)

[zharinov]

Unlimited: repo.maven.apache.org, 1281 requests, 181ms request average, 0ms queue average
Limit = 2: repo.maven.apache.org, 1281 requests, 169ms request average, 1650ms queue average
Limit = 1: repo.maven.apache.org, 1281 requests, 194ms request average, 4040ms queue average

[renovate-release]

🎉 This PR is included in version 24.0.0 🎉

The release is available on:

• GitHub release
• 24.0.0

Your semantic-release bot 📦🚀