Repository navigation
Conversation
Increase max-parallel up to 300, the curl max Tweak output to just give the http response code
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Increase max-parallel up to 300, the curl max. Tweak output to just give the http response code.
This test is interesting in showing curl performance when having many, small requests. Changing the output from
-w {%json}\nto-w %{response_code},\\ngives a 40% performance boost.Some results from my macOS machine (with
%{response_code}):On macOS, neither
curlnorhttpdare limited by their single cpu core (httpd load: 25% - 45%, caddy load: 45% - 95%).
On linux the performance roughly doubles (although the cpu is slower) and differences between the
libuvenabled scheduling andcurl_multi_performbecome visible. Curious about the delayed ramp-up oflibuvat 6 parallel requests.Update2: the reason why the 6 parallel requests on libuv do not scale up seems to be that the transfer loop in
tool_operate.cdoes not add new handles often enough. If no timeout happens, the only opportunity to add transfers is when the last socket is removed anduv_run()returns.