Skip to content

docs: Add doc for http config#7244

Merged
Xuanwo merged 1 commit intoapache:mainfrom
dentiny:hjiang/doc-for-http
Mar 18, 2026
Merged

docs: Add doc for http config#7244
Xuanwo merged 1 commit intoapache:mainfrom
dentiny:hjiang/doc-for-http

Conversation

@dentiny
Copy link
Copy Markdown
Contributor

@dentiny dentiny commented Mar 17, 2026

Rationale for this change

I'm using opendal to do large blob transfer (50GBps network, 20-30 GBps cluster-wise throughput), and found current HTTP optimization miss some explanations.

What changes are included in this PR?

Add some usage pattern I did in our production environment:

  • hyper-util currently always reuse the TCP connection when HTTP/2, which leads to bottleneck on single TCP connections
    • To address, we could either maintain a reqwest client pool with multiple HTTP/2 connection underlying and round-robin; or actively act gating on max allowed concurrency so we don't create excessive connections
    • For my use case, I observe 1800 connections created on single host, if no limit applied, which is definitely bad for performance and reliability

Are there any user-facing changes?

No

AI Usage Statement

I update the doc myself, no AI involvement.

@dentiny dentiny requested a review from Xuanwo as a code owner March 17, 2026 21:09
Copy link
Copy Markdown
Member

@Xuanwo Xuanwo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you!

@dosubot dosubot bot added the lgtm This PR has been approved by a maintainer label Mar 18, 2026
@Xuanwo Xuanwo changed the title [doc] Add doc for http config docs: Add doc for http config Mar 18, 2026
@Xuanwo Xuanwo merged commit 423a287 into apache:main Mar 18, 2026
95 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

lgtm This PR has been approved by a maintainer

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants