Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Rewrite host connection pool as single GraphStage #1312

Closed
jrudolph opened this issue Jul 27, 2017 · 5 comments
Closed

Rewrite host connection pool as single GraphStage #1312

jrudolph opened this issue Jul 27, 2017 · 5 comments
Labels
1 - triaged Tickets that are safe to pick up for contributing in terms of likeliness of being accepted t:client Issues related to the HTTP Client t:core Issues related to the akka-http-core module
Milestone
10.0.11

Comments

@jrudolph
Copy link
Member

As far as I can see that should remove lots of the stream related bugs. The custom GraphStage should contain all logic from PoolInterfaceActor, PoolConductor, PoolSlot. The external interface should probably be a FlowShape[HttpRequest, HttpResponse]. The PoolMasterActor can then use that instead of sending messages to the current PoolInterfaceActor.

I guess in the best case, we would make this new implementation available under a feature flag depending on our confidence on getting it right.
@jrudolph jrudolph added 1 - triaged Tickets that are safe to pick up for contributing in terms of likeliness of being accepted t:client Issues related to the HTTP Client t:core Issues related to the akka-http-core module labels Jul 27, 2017
@tomrf1
Copy link
Contributor

tomrf1 commented Oct 1, 2017

This sounds like an interesting one.
The PoolInterfaceActor currently has a request buffer with size max-open-requests. Is the intention to continue using the buffer, inside the new GraphStage? (Perhaps as a rate decoupled graph stage).
I'm not sure what the reason for the buffering here is. Why not just backpressure all the way and let the user decide whether or not to buffer?

@jrudolph
Copy link
Member Author

jrudolph commented Oct 4, 2017

@tomrf1, good point. The reason for the buffer is that requests can always be pushed towards a pool by running them via Http.singleRequest. I think previously there was also another concern that new stream materializations created by Http.cachedHostConnectionPool or Http.superPool also need some buffer space because a pool cannot know from which of those materializations to request from, so it requests from all of them.

I think we might want to separate the effort into a part of just rewriting PoolConductor, PoolFlow, and PoolSlot leaving PoolInterfaceActor as it is.

Rewriting PoolInterfaceActor into something else could be another step in the effort.

@jrudolph jrudolph mentioned this issue Oct 10, 2017
Closed
jrudolph added a commit to jrudolph/akka-http that referenced this issue Nov 6, 2017
@jrudolph
=hco akka#1312 test stubs
1d1097f
jrudolph added a commit to jrudolph/akka-http that referenced this issue Nov 9, 2017
@jrudolph
=hco akka#1312 test stubs
7d5c4b1
jrudolph added a commit to jrudolph/akka-http that referenced this issue Nov 9, 2017
@jrudolph
=hco akka#1312 implement new host connection pool
09c73ba
jrudolph added a commit to jrudolph/akka-http that referenced this issue Nov 30, 2017
@jrudolph
=hco akka#1312 implement new host connection pool
4d32ea7
jrudolph added a commit to jrudolph/akka-http that referenced this issue Nov 30, 2017
@jrudolph
+htc akka#1312 new host connection pool implementation
732d764 
A new implementation of the HostConnectionPool. The basic idea is to replace
the former complicated streaming pipeline of `PoolFlow`, `PoolConductor`,
and `PoolSlot` into a single stage that handles all aspects to get rid
of all the small race condition issues that exist in the current ("legacy")
pool implementation.

The new pool implementation is split into two basic classes

 * akka.http.impl.engine.client.pool.NewHostConnectionPool that provides all
   the infrastructure and event handling to drive the pool
 * akka.http.impl.engine.client.pool.SlotState that contains only the logic
   to handle state changes of a single pool slot
jrudolph added a commit to jrudolph/akka-http that referenced this issue Nov 30, 2017
@jrudolph
+htc akka#1312 new host connection pool implementation
9da066c 
A new implementation of the HostConnectionPool. The basic idea is to replace
the former complicated streaming pipeline of `PoolFlow`, `PoolConductor`,
and `PoolSlot` into a single stage that handles all aspects to get rid
of all the small race condition issues that exist in the current ("legacy")
pool implementation.

The new pool implementation is split into two basic classes

 * akka.http.impl.engine.client.pool.NewHostConnectionPool that provides all
   the infrastructure and event handling to drive the pool
 * akka.http.impl.engine.client.pool.SlotState that contains only the logic
   to handle state changes of a single pool slot
jrudolph added a commit to jrudolph/akka-http that referenced this issue Nov 30, 2017
@jrudolph
+htc akka#1312 new host connection pool implementation
96c70c1 
A new implementation of the HostConnectionPool. The basic idea is to replace
the former complicated streaming pipeline of `PoolFlow`, `PoolConductor`,
and `PoolSlot` into a single stage that handles all aspects to get rid
of all the small race condition issues that exist in the current ("legacy")
pool implementation.

The new pool implementation is split into two basic classes

 * akka.http.impl.engine.client.pool.NewHostConnectionPool that provides all
   the infrastructure and event handling to drive the pool
 * akka.http.impl.engine.client.pool.SlotState that contains only the logic
   to handle state changes of a single pool slot
jrudolph added a commit to jrudolph/akka-http that referenced this issue Nov 30, 2017
@jrudolph
+htc akka#1312 new host connection pool implementation
8b15501 
A new implementation of the HostConnectionPool. The basic idea is to replace
the former complicated streaming pipeline of `PoolFlow`, `PoolConductor`,
and `PoolSlot` into a single stage that handles all aspects to get rid
of all the small race condition issues that exist in the current ("legacy")
pool implementation.

The new pool implementation is split into two basic classes

 * akka.http.impl.engine.client.pool.NewHostConnectionPool that provides all
   the infrastructure and event handling to drive the pool
 * akka.http.impl.engine.client.pool.SlotState that contains only the logic
   to handle state changes of a single pool slot
jrudolph added a commit to jrudolph/akka-http that referenced this issue Nov 30, 2017
@jrudolph
+htc akka#1312 new host connection pool implementation
ecb76a8 
A new implementation of the HostConnectionPool. The basic idea is to replace
the former complicated streaming pipeline of `PoolFlow`, `PoolConductor`,
and `PoolSlot` into a single stage that handles all aspects to get rid
of all the small race condition issues that exist in the current ("legacy")
pool implementation.

The new pool implementation is split into two basic classes

 * akka.http.impl.engine.client.pool.NewHostConnectionPool that provides all
   the infrastructure and event handling to drive the pool
 * akka.http.impl.engine.client.pool.SlotState that contains only the logic
   to handle state changes of a single pool slot
jrudolph added a commit that referenced this issue Nov 30, 2017
@jrudolph
Merge pull request #1533 from jrudolph/jr/w/1312-rewrite-poolslot
0643345 
#1312 Rewrite of PoolFlow / PoolSlot / PoolConductor as single GraphStage
@jrudolph jrudolph added this to the 10.0.11 milestone Nov 30, 2017
@jrudolph
Copy link
Member Author

The new pool implementation will be available in 10.0.11 under a flag. I'm closing this one in favor of follow up tickets to flesh out details of behavior in the new implementation when it got some more testing.

@benjamingeer
Copy link

Is the new pool implementation still available only under a flag in 10.1.1, and if so, what's the flag? And does it resolve #1459?

@raboof
Copy link
Member

raboof commented Jun 6, 2018 •
edited
Loading

The new host connection pool is the default since 10.1.0. I'm not familiar enough with #1459 to say whether it is expected to resolved (though if so of course that ticket should be closed).

@ennru ennru mentioned this issue May 15, 2020
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
1 - triaged Tickets that are safe to pick up for contributing in terms of likeliness of being accepted t:client Issues related to the HTTP Client t:core Issues related to the akka-http-core module
Projects
None yet
Milestone
10.0.11
Development

No branches or pull requests
4 participants
@jrudolph @raboof @benjamingeer @tomrf1