Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Hot-standby keep alive for sharding #29319

Closed
patriknw opened this issue Jun 25, 2020 · 9 comments
Closed

Hot-standby keep alive for sharding #29319

patriknw opened this issue Jun 25, 2020 · 9 comments
Assignees
Labels
3 - in progress Someone is working on this ticket t:replicated-event-sourcing Replicated active event sourcing
Milestone

Comments

@patriknw
Copy link
Member

https://doc.akka.io/docs/akka-enhancements/current/persistence-dc/index.html#hot-standby

@patriknw patriknw added 1 - triaged Tickets that are safe to pick up for contributing in terms of likeliness of being accepted t:replicated-event-sourcing Replicated active event sourcing labels Jun 25, 2020
@johanandren
Copy link
Member

I think this will either become documentation, or if we introduce an API routing across N sharding proxies we can support it there (#29283)

@patriknw
Copy link
Member Author

It's difficult for user to implement, because it's based on reading from the notification table (I think).
Related to #29314

@johanandren
Copy link
Member

For hot standby isn't there either so that you know up front what ids you have or if they are appearing over time you'd start one in each replica at the first event? (Potentially together with remember-entities)

@patriknw
Copy link
Member Author

You "almost never" know the ids up front. I think we wanted it to work with sharding passivation, and then wake up on the other side when something happened.

Maybe the direct replication messages are enough for this?

@johanandren
Copy link
Member

Yeah, I think having each event persisted in other replicas lead to a message passed through sharding should do the trick.

@chbatey
Copy link
Member

chbatey commented Jun 25, 2020

Yeah, I think having each event persisted in other replicas lead to a message passed through sharding should do the trick.

👍

@chbatey
Copy link
Member

chbatey commented Jun 25, 2020

That will keep them alive. I think we need some documentation for the pattern of failing over.

@johanandren
Copy link
Member

@chbatey also related is #29283

@patriknw
Copy link
Member Author

Ok, seems we don't have to implement anything here, but we can keep the ticket for documentation purposes.

Note that when I say hot standby here I don't necessarily mean strictly that only one is active and others are passive until the active fails. It can also be that there is no traffic for an entity in a DC for a while, and when it starts up it can be bad to have to read all the replicated events in one go, to catch up.

@johanandren johanandren self-assigned this Jul 29, 2020
@johanandren johanandren added 3 - in progress Someone is working on this ticket and removed 1 - triaged Tickets that are safe to pick up for contributing in terms of likeliness of being accepted labels Jul 29, 2020
@chbatey chbatey added this to the 2.6.9 milestone Aug 17, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
3 - in progress Someone is working on this ticket t:replicated-event-sourcing Replicated active event sourcing
Projects
None yet
Development

No branches or pull requests

3 participants