Skip to content

[WIP] Split membership sync endpoints#2773

Merged
manishrjain merged 9 commits intomasterfrom
mrjn/split-membership-endpoints
Nov 25, 2018
Merged

[WIP] Split membership sync endpoints#2773
manishrjain merged 9 commits intomasterfrom
mrjn/split-membership-endpoints

Conversation

@manishrjain
Copy link
Copy Markdown
Contributor

@manishrjain manishrjain commented Nov 25, 2018

This change is Reviewable

Comment thread dgraph/cmd/zero/raft.go Outdated
@manishrjain manishrjain merged commit 60bbf0a into master Nov 25, 2018
@manishrjain manishrjain deleted the mrjn/split-membership-endpoints branch November 25, 2018 02:58
dna2github pushed a commit to dna2fork/dgraph that referenced this pull request Jul 19, 2019
…o#2773)

- Now that Zero followers cannot send proposals to leader, Alphas must send their membership updates
  to the Zero leader.
- The membership updates can be received from any Zero server, leader or follower.
- So, this PR splits the job of sending and receiving updates into two different endpoints:
  StreamMembership and UpdateMembership.

- Purge Timestamps are now calculated using the Snapshot timestamp of the group. This is simpler,
  easier to predict and makes this system run like clockwork. That is, a snapshot calculation in
  Alpha leader would cause all Alpha followers to get that snapshot, which would then cause Zero to
  purge the timestamps below that snapshot ts (assuming other groups have caught up).
- This removes the need for Zero to query all Alpha leaders, via PurgeTs endpoint. That is now
  removed.

- Removed a lot of error variables, switching them with explanatory errors about what is going on in
  the system, making things easier to debug.

Commits:

* Working membership endpoint split.
* Removed PurgeTs endpoint. Passing snapshot ts during membership update, so Zero can use that information to purge Oracle.
* Block on Tablet call until we find a Zero leader.
* More debugging via traces.
* Simplify connToZeroLeader. Try to not add new bugs.
* Update blockade test with restart option.
* Self Reviews.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Development

Successfully merging this pull request may close these issues.

2 participants