-
Notifications
You must be signed in to change notification settings - Fork 2
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[CAY-1139, 1148] Implements Pregel on ET #1170
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@JunhoeKim Overall it looks great :)
I've made some minor commits.
Could you take a look?
Thanks!
@wynot12 It looks good to me. Thank you for refining works! |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@JunhoeKim Thanks for your work :)
I'll merge it.
Closes #1139 #1148 .
This PR implements a simple version of Pregel on ET. The current version has an environment that only runs Pagerank app. And optimization problems related to graph processing will be covered in future issues.
This program works in the following way:
PregelLauncher
submitsPregelDriver
according to the specified configuration.PregelDriver
submitsPregelWorkerTask
to executors. Then all executors starts graph processing app.PregelMaster
communicates withWorkerMsgManager
in each executor using CentComm services.SuperstepControlMsg
andSuperstepResultMsg
determine the termination of current app.Computation
interface which are specified by app works around the vertices assigned to the executor.MessageManager
.