Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Decouple computation and communication by introducing worker-side model cache #1251

Closed
wynot12 opened this issue Oct 25, 2017 · 1 comment
Closed

Comments

@wynot12
Copy link
Contributor

wynot12 commented Oct 25, 2017

In Dolphin, workers always pull model from servers in synchronous manner.
Computation stalls until the model pull finishes.
It wastes much of worker resources and slows down overall progress.

We need to decouple computation from communication by introducing worker-side model cache.
Then computation can keep going regardless of communication.

The model cache will be refreshed in background.
As a first try, we can update cache in best-effort manner.
Later, we may support SSP.

@yunseong
Copy link
Contributor

yunseong commented Nov 6, 2017

Part of #803

Let's separate out the issues about policies for refreshing cached objects.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants