Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[docs] yarn update #6173

Merged
merged 6 commits into from
Nov 20, 2019
Merged

[docs] yarn update #6173

merged 6 commits into from
Nov 20, 2019

Conversation

richardliaw
Copy link
Contributor

Why are these changes needed?

Related issue number

Checks

@edoakes edoakes mentioned this pull request Nov 16, 2019
7 tasks
doc/source/deploy-on-yarn.rst Show resolved Hide resolved
doc/source/deploy-on-yarn.rst Outdated Show resolved Hide resolved
doc/yarn/ray-skein.yaml Outdated Show resolved Hide resolved
doc/yarn/ray-skein.yaml Outdated Show resolved Hide resolved
doc/yarn/ray-skein.yaml Outdated Show resolved Hide resolved
richardliaw and others added 2 commits November 15, 2019 21:37
Co-Authored-By: Edward Oakes <ed.nmi.oakes@gmail.com>
@AmplabJenkins
Copy link

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/18519/
Test PASSed.

@AmplabJenkins
Copy link

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/18534/
Test PASSed.

@richardliaw richardliaw added the tests-ok The tagger certifies test failures are unrelated and assumes personal liability. label Nov 16, 2019
Copy link

@jcrist jcrist left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall these updates look good to me.

# This activates a pre-existing environment for dependency management.
source /home/rayonyarn/miniconda3/bin/activate
# This obtains the Skein Application ID which is used when pushing addresses to worker services.
APP_ID=$(python -c 'import skein;print(skein.properties.application_id)')

# This register the Ray head addresses needed by the workers with the Skein key-value store.
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This reads a little off. Perhaps:

This stores the Ray head address in the Skein key-value store, so the workers can retrieve it later

# # doesn't require any specific way of distributing files, but this
# # is a good one for python projects.
# # See https://jcrist.github.io/skein/distributing-files.html
# environment: environment.tar.gz
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Unfortunately github diff commenting only lets me comment on changes, so I'll add this here

This section is copied around in a few places, and may be confusing for new readers as it's double commented out, and not really explained. I'd either drop it, or alter the language to make it clearer that including a packaged environment file is optional, and if they wish to do so they can do so here in this way.

Also, you may want to remove the code block from https://github.com/ray-project/ray/pull/6173/files#diff-de6110281d163f755df4b298ab7b2bc6R71 and use a literalinclude to the example file instead, not sure.


Obtain the Skein Application ID which is used when pushing addresses to worker services.
Register the Ray head addresses needed by the workers in the Skein key-value store.
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is there more than one address? Otherwise you might want "address" instead of "addresses".

@AmplabJenkins
Copy link

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/Ray-PRB/18596/
Test FAILed.

@richardliaw richardliaw merged commit d3c7a8f into ray-project:master Nov 20, 2019
@richardliaw richardliaw deleted the yarn branch November 20, 2019 00:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
tests-ok The tagger certifies test failures are unrelated and assumes personal liability.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants