Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remote jobs #6

Merged
merged 6 commits into from
Dec 1, 2018
Merged

Remote jobs #6

merged 6 commits into from
Dec 1, 2018

Conversation

atait
Copy link
Owner

@atait atait commented Dec 1, 2018

Sending build, test, and dataprep jobs to a remote [high performance] computer

Remote visualization

You can now send lyipc visualizations to a remote computer by setting an environment variable

export LYIPCTARGET=username@hostname

This format has some issues. You can't use your .ssh/config aliases. You must have an RSA key approved on the remote computer.

Local visualization with remote work

This is a matter of shipping files out with local rsync (python wrapped), calling remote shell commands via ssh (python wrapped), and then calling a remote visualization from the remote computer, resulting in a local visualization.

Also, some simplification to host formatting

The socket package is used to resolve ambiguous ones instead of specifying them separately depending on case

@atait atait merged commit 8998748 into master Dec 1, 2018
@atait atait deleted the remote-jobs branch December 1, 2018 09:29
@atait atait restored the remote-jobs branch December 7, 2018 18:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant