Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

condor job scheduler with docker support #323

Merged
merged 69 commits into from May 10, 2017

Conversation

Projects
None yet
2 participants
@bgruening
Copy link
Owner

bgruening commented May 6, 2017

Here we introduce some environment variables that can control the compose file. We can use this to automatically switch deployments. In this PR we enable Docker-jobs on-demand for Condor by:

export GALAXY_DOCKER_ENABLED=true
# Galaxy needs to a full path for the the jobs, in- and outputs.
# Do we want to run each job in it's own container and this container uses the host
# container engine (not Docker in Docker) then the path to all files inside and outside
# of the container needs to be the same.
sudo mkdir /export
sudo chmod 666 /export
export EXPORT_DIR=/export

To use more containers by default we need to enable mulled containers and add some more testing. I would like to submit Docker tools as part of the tests - maybe with planemo?

This is blocked by galaxyproject/galaxy#4038

ping @jmchilton

@bgruening bgruening force-pushed the condor_docker branch from 652a0c7 to ae58c86 May 7, 2017

@bgruening bgruening force-pushed the condor_docker branch from ae58c86 to 88db276 May 7, 2017

@bgruening bgruening changed the title WIP: condor job scheduler with docker support condor job scheduler with docker support May 10, 2017

@bgruening bgruening merged commit cad2d21 into dev May 10, 2017

0 of 2 checks passed

continuous-integration/travis-ci/pr The Travis CI build could not complete due to an error
Details
continuous-integration/travis-ci/push The Travis CI build could not complete due to an error
Details

@bgruening bgruening deleted the condor_docker branch May 10, 2017

@jmchilton

This comment has been minimized.

Copy link
Collaborator

jmchilton commented May 10, 2017

Congrats @bgruening - amazing work as always!

@bgruening

This comment has been minimized.

Copy link
Owner Author

bgruening commented May 10, 2017

Thanks @jmchilton!
Mesos, Swarm next - we should also get the ssh-job running under testing/documentation here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.