Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Docker image for development and testing #1

Closed
bmpvieira opened this Issue Dec 10, 2014 · 11 comments

Comments

3 participants
@bmpvieira
Copy link
Member

bmpvieira commented Dec 10, 2014

We need a Docker image with Son of Grid setup so that we can develop this module without the need of a HPC/cluster. @gawbul is working on one.

@gawbul

This comment has been minimized.

Copy link

gawbul commented Dec 10, 2014

Basic Dockerfile and requisite files are here https://github.com/gawbul/docker-sge. Have created auto-build repository in the Docker registry too https://registry.hub.docker.com/u/gawbul/docker-sge/. Can use docker pull gawbul/docker-sge to use. Still a couple of issues to resolve before fully functional.

@bmpvieira bmpvieira assigned bmpvieira and unassigned mkuzak and bmpvieira Dec 10, 2014

@mkuzak

This comment has been minimized.

Copy link

mkuzak commented Dec 10, 2014

@gawbul when I try to pull the image I get:
2014/12/10 02:23:20 Tag latest not found in repository gawbul/docker-sge

@gawbul

This comment has been minimized.

Copy link

gawbul commented Dec 10, 2014

Probably still building? Only just pushed to the repo! Will check...

@gawbul

This comment has been minimized.

@gawbul

This comment has been minimized.

Copy link

gawbul commented Dec 10, 2014

Just about sorted the issues and got SGE to auto install. Having a problem with the hostname changing during the build so get an error in resolving the hostname (see gawbul/docker-sge#3).

@gawbul

This comment has been minimized.

Copy link

gawbul commented Dec 12, 2014

Should all be working now https://github.com/gawbul/docker-sge :)

@gawbul

This comment has been minimized.

Copy link

gawbul commented Dec 14, 2014

@bmpvieira @mkuzak I've been thinking about the container configuration and wanted to get your thoughts. Currently I am installing SGE and configuring the container as the master, exec, and submission host. This is how every container you spin up using the Docker image will be configured.

Should I change it so SGE is compiled from the Dockerfile, but then the user can run one of a number of shell scripts from within the container to setup SGE how they prefer? It would still require some manual input of hostnames I think, though, it would be useful to do service discovery (perhaps using consul? https://www.consul.io/) to automate the configuration of that too. Would still probably need some container linking though?

@mkuzak

This comment has been minimized.

Copy link

mkuzak commented Dec 14, 2014

I think the current configuration is good for start. The simpler the setup the better. Can get more complicated in the future.

@gawbul

This comment has been minimized.

Copy link

gawbul commented Dec 14, 2014

@mkuzak Good stuff, thanks! Just sorting a couple of minor config issues with the image. Hopefully fully functional by the end of the day?

@gawbul

This comment has been minimized.

Copy link

gawbul commented Dec 14, 2014

@mkuzak @bmpvieira Fixed image - just building/pushing to Docker Hub. See README at https://github.com/gawbul/docker-sge for information on how to run.

@bmpvieira

This comment has been minimized.

Copy link
Member Author

bmpvieira commented Apr 4, 2015

Thanks a lot @gawbul!
Seems to be working as qstat shows jobs in queue, however it also tells me I'm not allowed to run jobs (confusing).

sgeadmin@084311c933c3:~$ echo "echo Running test from $HOSTNAME" | qsub
Unable to run job: warning: sgeadmin's job is not allowed to run in any queue
Your job 2 ("STDIN") has been submitted
Exiting.
sgeadmin@084311c933c3:~$ qstat
job-ID  prior   name       user         state submit/start at     queue                          slots ja-task-ID
-----------------------------------------------------------------------------------------------------------------
      1 0.55500 STDIN      sgeadmin     qw    04/04/2015 15:50:07                                    1

Now we just need to actually write the wrapper 😆 #2

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.