User_Using your own compute workers

In these instructions, we guide you step-by-step to create your own "compute worker" (a server to which submissions of challenge participants are sent to be executed).

Contents

• Setting up a server as compute worker
• Hooking up the server to a queue
• Assigning a queue to a competition

---

Setting up a server as compute worker

First you need to have access to a server connected to the Internet having an IP address and into which you can remote login via ssh. If you do not have one, you need to create one. We provide instructions for creating Ubuntu Virtual machines (VM):

• Creating a Windows Azure Ubuntu VM
• Creating an AWS Ubuntu VM

Then ssh into your machine and run the following commands:

curl https://get.docker.com | sudo sh

sudo usermod -aG docker ubuntu # Adding myself to docker group

log out, log back in

$ docker run hello-world $ sudo apt-get install docker-compose # run many containers at once

$ git clone https://github.com/codalab/codalab-competitions.git

$ cd codalab-competitions $ cp .env_sample .env

edit .env (with emacs?) and put pyamqp://61fdd17e-fb04-4296-9d30-6cd3a69c8aa8:8cc2cd6e-ce72-4592-9483-fe6b6c8b2495@13.82.145.119/030e877d-5f61-479c-8c87-7da347828287 in BROKER_URL=

$ docker-compose up -d worker_compute

docker-compose logs -f

sudo apt-get install emacs

Hooking up the server to a queue

Worker queues

Assigning a queue to a competition