DC dynamic

This repository contains code to generate a docker container for running jobs. By default it runs the commands in all.sh when started.

ACCESS_KEY should be set for the container, defining the access key to use for Blobserver.

There are two cronjobs active on the cluster. No persistent storage is provided, so any generated files should be uploaded somewhere to be saved.

Runs the commands in the file runner_daily.sh on 0 4 * * * (04:00 every morning).

Any files put in $CODE_PATH/output will be uploaded to Blobserver using the dc-dynamic account.

Runs the commands in the file runner_weekly.sh on 0 4 * * 5 (04:00 every Friday morning).

Any files put in $CODE_PATH/output will be uploaded to Blobserver using the dc-dynamic account.

Adding jobs

Add new commands to the above files to have them running on schedule. If you need jobs to run on a different schedule, talk to @talavis.

Th easiest way to upload files is to use curl:

curl "https://blobserver.dckube.scilifelab.se/blob/$filename" -H "x-accesskey: $ACCESS_KEY" --upload-file "$filename"

Feel free to set new variables, but remember to tell @talavis if you need them to be set for the cronjobs on the cluster.

Name		Name	Last commit message	Last commit date
Latest commit History 46 Commits
.github/workflows		.github/workflows
.gitignore		.gitignore
.pylintrc		.pylintrc
Dockerfile		Dockerfile
README.md		README.md
all.sh		all.sh
gen_clouds.py		gen_clouds.py
gen_publication_count.py		gen_publication_count.py
gen_recent_pub.py		gen_recent_pub.py
gen_symptoms_data.py		gen_symptoms_data.py
gen_ww_slu_logyaxis.py		gen_ww_slu_logyaxis.py
gen_ww_slu_regular.py		gen_ww_slu_regular.py
gen_ww_stockholm_logyaxis.py		gen_ww_stockholm_logyaxis.py
gen_ww_stockholm_regular.py		gen_ww_stockholm_regular.py
requirements.txt		requirements.txt
runner_daily.sh		runner_daily.sh
runner_every10mins.sh		runner_every10mins.sh
runner_weekly.sh		runner_weekly.sh