Skip to content
Distributed job execution application built for Galaxy
Branch: master
Clone or download
jmchilton Merge pull request #195 from jmchilton/merge_pulsar_docker_images
Attempt to merge Pulsar Docker images (1 / ...)
Latest commit 2869294 Jun 22, 2019
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
.travis Another try to fix to CI for Pulsar. Jun 18, 2019
docker
docs using queued_condor May 31, 2019
files/persisted_data Doc updates for new URL/name. Jun 19, 2014
install_test
pulsar PEP-8 configure slurm... Jun 21, 2019
scripts Fix Pulsar configs so ./run.sh just works out of the box. Sep 29, 2017
test Allow remote_object_store_copy file action. Jun 6, 2019
test_data Enable scp/rsync integration tests on travis. Mar 9, 2015
tools Prep Planemo 0.11.0. May 16, 2019
wsgi_path.egg-info Add some dummy package info to wsgi_path.egg-info. Apr 9, 2015
.coveragerc
.dockerignore Added dockerignore Oct 16, 2018
.gitignore More tweaks to docker building process. May 16, 2019
.travis.yml Another try to fix to CI for Pulsar. Jun 18, 2019
CITATION Rebase into update config. Jun 19, 2014
CODE_OF_CONDUCT.rst Switch pulsar code of conduct. Dec 26, 2015
CONTRIBUTING.rst Python 3 all the stuff. Apr 15, 2015
HISTORY.rst Starting work on 0.13.0 Jun 3, 2019
LICENSE Initial commit. Jan 16, 2011
MANIFEST.in Include job_script in source dist package. May 8, 2015
Makefile Even better linting of dist artifacts. May 29, 2019
README.rst Update link for logo image Sep 22, 2017
app.yml.sample Fix 'amqp_ack_republish_time' in sample (from 'amqp_republish_time' w… May 16, 2019
dependency_resolvers_conf.xml.sample Fixing conda auto install error and adding depedency resolver conf ex… May 12, 2017
dev-requirements.txt Improve readme linting. May 29, 2019
drmaa_dev.txt Initial implementation of DRMAA job manager now works! Sep 2, 2013
local_env.sh.sample Support the $GALAXY_VIRTUAL_ENV and $PRESERVE_GALAXY_ENVIRONMENT Sep 19, 2017
requirements.txt Attempt to merge Pulsar Docker images. Jun 21, 2019
run.bat Add run.bat Windows helper script to mirror run.sh for Linux. Mar 5, 2014
run.sh Make Pulsar useful from pip install. Mar 1, 2015
run_client_tests.py Make Pulsar useful from pip install. Mar 1, 2015
server.ini.sample Documentation overhaul for pip installation as best practice. Apr 13, 2015
setup.cfg Create universal wheels Feb 8, 2018
setup.py Attempt to merge Pulsar Docker images. Jun 21, 2019
setup_venv.sh Add optional virtual environment configuration scripts to easy running Aug 9, 2012
tox.ini Depend on newer style Galaxy library dependencies. May 29, 2019

README.rst

Pulsar Logo
Documentation Status Pulsar on the Python Package Index (PyPI) Build Status Test Coverage

This project is a Python server application that allows a Galaxy server to run jobs on remote systems (including Windows) without requiring a shared mounted file systems. Unlike traditional Galaxy job runners - input files, scripts, and config files may be transferred to the remote system, the job is executed, and the results are transfered back to the Galaxy server - eliminating the need for a shared file system.

Full documentation for the project can be found on Read The Docs.

Configuring Galaxy

Galaxy job runners are configured in Galaxy's job_conf.xml file. Some small examples of how to configure this can be found here, but be sure to checkout job_conf.xml.sample_advanced in your Galaxy code base or on Github for complete information.

Quickstart

Full details on different ways to install Pulsar can be found in the install section of the documentaiton, but if your machine has the proper Python dependencies available it can be quickly download and a test job run with.

mkdir pulsar
cd pulsar
virtualenv venv
. venv/bin/activate # .venv\Scripts\activate if Windows
pip install pulsar-app
pulsar-config
pulsar --daemon # just pulsar if Windows
pulsar-check # runs a test job

The configuration documentation has many details on securing your Pulsar server and enabling advanced features such as cluster integration and message queue communication.

Development and Testing

The recommended approach to setting up a development environment for Pulsar on Linux or Mac OS X is rougly as follows:

git clone https://github.com/galaxyproject/pulsar
cd pulsar
virtualenv .venv
. .venv/bin/activate # .venv\Scripts\activate if Windows
pip install -r requirements.txt
pip install -r dev-requirements.txt

This project is distributed with unit and integration tests (many of which will not run under Windows), the following command will install the needed python components to run these tests. The following command will then run these tests:

make tests

The following command will then produce a coverage report corresponding to this test and place it in the coverage_html_report subdirectory of this project.:

coverage html

Checkout the Contributing documentation for many more details on developing and contributing to Pulsar.

Please note that this project is released with a Contributor Code of Conduct. By participating in this project you agree to abide by its terms.

You can’t perform that action at this time.