Skip to content
SAGA-based Pilot-Job Implementation for Compute and Data
Python CSS JavaScript Shell
Latest commit d6cf865 @drelu drelu Revert "bootstrap to BJ2"
This reverts commit 71c6426.
Failed to load latest commit information.
api Added wait() function to bigjob class
bigjob Revert "bootstrap to BJ2"
bigjob_dynamic Remove appwriting and pilotdata, these should not be front-facing pag…
bootstrap Revert "bootstrap to BJ2"
cli further refinement of API documentation
coordination Merge branch 'master' into develop
doc Remove all references to the gw68 password in code and examples
docs Fix indices
examples Revert "bootstrap to BJ2"
pilot fixed examples so that they do not contain compile errors
scripts work on path handling for irods
tests optimizing performance of ComputeDataService
util fix get_details()
.gitignore Further work on Google Storage integration for PD
CHANGES updated VERSION for release Added License (so people are forced now to attribution) added VERSION to package
Makefile added 'clean' target separate README for Condor Merge branch 'develop-prod'
bigjob.conf updated bootstrapped version of BJ
bigjob.sublime-project alt. PyPi project to minimize potential damage
bigjob_agent.conf Make executor threadpool size configurable use setuptools 2.1 for packaging bj force setuptools 2.x switch


The SAGA BigJob framework is a SAGA-based pilot job implementation. The Simple API for Grid Applications (SAGA) is a high-level, easy-to-use API for accessing distributed resources. SAGA BigJob supports a wide range of application types, and is usable over a broad range of infrastructures, i.e., it is general-purpose, extensible and interoperable. Unlike other common pilot job systems SAGA BigJob (i) natively supports MPI job and (ii) works on a variety of back-end systems, generally reflecting the advantage of using a SAGA-based approach.

Web Page & Mailing List

Web page:

Mailing list:


$ curl -o
$ python $HOME/.bigjob/python/
$ . $HOME/.bigjob/python/bin/activate

See for further information. The Wiki includes among many things information on how to setup BigJob on various machines, e.g. on XSEDE (Ranger, Kraken) or FutureGrid.

Configuration of Redis Coordination Backend

BigJob requires Redis for communication between BigJob manager/agent. Use the following steps to install Redis.

Mac Homebrew:

brew install redis redis-tools 

Linux: Download Redis Currently only tested with Redis 2.2.12

$ tar -xzvf redis-2.2.12.tar.gz
$ cd redis-2.2.12
$ make
$ make install (if root)

Start Redis (redis-server executable is located in src/ dir):

cd src


Please modify COORDINATION_URL on top of example to the correct Redis backend!

Development & Packaging


Building PyPi package

python build

Upload to PyPi

python sdist upload
Something went wrong with that request. Please try again.