Skip to content

Commit

Permalink
ongoing work on docs
Browse files Browse the repository at this point in the history
  • Loading branch information
Mark Fiers committed May 24, 2012
1 parent 23520c7 commit 8cc24c3
Show file tree
Hide file tree
Showing 40 changed files with 4,249 additions and 0 deletions.
2 changes: 2 additions & 0 deletions _sources/api/plugin/checkversion.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
.. automodule:: moa.plugin.checkversion
:members:
2 changes: 2 additions & 0 deletions _sources/api/plugin/doc.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
.. automodule:: moa.plugin.doc
:members:
2 changes: 2 additions & 0 deletions _sources/api/plugin/mail.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
.. automodule:: moa.plugin.mail
:members:
2 changes: 2 additions & 0 deletions _sources/api/plugin/metavar.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
.. automodule:: moa.plugin.metavar
:members:
2 changes: 2 additions & 0 deletions _sources/api/plugin/project.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
.. automodule:: moa.plugin.project
:members:
2 changes: 2 additions & 0 deletions _sources/api/plugin/report.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
.. automodule:: moa.plugin.report
:members:
2 changes: 2 additions & 0 deletions _sources/api/plugin/sgeActor.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
.. automodule:: moa.plugin.sgeActor
:members:
2 changes: 2 additions & 0 deletions _sources/api/plugin/umask.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
.. automodule:: moa.plugin.umask
:members:
2 changes: 2 additions & 0 deletions _sources/api/plugin/varInject.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
.. automodule:: moa.plugin.varInject
:members:
75 changes: 75 additions & 0 deletions _sources/sync.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,75 @@
Synchronizing jobs
==================

It is quite often usefull to repeat a jobs on a number of different
input files. For simple operations, one liners, this ca be
accomplished using `moa map`. More complex operations, or those
requiring a template other than `map` can be replicated using job
syncronization. Assume you have a set of fastq libraries, each in it's
own directory::

./fq/set1/set1_1.fq
./fq/set1/set1_2.fq
./fq/set2/set2_1.fq
./fq/set2/set2_2.fq
./fq/set3/set3_1.fq
./fq/set3/set3_2.fq

And you want to run a bowtie alignment for each separately. The
approach to take is to create a directory containing all alignments::


mkdir bowtie
cd bowtie

and, in that directory, create one job running bowtie, in a directory
named **exactly** as the input directories::

mkdir set1
cd set1
moa new bowtie -t 'run bowtie for {{_}}'

Note the magic variable `{{_}}`. This variable is replaced by the name
of the current directory. So when running `moa show`, the title would
show up as "run bowtie for set1". This magic variable can be used in
all variables, and we'll use it here to set this job up in such a way
that it can be reused for the other datasets::

set moa fq_forward_input='../../fq/{{_}}/*_1.fq'
# .. configure the remaining variables

Now - we replicate this directory in the following manner. We'll move
one directory up, to the `bowtie` directory, and create a `sync` job::

cd ..
moa new sync -t 'run bowtie for all fq datasets'
moa set source=../fq/

The sync template keeps directories synchronized, based on the
`source` directory. If you now run `moa run` in the `bowtie`
directory, two more directories will be created: `set2` and `set3`,
each containing a verbatim copy of the original bowtie job created.

If, at a certain moment you obtain more fastq datasets::

./fq/set4/set4_1.fq
./fq/set4/set4_2.fq

you can repeat `moa run` in the `./bowtie` sync directory, and a new
directory will be created. Note that the `sync` template will not
remove directories. Also if you want to update the configuration of
the syncronized bowtie jobs, you only need to change the configuration
in one directory, run `moa run` again in the `./bowtie` directory and
the configuration is synchronized across all jobs.












43 changes: 43 additions & 0 deletions _sources/templates/archroot.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,43 @@
archroot
------------------------------------------------

**Helper script for a root archive**


Helper script for the root of an archive template



Commands
~~~~~~~~

**run**
*no help defined*



Parameters
~~~~~~~~~~



**moa_archive_parameters**
space separated list of parameters to set for this template

| *type*: `string`
| *default*: `{}`
| *optional*: `False`



miscellaneous
~~~~~~~~~~~~~

**Backend**
ruff
**Author**
Mark Fiers
**Creation date**
Tue, 17 Apr 2012 10:21:31
**Modification date**
Tue, 17 Apr 2012 10:21:25
121 changes: 121 additions & 0 deletions _sources/templates/filterwgs_pair.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,121 @@
filterwgs_pair
------------------------------------------------

**Execute a "map22" ad-hoc analysis - two input files, two output files**


Filter raw WGS data



Commands
~~~~~~~~

**run**
Filter WGS data



Filesets
~~~~~~~~


**input1**
forward input fastq





**input2**
reverse input fastq


| *type*: `map`
| *source*: `input1`
| *category*: `input`
| *optional*: `False`
| *pattern*: `*/*`




**output1**
forward output fastq


| *type*: `map`
| *source*: `input1`
| *category*: `output`
| *optional*: `True`
| *pattern*: `./*`




**output2**
reverse output fastq


| *type*: `map`
| *source*: `input1`
| *category*: `output`
| *optional*: `True`
| *pattern*: `./*`





Parameters
~~~~~~~~~~



**adapters**
Fasta file with the adapter sequences to trim

| *type*: `file`
| *default*: `{}`
| *optional*: `False`



**minlen**
Minimum remaining sequence length

| *type*: `int`
| *default*: `50`
| *optional*: `True`



**qual**
quality threshold causing trimming

| *type*: `int`
| *default*: `13`
| *optional*: `True`



**title**


| *type*: `{}`
| *default*: `Filter paired fastq files using fastq-mcf`
| *optional*: `{}`



miscellaneous
~~~~~~~~~~~~~

**Backend**
ruff
**Author**
Mark Fiers
**Creation date**
Tue Mar 29 16:34:19 2011
**Modification date**
Mon, 13 Feb 2012 09:16:36 +1300
81 changes: 81 additions & 0 deletions _sources/templates/map2.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,81 @@
map2
------------------------------------------------

**Execute a "map2" ad-hoc analysis**


Execute one command, on a number of input files.



Commands
~~~~~~~~

**run**
*no help defined*



Filesets
~~~~~~~~


**input1**
"map" input files set 1





**input2**
"map" input files set 2


| *type*: `map`
| *source*: `input1`
| *category*: `input`
| *optional*: `False`
| *pattern*: `*/*`




**output**
"map" output files


| *type*: `map`
| *source*: `input1`
| *category*: `output`
| *optional*: `True`
| *pattern*: `./*`





Parameters
~~~~~~~~~~



**process**
The command to execute

| *type*: `string`
| *default*: `True`
| *optional*: `False`



miscellaneous
~~~~~~~~~~~~~

**Backend**
ruff
**Author**
Mark Fiers
**Creation date**
Tue Mar 29 16:34:19 2011
**Modification date**
Wed Mar 30 06:02:01 2011

0 comments on commit 8cc24c3

Please sign in to comment.