-
Notifications
You must be signed in to change notification settings - Fork 10
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Mark Fiers
committed
May 24, 2012
1 parent
23520c7
commit 8cc24c3
Showing
40 changed files
with
4,249 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,2 @@ | ||
.. automodule:: moa.plugin.checkversion | ||
:members: |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,2 @@ | ||
.. automodule:: moa.plugin.doc | ||
:members: |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,2 @@ | ||
.. automodule:: moa.plugin.mail | ||
:members: |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,2 @@ | ||
.. automodule:: moa.plugin.metavar | ||
:members: |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,2 @@ | ||
.. automodule:: moa.plugin.project | ||
:members: |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,2 @@ | ||
.. automodule:: moa.plugin.report | ||
:members: |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,2 @@ | ||
.. automodule:: moa.plugin.sgeActor | ||
:members: |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,2 @@ | ||
.. automodule:: moa.plugin.umask | ||
:members: |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,2 @@ | ||
.. automodule:: moa.plugin.varInject | ||
:members: |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,75 @@ | ||
Synchronizing jobs | ||
================== | ||
|
||
It is quite often usefull to repeat a jobs on a number of different | ||
input files. For simple operations, one liners, this ca be | ||
accomplished using `moa map`. More complex operations, or those | ||
requiring a template other than `map` can be replicated using job | ||
syncronization. Assume you have a set of fastq libraries, each in it's | ||
own directory:: | ||
|
||
./fq/set1/set1_1.fq | ||
./fq/set1/set1_2.fq | ||
./fq/set2/set2_1.fq | ||
./fq/set2/set2_2.fq | ||
./fq/set3/set3_1.fq | ||
./fq/set3/set3_2.fq | ||
|
||
And you want to run a bowtie alignment for each separately. The | ||
approach to take is to create a directory containing all alignments:: | ||
|
||
|
||
mkdir bowtie | ||
cd bowtie | ||
|
||
and, in that directory, create one job running bowtie, in a directory | ||
named **exactly** as the input directories:: | ||
|
||
mkdir set1 | ||
cd set1 | ||
moa new bowtie -t 'run bowtie for {{_}}' | ||
|
||
Note the magic variable `{{_}}`. This variable is replaced by the name | ||
of the current directory. So when running `moa show`, the title would | ||
show up as "run bowtie for set1". This magic variable can be used in | ||
all variables, and we'll use it here to set this job up in such a way | ||
that it can be reused for the other datasets:: | ||
|
||
set moa fq_forward_input='../../fq/{{_}}/*_1.fq' | ||
# .. configure the remaining variables | ||
|
||
Now - we replicate this directory in the following manner. We'll move | ||
one directory up, to the `bowtie` directory, and create a `sync` job:: | ||
|
||
cd .. | ||
moa new sync -t 'run bowtie for all fq datasets' | ||
moa set source=../fq/ | ||
|
||
The sync template keeps directories synchronized, based on the | ||
`source` directory. If you now run `moa run` in the `bowtie` | ||
directory, two more directories will be created: `set2` and `set3`, | ||
each containing a verbatim copy of the original bowtie job created. | ||
|
||
If, at a certain moment you obtain more fastq datasets:: | ||
|
||
./fq/set4/set4_1.fq | ||
./fq/set4/set4_2.fq | ||
|
||
you can repeat `moa run` in the `./bowtie` sync directory, and a new | ||
directory will be created. Note that the `sync` template will not | ||
remove directories. Also if you want to update the configuration of | ||
the syncronized bowtie jobs, you only need to change the configuration | ||
in one directory, run `moa run` again in the `./bowtie` directory and | ||
the configuration is synchronized across all jobs. | ||
|
||
|
||
|
||
|
||
|
||
|
||
|
||
|
||
|
||
|
||
|
||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,43 @@ | ||
archroot | ||
------------------------------------------------ | ||
|
||
**Helper script for a root archive** | ||
|
||
|
||
Helper script for the root of an archive template | ||
|
||
|
||
|
||
Commands | ||
~~~~~~~~ | ||
|
||
**run** | ||
*no help defined* | ||
|
||
|
||
|
||
Parameters | ||
~~~~~~~~~~ | ||
|
||
|
||
|
||
**moa_archive_parameters** | ||
space separated list of parameters to set for this template | ||
|
||
| *type*: `string` | ||
| *default*: `{}` | ||
| *optional*: `False` | ||
|
||
|
||
|
||
miscellaneous | ||
~~~~~~~~~~~~~ | ||
|
||
**Backend** | ||
ruff | ||
**Author** | ||
Mark Fiers | ||
**Creation date** | ||
Tue, 17 Apr 2012 10:21:31 | ||
**Modification date** | ||
Tue, 17 Apr 2012 10:21:25 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,121 @@ | ||
filterwgs_pair | ||
------------------------------------------------ | ||
|
||
**Execute a "map22" ad-hoc analysis - two input files, two output files** | ||
|
||
|
||
Filter raw WGS data | ||
|
||
|
||
|
||
Commands | ||
~~~~~~~~ | ||
|
||
**run** | ||
Filter WGS data | ||
|
||
|
||
|
||
Filesets | ||
~~~~~~~~ | ||
|
||
|
||
**input1** | ||
forward input fastq | ||
|
||
|
||
|
||
|
||
|
||
**input2** | ||
reverse input fastq | ||
|
||
|
||
| *type*: `map` | ||
| *source*: `input1` | ||
| *category*: `input` | ||
| *optional*: `False` | ||
| *pattern*: `*/*` | ||
|
||
|
||
|
||
|
||
**output1** | ||
forward output fastq | ||
|
||
|
||
| *type*: `map` | ||
| *source*: `input1` | ||
| *category*: `output` | ||
| *optional*: `True` | ||
| *pattern*: `./*` | ||
|
||
|
||
|
||
|
||
**output2** | ||
reverse output fastq | ||
|
||
|
||
| *type*: `map` | ||
| *source*: `input1` | ||
| *category*: `output` | ||
| *optional*: `True` | ||
| *pattern*: `./*` | ||
|
||
|
||
|
||
|
||
|
||
Parameters | ||
~~~~~~~~~~ | ||
|
||
|
||
|
||
**adapters** | ||
Fasta file with the adapter sequences to trim | ||
|
||
| *type*: `file` | ||
| *default*: `{}` | ||
| *optional*: `False` | ||
|
||
|
||
|
||
**minlen** | ||
Minimum remaining sequence length | ||
|
||
| *type*: `int` | ||
| *default*: `50` | ||
| *optional*: `True` | ||
|
||
|
||
|
||
**qual** | ||
quality threshold causing trimming | ||
|
||
| *type*: `int` | ||
| *default*: `13` | ||
| *optional*: `True` | ||
|
||
|
||
|
||
**title** | ||
|
||
|
||
| *type*: `{}` | ||
| *default*: `Filter paired fastq files using fastq-mcf` | ||
| *optional*: `{}` | ||
|
||
|
||
|
||
miscellaneous | ||
~~~~~~~~~~~~~ | ||
|
||
**Backend** | ||
ruff | ||
**Author** | ||
Mark Fiers | ||
**Creation date** | ||
Tue Mar 29 16:34:19 2011 | ||
**Modification date** | ||
Mon, 13 Feb 2012 09:16:36 +1300 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,81 @@ | ||
map2 | ||
------------------------------------------------ | ||
|
||
**Execute a "map2" ad-hoc analysis** | ||
|
||
|
||
Execute one command, on a number of input files. | ||
|
||
|
||
|
||
Commands | ||
~~~~~~~~ | ||
|
||
**run** | ||
*no help defined* | ||
|
||
|
||
|
||
Filesets | ||
~~~~~~~~ | ||
|
||
|
||
**input1** | ||
"map" input files set 1 | ||
|
||
|
||
|
||
|
||
|
||
**input2** | ||
"map" input files set 2 | ||
|
||
|
||
| *type*: `map` | ||
| *source*: `input1` | ||
| *category*: `input` | ||
| *optional*: `False` | ||
| *pattern*: `*/*` | ||
|
||
|
||
|
||
|
||
**output** | ||
"map" output files | ||
|
||
|
||
| *type*: `map` | ||
| *source*: `input1` | ||
| *category*: `output` | ||
| *optional*: `True` | ||
| *pattern*: `./*` | ||
|
||
|
||
|
||
|
||
|
||
Parameters | ||
~~~~~~~~~~ | ||
|
||
|
||
|
||
**process** | ||
The command to execute | ||
|
||
| *type*: `string` | ||
| *default*: `True` | ||
| *optional*: `False` | ||
|
||
|
||
|
||
miscellaneous | ||
~~~~~~~~~~~~~ | ||
|
||
**Backend** | ||
ruff | ||
**Author** | ||
Mark Fiers | ||
**Creation date** | ||
Tue Mar 29 16:34:19 2011 | ||
**Modification date** | ||
Wed Mar 30 06:02:01 2011 |
Oops, something went wrong.