Skip to content

Commit

Permalink
typo
Browse files Browse the repository at this point in the history
  • Loading branch information
dkj committed Sep 11, 2023
1 parent 2611d28 commit 9100456
Showing 1 changed file with 10 additions and 9 deletions.
19 changes: 10 additions & 9 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,22 +11,22 @@ There are two main pipelines:

and the daemons which automatically start these pipelines.

Processing is performed as a appropriate for the entire run, for each lane in
the sequencing flowcell, or each tagged library (within a pool on the flowcell).
Processing is performed as appropriate for the entire run, for each lane in the
sequencing flowcell, or each tagged library (within a pool on the flowcell).

## Batch Processing and Dependency Tracking with LSF or wr

With this system, all of a pipeline's job for its steps are submitted for
With this system, all of a pipeline's jobs for its steps are submitted for
execution to the LSF, or wr, batch/job processing system as the pipeline is
initialised. As such, a _submitted_ pipeline does not have a orchestration
initialised. As such, a _submitted_ pipeline does not have an orchestration
script or daemon running: managing the runtime dependencies of jobs within an
instance of a pipeline is delegated to the batch/job processing system.

How is this done? The job representing the start point of a graph is submitted
to LSF, or wr, in a suspended state and is resumed once all other jobs have been
submitted thus ensuring that the execution starts only if all steps are
successfully submitted to LSF, or wr. If an error occurs at any point, all
submitted jobs, apart from the start job, are killed.
successfully submitted to LSF, or wr. If an error occurs at any point during job
submissions, all submitted jobs, apart from the start job, are killed.

## Pipeline Creation

Expand All @@ -51,7 +51,7 @@ DAG: some steps are appropriate for

parallelisation.

### Visualizing Input Graphs
#### Visualizing Input Graphs

JSON Graph Format (JGF) is relatively new, with little support for
visualization. Convert JGF to GML
Expand Down Expand Up @@ -84,8 +84,9 @@ The input for an instance of the pipeline is the instrument output run folder
processing.

The key data products are aligned CRAM files and indexes, or unaligned CRAM
files. However (per study) configuration allows for the creation of GATK gVCF
files, or the running for external tool/pipeline e.g. ncov2012-artic-nf
files. However per study (a LIMS datum) pipeline configuration allows for the
creation of GATK gVCF files, or the running for external tool/pipeline e.g.
ncov2012-artic-nf

!["central" pipeline](data/config_files/function_list_central.json.png)

Expand Down

0 comments on commit 9100456

Please sign in to comment.