Rapid and robust analysis of RNA-Seq experiments.
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
build
extra
src
CMakeLists.txt
LICENSE.md
README.md
git-commit-gen
git-version-gen

README.md

Isolator

Isolator analyzes RNA-Seq experiments.

There are many methods to analyze RNA-Seq data. Isolator differs in few important ways.

  • Isolator has a particular focus on producing stable, consistent estimates. Maximum likelihood approaches produce unstable point estimates: small changes in the data can result in drastically different results, conflating downstream analysis like clustering or PCA. Isolator produces estimates that are in general, simultaneously more stable and more accurate other methods.
  • It implements a full hierarchical Bayesian model of an entire RNA-Seq experiment. Pooling information leads more accurate estimates of effect size, particularily at low-levels. Conditions can be compared or clustered without throwing anything out.
  • It saves all the samples generated by the sampler, which can be process to compute posterior probabilities for arbitrarily complex questions, far beyond the confines of pairwise tests.
  • It aggressively corrects for technical effects, such as random priming bias, GC-bias, 3' bias, and fragmentation effects.
  • Compared to other MCMC approaches, it is exceedingly efficient. Though, generally slower that modern maximum likelihood approaches.

Note: I've run this tool on a lot of data, evaluated it with multiple benchmarks, and am writing a paper about it, but it's still alpha software. Contact me if you'd like help using it to analyze your data.

Installing

Currently, Isolator must be installed by cloning the git repository and building the source code. It has been tested on OS X and Linux.

Installing Dependencies

To build Isolator from source, you will need to first install Boost, HDF5, and cmake.

Linux

On Debian, Ubuntu, or similar.

apt-get install libboost-dev libboost-thread-dev libboost-system-dev libboost-timer-dev libhdf5-dev cmake

OSX

The easiest way to install dependencies is with Homebrew.

brew install boost hdf5 cmake

Building Isolator

From git

git clone https://github.com/dcjones/isolator.git
cd isolator/build
cmake ..
make
make install

This will install the isolator program to the default destination (usually /usr/local/bin).

Analyzing an RNA-Seq Experiment

Isolator works in two steps: analysis and summarization. The analysis step will run the sampler for a number of iterations collecting estimates of the model parameters, which it will output to an HDF5 file. This output can then mu summarized and turned into regular tab-delimined tables in a variety of ways.

What you'll need

Input to isolator is a GTF giving transcript/gene annotations along with one or more BAM/SAM files giving the aligned reads for each sample or replicate in the experiment.

Optionally, the genome sequence can also be provided in FASTA format, allowing isolator to correct for various forms of sequence bias, typically resulting in more accurate quantification.

Analyzing the Experiment

Experiments consist of one or more BAM (or SAM) files grouped into conditions. Isolator puts no restriction on the number of conditions or the number of samples within conditions, though if the goal is to compare two or more biological conditions, using multiple replicates is strongy recommended.

The analyze command is invoked like:

isolator analyze gene_annotations.gtf \
    a1.bam,a2.bam,a3.bam b1.bam,b2.bam,b3.bam

BAM files within the same condition are grouped with commas, and conditions are separated with spaced. Analyze is a general purpose command. It can also be invoked on a single bam file.

isolator analyze gene_annotations.gtf a.bam

The analyze command will run for a while and output a file named (by default) isolator-output.h5. It is an HDF5 file, which is a standardized data format than can be accessed using wide variety of tools. However, data stored in this file is a raw form, and typically far more information than is needed. To quickly generate to-the-point results, there is the isolator summarize command.

Summarizing the Analysis

The isolator analyze estimates parameters for a full probabilistic model of the experiment. It is not a simple statistical test that attempts to answer a single question (e.g. whether a gene is differentialy expressed). As a result, the results generated from isolator analyze can be used to examine the data in many ways.

This is where the isolator summarize comes in. It provides a number of sub-commands to generate simple tables of results from the sampler output. What follows are several examples. To see a list of the summarize sub-commands, run isolator summarize --list.

Transcript and Gene Expression

The simplest sort of summarization one might perform is to generate estimates of transcript expression.

isolator summarize transcript-expression isolator-output.h5

This will generate a tab-delimited file (named transcript-expression.tsv) that looks like:

gene_name       gene_id transcript_id           sample1_tpm    sample2_tpm    sample3_tpm    sample4_tpm    sample5_tpm    sample6_tpm
mt-Tf   ENSMUSG00000064336      ENSMUST00000082387      3.064260e+01    3.542358e+01    3.068786e+01    3.283976e+01    3.785287e+01    3.647695e+01
mt-Rnr1 ENSMUSG00000064337      ENSMUST00000082388      1.812662e+03    2.566914e+03    2.470344e+03    2.728776e+03    2.445997e+03    2.241069e+03
mt-Tv   ENSMUSG00000064338      ENSMUST00000082389      3.002667e+01    3.085850e+01    3.081490e+01    3.373214e+01    3.507645e+01    3.934946e+01
mt-Rnr2 ENSMUSG00000064339      ENSMUST00000082390      1.337085e+03    1.855240e+03    2.015555e+03    1.996198e+03    1.914501e+03    1.927667e+03

Each column gives a point estimate of the transcripts per million (TPM).

Credible intervals (i.e. Bayesian confidence interval) for each point estimate can also be generated by passing the --credible argument. The following command will generate a table that include lower and upper bounds of 95% credible interval for each point estimate.

isolator summarize transcript-expression --credible=0.95 isolator-output.h5

Expression can also be summarized on the gene level, according to the gene_id field in the input GTF file.

isolator summarize gene-expression isolator-output.h5

Differential Expression, Transcription, and Splicing

Since Isolator follows a Bayesian methodology, it does not assign p-values to differential expression, but rather estimates a probability that the condition-wise tendendency has changed by more than some minimum fold change. The researcher may choose the minimum fold change (it is set to a log2 fold change of 1.5 by default).

The command to generate a table of differential expression results:

isolator summarize differential-transcript-expression isolator-output.h5
# OR
isolator summarize differential-gene-expression isolator-output.h5

The minmum effect size can be set with the --effect-size argument. E.g. passing --effect-size 2 will cause the summarize command to compute the probability of a 2-fold or greater change in expression between conditions.

Expression is a general term for the relative number of copies of an mRNA. A change in expression can be driven by a change in transcription or in post-transcriptional processing (e.g. splicing). Transcriptional and post-transcriptional effects are explicitly modeled in Isolator and splicing can be separately tested.

to summarize condition pairwise changes in splicing:

isolator summarize differential-splicing isolator-output.h5

There are also methods built in to test for splicing changes at the feature (i.e. cassette exons and retained introns, currently) level, which is often more robust due to varying annotation quality.

isolator summarize differential-feature-splicing isolator-output.h5

These commands similarly accept the -a, -b, and --effect-size arguments to set the conditions being tested and the minimum effect size, respectively.

Note: for simplicitly the term "splicing" is in used here, when in fact it will capture any change in expression dynamics occouring after transcription initiation, including changes in splicing and transcription termination.

Using an experiment specification file

In the previous examples we invoked isolator analyze by passing some number of BAM files as arguments. This can be a pain with complex experiments involving many conditions. Furthermore, to keept track of all these conditions, we may wish to provide names. The analyze command can also be invoked with a YAML file describing the experiment and the location of the BAM files.

This file is structured like the following.

condition1-name:
  condition1-replicate1-name: cond1-repl1-reads.bam
  condition1-replicate2-name: cond1-repl2-reads.bam

condition2-name:
  condition2-replicate1-name: cond2-repl1-reads.bam
  condition2-replicate2-name: cond2-repl2-reads.bam

If we same this to experiment.yml, we can then invoke the analyze command more conveniently:

isolator analyze genes.gtf experiment.yml

For a more concrete example, here's an example of a specification of an experiment involving six conditions, each with either three or two replicates.

h7-1yr:
    1-h7-1yr: 1-h7-1yr.bam
    2-h7-1yr: 2-h7-1yr.bam
    3-h7-1yr: 3-h7-1yr.bam

h7-day20:
    4-h7-day20: 4-h7-day20.bam
    5-h7-day20: 5-h7-day20.bam
    6-h7-day20: 6-h7-day20.bam

empty-vector:
    8-empty-vector: 8-empty-vector.bam
    9-empty-vector: 9-empty-vector.bam

let-7g-oe:
    10-let-7g-oe: 10-let-7g-oe.bam
    11-let-7g-oe: 11-let-7g-oe.bam
    12-let-7g-oe: 12-let-7g-oe.bam

fetal-ventricle:
    13-fetal-ventricle: 13-fetal-ventricle.bam
    14-fetal-ventricle: 14-fetal-ventricle.bam

fetal-atrium:
    15-fetal-atrium: 15-fetal-atrium.bam
    16-fetal-atrium: 16-fetal-atrium.bam