GitHub - dib-lab/dib-MMETSP: Code to generate re-assemblies of the Marine Microbial Eukaryote Transcriptome Sequencing Project (MMETSP)

dib-MMETSP

Output files available for download:

Transcriptome assemblies (fasta):

Annotations (gff):

Table of one annotation name (best = sorted by e-value < 1e-05) by transcript ID (.csv):

Peptide translations (fasta):

Expression quantification (salmon output):

All files combined:

Pipeline scripts:

Citation:

Johnson, Lisa K., Alexander, Harriet, & Brown, C. Titus. (2018). MMETSP re-assemblies [Data set]. Zenodo. https://doi.org/10.5281/zenodo.740440

MMETSP pipeline

This respository contains the pipeline code used to generate re-assemblies of the Marine Microbial Eukaryote Transcriptome Sequencing Project (MMETSP). Originally: https://github.com/ljcohen/MMETSP

This pipeline was constructed to automate the eel pond khmer protocols over a large-scale RNAseq data set. The data set used is from the Marine Microbial Eukaryotic Transcriptome Sequencing Project (MMETSP), which contains 678 cultured samples of 306 pelagic and endosymbiotic marine eukaryotic species representing more than 40 phyla (Keeling et al. 2014).

Input file is SraRunInfo.csv, a metadata spreadsheet downloaded from NCBI-SRA that contains the url and sample ID information. Scripts were designed for the high performance computing cluster at Michigan State University, iCER, and will be launched in parallel through the portable batch system (PBS) scheduler. Scripts will use the SraRunInfo.csv metadata spreadsheet to download and extract data, run qc, trim, diginorm, then assemble using Trinity. If you are interested in using these scripts, please be aware that modifications will be required specific to the system you are using.

The main pipeline scripts in this repository:

getdata.py, download data from NCBI and organize into individual directories for each sample/accession ID
trim_qc.py, trim reads for quality, interleave reads
diginorm_mmetsp.py, normalize-by-median and filter-abund from khmer, rename, combined orphans
assembly.py, runs Trinity de novo transcriptome assembly software

Annotation and expression counts (run separately):

dammit.py, annotation https://github.com/camillescott/dammit/tree/master/dammit
salmon.py, runs salmon reference-free transcript quantification https://github.com/COMBINE-lab/salmon

Additional scripts (run separately):

rapclust.py, clustering contigs https://github.com/COMBINE-lab/rapclust
busco.py, assessing assembly and annotation completeness with single-copy orthologs http://busco.ezlab.org/
clusterfunc.py, cluster control module
sourmash.py, MinHash signatures to cluster unassembled reads https://github.com/dib-lab/sourmash/tree/v0.9.4
transdecoder.py, translate nucleotide contigs to amino acid contigs http://transdecoder.github.io/
transrate.py, evaluate assembly with reads http://hibberdlab.com/transrate/
transrate_reference.py, evaluate assembly with reference assembly http://hibberdlab.com/transrate/

Usage:

Clone this repo

git clone https://github.com/dib-lab/dib-MMETSP.git

edit dibMMETSP_configuration.py with absolute path names specific to your system. The file SraRunInfo.csv was obtained from NCBI for NCBI Bioproject accession: PRJNA231566. This set of code could be used with SraRunInfo.csv input from any collection of SRA records from NCBI or ENA.
Run the main python function