A tool for evaluating RNA seq mapping
Switch branches/tags
Nothing to show
Clone or download
Type Name Latest commit message Commit time
Failed to load latest commit information.
RNAseq_benchmark Update Data_preparation.md Sep 2, 2017
doc Update RNAseqEval.md Sep 22, 2017
example_dataset Update example.md Sep 2, 2017
img Add files via upload Aug 27, 2017
samscripts @ ef2baca Updating submodule samscripts to the latest version Sep 5, 2017
.gitignore Intermediate commit to backup changes on GITHub Jul 11, 2016
.gitmodules First alpha version 0.01 Apr 21, 2016
Annotation_formats.py Minor fixes and enhancements Jul 6, 2018
Process_pbsim_data.py Sall improvement to real data evaluation May 21, 2018
README.md Update README.md Oct 10, 2017
RNAseqEval.py Merge branch 'master' of https://github.com/kkrizanovic/RNAseqEval Nov 15, 2018
basicdefines.py Alpha 0.02 Apr 21, 2016
file_compare.py Qname analysis scripts and options Mar 22, 2018
generate_transcriptome.py Fixed a bug in generate_transcriptome.py Oct 24, 2016
get_chimer_from_paf.py Bugfuxes and ease of use improvements! Mar 6, 2018
paramsparser.py Commit before refactoring May 3, 2016
prepare_data.py Typo corrected Nov 23, 2016
qname_analysis.py Qname analysis scripts and options Mar 22, 2018
setup_RNAseqEval.py Alpha 0.02 Apr 21, 2016
test_cigars.py Adding some new measures for real data Jun 6, 2018



A collection of tools for evaluating RNA seq mapping. The tools were used to benchmark some RNA mapping tools on real and synthetic third generation sequencing datasets. Detailed description of synthetic dataset preparation can be found at RNAseq_benchmark/Data_preparation.md. Description of the evaluation process for real and simulated datasets can be found at RNAseq_benchmark/RNAseq_benchmark.md.


Since the RNAseqEval repository contains python scripts, it does not require an installation. Only requirement is to clone RNAseqEval repository together with the samscripts submodule:

git clone --recursive https://github.com/kkrizanovic/RNAseqEval.git

The other way is to clone the main repository first and then update the submodule:

git clone https://github.com/kkrizanovic/RNAseqEval.git
cd RNAseqEval
git submodule update --init --recursive


The repository contains Python scripts only and requires a Python 2 interpreter. We have tested it on Ubuntu server 14.04 and 16.04 with Python 2.7.12 However, we believe that it should also work with older versions of Python and on other operating systems.



Run generate_transcriptome.py to generate a trancriptome from a reference and a set of annotations.

How to run:

 generate_transcriptome.py annotations.gtf reference.fasta transcriptome.fasta

Generated transcriptome can be used to simulate RNA reads using DNA simulators such as PBSIM.


Run RNAseqEval.py for general evaulation of mappings in sam file against reference and optionally annotations. This script is intended to evaluate real dataset mapping. Run RNAseqEval.py without any arguments to print options.


RNAseqEval.py eval-mapping <reference FASTA file> <input SAM file> options

-a <file> : a reference annotation (GFF/GTF/BED) file
-o (--output) <file> : output file to which the report will be written

Detailed description of running modes, options and output can be found at doc/RNAseqEval.md.


Run Process_pbsim_data.py to evaluate mappings of data generated by the PBSIM simulator. It requires the simulation data to be organized in a specific way.

How to run:

Process_pbsim_data.py process simulation_root_folder mappings.sam annotations.gtf

Detailed description of options, output and required simulation data organization can be found at doc/Process_pbsim_data.md.

Example dataset

Folder example_dataset contains an example dataset, simulated by applying PBSIM o a transcriptome. Example dataset was generated usign reference and annotations for_ Drosophilla Melanogaster_ chromosome 4. The folder contains everything necessary to test out our evaluation tools. More on example dataset can be fouund at example_dataset/example.md.


This work has been supported in part by Croatian Science Fundation under the project UIP-11-2013-7353.