Rapid phylogenetic analysis of large samples of recombinant bacterial whole genome sequences using Gubbins
Latest commit 7df335d Sep 20, 2018

README.md

Gubbins

Genealogies Unbiased By recomBinations In Nucleotide Sequences

Build Status
License: GPL v2
status
install with bioconda
Container ready
Docker Build Status
Docker Pulls

Contents

Introduction

Since the introduction of high-throughput, second-generation DNA sequencing technologies, there has been an enormous increase in the size of datasets being used for estimating bacterial population phylodynamics. Although many phylogenetic techniques are scalable to hundreds of bacterial genomes, methods which have been used for mitigating the effect of mechanisms of horizontal sequence transfer on phylogenetic reconstructions cannot cope with these new datasets. Gubbins (Genealogies Unbiased By recomBinations In Nucleotide Sequences) is an algorithm that iteratively identifies loci containing elevated densities of base substitutions while concurrently constructing a phylogeny based on the putative point mutations outside of these regions. Simulations demonstrate the algorithm generates highly accurate reconstructions under realistic models of short-term bacterial evolution, and can be run in only a few hours on alignments of hundreds of bacterial genome sequences.

Installation

Before you do anything, please have a look at the Gubbins webpage.

Required dependencies

  • FastTree ( >=2.1.4 )
  • RAxML ( >=8.0 )
  • Python modules: Biopython (> 1.59), DendroPy (>=4.0), Reportlab, nose, pillow
  • Standard build environment tools (e.g. python3, pip3, make, autoconf, libtool, gcc, check, etc...)

There are a number of ways to install Gubbins and details are provided below. If you encounter an issue when installing Gubbins please contact your local system administrator. If you encounter a bug please log it here or email us at gubbins-help@sanger.ac.uk.

OSX/Linux - conda

Install conda and enable the bioconda channels.

conda config --add channels r
conda config --add channels defaults
conda config --add channels conda-forge
conda config --add channels bioconda
conda install gubbins

Linux - Ubuntu Xenial (16.04) & Debian (unstable)

Gubbins has been packaged by the Debian Med team and is trivial to install using apt.

sudo apt-get install gubbins

OSX/Linux/Cloud/Windows - Docker

We have a docker container which gets automatically built from the latest version of Gubbins in Debian Med. To install it:

docker pull sangerpathogens/gubbins

To use it you would use a command such as this:

docker run --rm -it -v <local_dir>:<remote_dir> sangerpathogens/gubbins run_gubbins -p <remote_dir>/<prefix> [<options>] <remote_dir>/<alignment_file>

The flag -v synchronizes a directory on the host machine (here denoted as <local_dir>) with a directory in the Docker container (here denoted as <remote_dir>). <remote_dir> does not need to exist in the container before the run, a common choice is /data. Note that both <local_dir> and <remote_dir> must be absolute paths.

The input alignment file must be present in <local_dir> (or in one of its subdirectories). In order to retrieve the files produced by Gubbins, run the program with option -p; the argument of this option must consist of <remote_dir>, followed by an arbitrary identifier (here denoted as <prefix>).

OSX/Linux - from source

This is the most difficult method and is only suitable for someone with advanced computing skills. Please consider using Conda instead.

Install the dependencies and include them in your PATH.

Clone or download the source code from GitHub and run the following commands to install Gubbins:

autoreconf -i
./configure [--prefix=$PREFIX]
make
[sudo] make install
cd python
[sudo] python3 setup.py install

Use sudo to install Gubbins system-wide. If you don't have the permissions, run configure with a prefix to install Gubbins in your home directory.

OSX/Linux/Windows - Virtual Machine

Gubbins wont run natively on Windows but we have created a virtual machine which has all of the software setup, along with the test datasets from the paper. It is based on Bio-Linux 8. You need to first install VirtualBox, then load the virtual machine, using the 'File -> Import Appliance' menu option. The root password is 'manager'.

  • ftp://ftp.sanger.ac.uk/pub/pathogens/pathogens-vm/pathogens-vm.latest.ova

More importantly though, if your trying to do bioinformatics on Windows, your not going to get very far and you should seriously consider upgrading to Linux.

Usage

To run Gubbins with default settings:

run_gubbins.py [FASTA alignment]

Input options:

--outgroup, -o	

The name of a sequence in the alignment on which to root the tree

--starting_tree, -s	

A Newick-format starting tree on which to perform the first iteration analysis. The default is to compute a starting tree using RAxML

--filter_percentage -f	

Filter out taxa with more than this percentage of missing data. Default is 25%

Processing options:

--tree_builder, -t	

The algorithm to use in the construction of phylogenies in the analysis; can be ‘raxml’, to use RAxML, ‘fasttree’, to use Fasttree, or ‘hybrid’, to use Fasttree for the first iteration and RAxML in all subsequent iterations. Default is raxml

--iterations, -i	

The maximum number of iterations to perform; the algorithm will stop earlier than this if it converges on the same tree in two successive iterations. Default is 5.

--min_snps, -m	

The minimum number of base substitutions required to identify a recombination. Default is 3.

--converge_method, -z

Criteria to use to know when to halt iterations [weighted_robinson_foulds|robinson_foulds|recombination]. Default is weighted_robinson_foulds.

Output options:

--use_time_stamp, -u	

Include a time stamp in the name of output files to avoid overwriting previous runs on the same input file. Default is to not include a time stamp.

--prefix, -p	

Specifiy a prefix for output files. If none is provided it defaults to the name of the input FASTA alignment

--verbose, -v	

Print debugging messages. Default is off.

--no_cleanup, -n

Do not remove files from intermediate iterations. This option will also keep other files created by RAxML and fasttree, which would otherwise be deleted. Default is to only keep files from the final iteration.

--raxml_model, -r

Change the model used by RAxML. The default it GTRCAT (with -V). You can set it to GTRGAMMA.

Generating Input files

Any application which can generate a whole genome multi-FASTA alignment can be used with Gubbins, such as Snippy.

Output files

Prefix
If a prefix is not defined with the –prefix option, the default prefix of the output files is: X.Y

where: X = Prefix taken from the input fasta file Y = Time stamp. NOTE: This will only be included in the output file prefix if the –u flag has been selected

Output file suffices:

.recombination_predictions.embl

Recombination predictions in EMBL tab file format.

.recombination_predictions.gff	

Recombination predictions in GFF3 format

.branch_base_reconstruction.embl	

Base substitution reconstruction in EMBL tab format.

.summary_of_snp_distribution.vcf	

VCF file summarising the distribution of SNPs

.per_branch_statistics.csv	

Per branch reporting of the base substitutions inside and outside recombinations events.

.filtered_polymorphic_sites.fasta	

FASTA format alignment of filtered polymorphic sites used to generate the phylogeny in the final iteration.

.filtered_polymorphic_sites.phylip	

Phylip format alignment of filtered polymorphic sites used to generate the phylogeny in the final iteration.

.final_tree.tre	

Final phylogenetic tree in newick format.

.node_labelled.final_tree.tre

Final phylogenetic tree in newick format but with internal node labels.

License

Gubbins is free software, licensed under GPLv2.

Feedback/Issues

Please report any issues to the issues page or email us at gubbins-help@sanger.ac.uk.

Citation

If you use this software please cite: [Croucher N. J., Page A. J., Connor T. R., Delaney A. J., Keane J. A., Bentley S. D., Parkhill J., Harris S.R. "Rapid phylogenetic analysis of large samples of recombinant bacterial whole genome sequences using Gubbins". doi:10.1093/nar/gku1196, Nucleic Acids Research, 2014.] (http://nar.oxfordjournals.org/content/43/3/e15)

Further Information

For more information on this software see the Gubbins webpage.

Data from the paper

  • ftp://ftp.sanger.ac.uk/pub/project/pathogens/gubbins/PMEN1.aln.gz
  • ftp://ftp.sanger.ac.uk/pub/project/pathogens/gubbins/ST239.aln.gz

Midpoint rerooting

From version 1.3.5 (25/6/15) to version 1.4.6 (29/2/16) trees were not midpoint rerooted by default. This doesnt have any effect on the recombination detection, but the output trees may not look as expected. Users are advised to upgrade to the latest version.

Ancestral sequence reconstruction

From version 2.0.0 onwards, RAxML is used to reconstruction ancestral sequences instead of fastML. RAxML doesnt always produce results as you would expect so the results can be lower quaility than fastML. If you would like to stick with fastML for ancestral sequence reconstruction, please checkout and install v1.4.9.