This is an implementation of the PASTA (Practical Alignment using Sate and TrAnsitivity) algorithm published in RECOMB-2014 and JCB:
- Mirarab S, Nguyen N, Warnow T. PASTA: ultra-large multiple sequence alignment. Sharan R, ed. Res Comput Mol Biol. 2014:177-191.
- Mirarab S, Nguyen N, Guo S, Wang L-S, Kim J, Warnow T. PASTA: Ultra-Large Multiple Sequence Alignment for Nucleotide and Amino-Acid Sequences. J Comput Biol. 2015;22(5):377-386. doi:10.1089/cmb.2014.0156.
- The current PASTA code is heavily based on the SATe code developed by Mark Holder's group at KU. Refer to sate-doc directory for documentation of the SATe code, including the list of authors, license, etc.
- Niema Moshiri has contributed to the import to dendropy 4 and python 3
Documentation: In addition to this README file, you can consult our Tutorial.
- You need to have python 2.7 or later (including python 3).
- You need to have java installed (required for Opal, which is by the default used in PASTA for merging small alignments).
You have three options for installing PASTA.
- Windows: If you have a Windows machine, currently using the Virtual Machine (VM) image we provide is your only option.
- Linux: If you have Linux (or other *nix systems), you can still use VM, but downloading the code from github and installing it is what we strongly recommend.
- MAC: We have three options for MAC: VM, installing from the code, and downloading .dmg file. If you mostly use the GUI, then the MAC .dmg file is a good option (although sometimes it can be behind the latest code).
1. From pre-build MAC image file
- Download the MAC application .dmg file here or from the project website.
- Open the .dmg file and copy its content to your preferred destination (do not run PASTA from the image itself).
- Simply run the PASTA app from where you copied it.
In some cases, your python installation might be in a location different from where PASTA is hoping to find it. In these cases, you get the following error message:
PASTA has encoutered a fatal error, and will now terminate. A Python runtime could not be located. You may need to install a framework build of Python, or edit the PyRuntimeLocations array in this application's info.plist file.
If you get this message, make sure you have python 2.7 installed. Then, run
python -c 'import sys; print sys.prefix'. This will tell you where your python
is located. Now click on the PASTA app and select
Show Package Content.
Contents and open
Info.plist with the text editor.
with the location of your python installation (likely it is
Try running the App again and see if it works.
- If the above solution does not work, or if you get other errors, try first
installing PASTA from the source code (see below) and then run
./make-app.shfrom the pasta directory. This will create an app under
distdirectory, which you should be able to run and copy to any other location.
2. From Source Code
Current version of PASTA has been developed and tested entirely on Linux and MAC. Windows won't work currently (future versions may or may not support Windows).
You need to have:
- Python (version 2.7 or later, including python 3)
- Dendropy (but the setup script should automatically install dendropy for you if you don't have it)
- Java (only required for using OPAL)
- wxPython - only required if you want to use the GUI.
Open a terminal and create a directory where you want to keep PASTA. e.g.
mkdir ~/pasta-code. Go to this directory. e.g.
Clone the PASTA code repository from our github repository. For example you can use
git clone https://github.com/smirarab/pasta.git. If you don't have git, you can directly download a zip file from the repository and decompress it into your desired directory.
Clone the relevant "tools" directory (these are also forked from the SATe project). There are different repositories for linux and MAC. You can use
git clone https://github.com/smirarab/sate-tools-linux.gitfor Linux or
git clone https://github.com/smirarab/sate-tools-mac.gitfor MAC. Or you can directly download these as zip files for Linux or MAC and decompress them in your target directory (e.g.
pasta-code). Note that the tools directory and the PASTA code directory should be under the same parent directory. Also note that when you use the zip files instead of using
git, after decompressing the zip file you may get a directory called
sate-tools-linux. You need to rename thse directories and remove the
-masterpart. Finally, those with 32-bit Linux machines need to be aware that the master branch has 64bit binaries. 32-bit binaries are provided in the
sate-tools-linuxgit project (so download this zip file instead).
cd pasta-masterif you used the zip file instead of clonning the git repository)
sudo python setup.py develop
If you don't have root access, remove the
sudo part and instead use
--user option. Alternativley, you can
--prefix to install in a different location, but that different location needs to be part of your
PYTHONPATH environmental variable.
Could not find SATe tools bundle directory:: this means you don't have the right tools directory at the right location. Maybe you downloaded MAC instead of Linux? Or, maybe you didn't put the directory in the parent directory of where pasta code is? Most likely, you used the zip files and forgot to remove teh
-masterfrom the directory name. Run
mv sate-tools-mac-master sate-tools-macon MAC or
mv sate-tools-linux-master sate-tools-linuxto fix this issue.
setup.pyscript is supposed to install setuptools for you if you don't have it. This sometimes works and sometimes doesn't. If you get and error with a message like
invalid command 'develop', it means that setuptools is not installed. To solve this issue, you can manually install setup tools. For example, on Linux, you can run
curl https://bootstrap.pypa.io/ez_setup.py -o - | sudo python(but note there are other ways of installing setuptools as well).
3. From Virtual Machine (VM)
VM Image (mostly for Windows users) is available for download (~3 GB). Once the image is downloaded, you need to run it using a VM environment (VirtualBox is a good option). After you install VirtualBox, you just need to use File/import to import the *.ova image that you have downloaded (If your machine has less than 3GB you might want to reduce the memory to something like 512MB). Once VM is imported, you can start it from the Virtualbox. If you are asked to login, the username and passwords are (username: phylolab, password: phylolab). PASTA is already installed on the VM machine, so you can simply proceed by opening a terminal and running it. VM version may be an older version.
email@example.com for installation issues.
To run PASTA using the command-line:
python run_pasta.py -i input_fasta [-t starting_tree]
PASTA by default picks the appropriate configurations automatically for you. The starting tree is optional. If not provided, PASTA estimates a starting tree.
python run_pasta.py --help
to see PASTA's various options and description of how they work.
To run the GUI version,
- if you have used the MAC .dmg file, you can simply click on your application file to run PASTA.
- if you have installed from the source code, cd into your installation directory and run
on some machines you may need to use
pythonw run_pasta_gui.py instead.
PASTA estimates alignments and ML trees from unaligned sequences using an iterative approach. In each iteration, it first estimates a multiple sequence alignment and then a ML tree is estimated on (a masked version of) the alignment. By default PASTA performs 3 iterations, but a host of options enable changing that behavior. In each iteration, a divide-and-conquer strategy is used for estimating the alignment. The set of sequences is divided into smaller subsets, each of which is aligned using an external alignment tool (default is MAFFT). These subset alignments are then pairwise merged (by default using Opal) and finally the pairwise merged alignments are merged into a final alignment using transitivity merge. The division of the dataset into smaller subsets and selecting which alignments should be pairwise merged is guided by the tree from the previous iteration. The first step therefore needs an initial tree.
When GUI is used, a limited set of important options can be adjusted on the GUI. The command line also allows you to alter the behavior of the algorithm, and provides a larger sets of options that can be adjusted.
Options can also be passed in as configuration files with the format:
[commandline] option-name = value [sate] option-name = value
With every run, PASTA saves the configuration file for that run as a temporary
[jobname]_temp_pasta_config.txt in your output directory.
Multiple configuration files can be provided. Configuration files are read in the order they occur as arguments (with values in later files replacing previously read values). Options specified in the command line are read last. Thus these values "overwrite" any settings from the configuration files.
Note: the use of --auto option can overwrite some of the other options provided by commandline or through configuration files. The use of this option is generally not suggested (a legacy option from SATe).
The following is a list of important options used by PASTA. Note that by default PASTA picks these parameters for you, and thus you might not need to ever change these:
- Initial tree:
If a starting tree is provided using the
-toption, then that tree is used. If the input sequence file is already aligned and
--alignedoption is provided, then PASTA computes a ML tree on the input alignment and uses that as the starting tree. If the input sequences are not aligned (or if they are aligned and
--alignedis not given), PASTA uses the procedure described below for estimating the starting alignment and tree.
- randomly selects a subset of 100 sequences.
- estimates an alignment on the subset using the subset alignment tool (default MAFFT-l-insi).
- builds a HMMER model on this "backbone" alignment.
- uses hmmalign to align the remaining sequences into the backbone alignment.
- runs FastTree on the alignment obtained in the previous step.
Data type: PASTA does not automatically detect your data type. Unless your data is DNA, you need to set the data type using
Subset alignment tool: the default is MAFFT, but you can change it using
Pairwise merge tool: the default is OPAL for dna and Muscle for protein. Change it using
Tree estimation tool: the default is FastTree. You can also set it to RAxML using
--tree-estimatoroption. Be aware that RAxML takes much longer than FastTree. If you really want to have a RAxML tree, we suggest obtaining one by running it on the final PASTA alignment. You can change the model used by FastTree (default: -gtr -gammaq for nt and -wag -gamma for aa) or RAxML (default GTRGAMMA for nt and PROTWAGCAT for AA) by updating the
[RAxML]header in the config file. The model cannot be currently updated in the command line.
Number of iterations: the simplest option that can be used to set the number of iterations is
--iter-limit. You can also set a time limit using
--time-limit, in which case, PASTA runs until the time limit is reached, and then continues to run until the current iteration is finished, and then stops. If both values are set, PASTA stops after the first limit is reached. The remaining options for setting iteration limits are legacies of SATe and are not recommended.
Masking: Since PASTA produces very gappy alignments, it is a good idea to remove sites that are almost exclusively gaps before running the ML tree estimation. By default, PASTA removes sites that are more than 99.9% gaps. You can change that using the
Maximum subset size: two options are provided to set the maximum subset size:
--max-subproblem-fracoption is a number between 0 and 1 and sets the maximum subset size as a fraction of the entire dataset. The
--max-subproblem-sizeoption sets the maximum size as an absolute number. When both numbers are provided (in either configuration file or the command line), the LARGER number is used. This is an unfortunate design (legacy of SATe) and can be quite confusing. Please always double check the actual subset size reported by PASTA and make sure it is the value intended.
Temporary files: PASTA creates many temporary files, and deletes most at the end. You can control the behavior of temporary files using
--temporaries(to set the tempdirectory),
-k(to keep temporaries) and
--keepalignmenttemps(to keep even more temporaries) options. Note that PASTA also creates a bunch of temporary files in the output directory and never deletes them, because these temporary files are potentially useful for the users. These files are all of the form
[jobname]_temp_*. Some of the important files created are alignments and tree produced in individual steps (alignments are saved both in masked and unmasked versions). These intermediate files all have internal PASTA sequence names, which are slightly different from your actual sequence names. The mapping between PASTA and real names are given also as a temporary file:
Dry run: The
--exportconfigoption can be used to crate a config file that can be checked for correctness before running the actual job.
CPUs: PASTA tries to use all the available cpus by default. You can use
num_cpusto adjust the number of threads used.
The remaining options available in PASTA are mostly legacies from SATe and are generally not useful for PASTA runs.
PASTA outputs an alignment and a tree, in addition to a host of other files. These various output files are described in more detail in our tutorial. Note that the support values on the PASTA output tree are local SH-like support values computed by FastTree, and not bootstrap support values. To get a more reliable measure of support, please use the bootstrapping procedure, applied to the final PASTA alignments (you can use RAxML for this purpose).
To show debug information, set the following environmental variables:
export PASTA_DEBUG=TRUE export PASTA_LOGGING_LEVEL=DEBUG export PASTA_LOGGING_FORMAT=RICH
(last line is optional)
PASTA uses the same license as SATe (GNU Public License).