A project to extract CRISPR information from open genetic data.
Python HTML Perl Makefile Shell
Switch branches/tags
Nothing to show
Clone or download
mbonsma Merge pull request #282 from mbonsma/bac-phage-interactions
Beginnings of the pipeline to match spacers and phages
Latest commit 796e84e May 12, 2018
Failed to load latest commit information.
.coveragerc Specify paths to include in coverage. Jun 2, 2017
.editorconfig Add development environment setup scripts. Jan 20, 2018
.gitignore Ignores hmmercasdb storing hmmer database files. Jun 5, 2017
CODE-OF-CONDUCT.md Fix mail Nov 11, 2016
LICENSE PhageDB Reader using Regex and restructuring code Oct 10, 2014
README.md fixed broken links May 10, 2018



phageParser is a project to extract and organize CRISPR information from open genetic data.

Come chat with us!
Gitter chat

What is this tool?

Many bacterial and archaeal genomes have been sequenced, and a large fraction of them have CRISPR systems, ranging from deadly human pathogens to archaea living in the harshest environments on earth. Some CRISPR systems have been studied very well, and more is being discovered about CRISPR every day. phageParser is a tool to collect this growing pool of information and generate versatile and useful annotations. These are some of the annotations we include:

  • Spacer matches to known phages and prophages
  • Phage genome content near spacer matches
  • Spacer self-matches to host genome
  • cas gene content and inferred CRISPR type

We will collect these annotations in a database that can users can query through a GUI (graphical user interface). Neither of these exist yet, and we are looking for contributors!

This tool is currently in development, and it will always be possible to modify and enhance what is included as CRISPR research moves forward. We welcome suggestions for features or annotations you'd like to see! To suggest a feature, create an issue in our issue tracker.

Who is this for?

phageParser is for anyone interested in exploring what we know about CRISPR systems in nature. This includes researchers, educators, and the general public.

Where can I get involved?

We need many different skills and areas of expertise to build this tool, and you can help!

  • Check out the open canvas - this is a short outline of the project goals and plans.
  • Check out the Roadmap for an overview of where we're going and when.
  • Good first bugs include documentation and coding tasks that are doable by a newcomer. Mentoring is available for these tasks.
  • Do you know about CRISPR biology? Issues labeled science are things we need people with science background to work on.
  • Are you interested in contributing to project documentation? Any issues labeled documentation are ways to create or improve our docs.
  • Do you know about databases? We're just starting to think about how to structure our data - join the discussion in issue #64.
  • Do you know about Python and/or developing code? Check out our code-specific issues.
  • Check out our code of conduct which applies to all maintainers and contributors to this project.

About the CRISPR system

Clustered Regularly Interspaced Short Palindromic Repeats (CRISPR), and associated proteins (Cas) are part of the CRISPR-Cas system in bacteria. First observed in 1987 (Ishino et al., 1987), the CRISPR system is an adaptive immune system for bacteria.

When a virus enters a human body, specialized immune cells are often quick to recognize the virus invader and kill it. Bacteria do not have the benefit of millions of immune cells to protect them against viruses, but they have something else: CRISPR-Cas. The CRISPR-Cas immune response begins with the creation of spacer sequences from the invading virus' DNA followed by the production of small interfering crRNAs. Finally, when the bacterium is invaded again, the crRNAs recognize and cut the viral DNA, preventing infection.

Bacteria store their acquired spacers in their own DNA. The spacers are flanked by short pieces of bacterial DNA called repeats (see figure below).

CRISPR Locus Diagram

Amazingly, CRISPR-Cas immunity is both adaptive and hereditary! After acquiring a spacer, bacteria are both protected against future virus attacks and they can pass on their spacer libraries to their descendants.

More research is needed to better understand how bacteria use their CRISPR systems in nature.

*Ishino, Y., Shinagawa, H., Makino, K., Amemura, M., and Nakata, A. (1987). Nucleotide sequence of the iap gene, responsible for alkaline phosphatase isozyme conversion in Escherichia coli, and identification of the gene product. J. Bacteriol. 169, 5429–5433.

Relevant Literature

CRISPR-Cas Systems: Prokaryotes Upgrade to Adaptive Immunity: a very good review paper on the CRISPR-cas system, the biological backdrop of this project.


You can download the source code of the project by git: git clone https://github.com/phageParser/phageParser.git

After getting the local copy of the project, it is generally a good idea to create an isolated environment that belongs to the project and its specific packages. For this, python has a tool called virtualenv that can help create a python instance that has different packages than the system's version. To get started:

Make sure you have python3 in your system, if not, you can download python3 via their website

You can then install virtualenv package by pip

pip install virtualenv

For creating a virtualenv with a specific python version, you can supply the path of the python binary as an argument. The virtual python instances are conventionally kept in one place, usually in ~/.virtualenvs. You can create the folder and make an environment for phageParser as such:

mkdir ~/.virtualenvs && cd "$_"

python3 -m venv ~/.virtualenvs/pparserdev

You now have a separate environment which you can use to contribute phageParser. Whenever you're developing for phageParser, use the following command to activate the environment:

source ~/.virtualenvs/pparserdev/bin/activate

To install the required libraries for phageParser, after heading to the project folder containing requirements.txt, activate the project environment and run the following command:

pip install -r requirements.txt

For viewing the database, we recommend the Firefox SQLite Manager plugin. Once installed, launch it from the 'Tools' menu in Firefox.