Web app for CRISPR experiment setup and analysis. Fill in a 96-well plate and analyze it as a whole.
See it live at https://crispycrunch.czbiohub.org.
This app was developed by Greg Dingle starting in July 2018 for the genome engineering group in the CZ Biohub. The intention was to streamline the CRISPR experimentation process of researchers in the Biohub and provide a permanent record of experiments and results.
CrispyCrunch calls out to several bioinformatics web services.
Currently, CrispyCrunch calls out to mirrors for Crispor and Crispresso:
NOTE: The Crispor mirror is modified to support HDR primer design. See this PR.
NOTE: The Crispresso mirror is running in a Docker container on the same machine as Crispor. Docker service is modified on the machine to store all its data in
/mnt/data/docker. The code of
CRISPRessoCORE.py was modified from the public image to fix a bug in HDR stats. The number of Celery workers was increased from the default of 1 to 3 for better parallelism.
CrispyCrunch is built with the following technologies and frameworks.
Clone the repo. You must have czbiohub github access.
git clone firstname.lastname@example.org:czbiohub/crispycrunch.git
Install python dependencies
pip install -r requirements.txt
Start postgres. The exact command will depend on how you installed it.
brew services start postgresql
settings.py if needed.
Initialize the database.
python manage.py migrate
Create a superuser for admin.
python manage.py createsuperuser
NOTE: a superuser is automatically created by
Go to http://localhost:8000/. Create a new experiment and follow the subsequent steps.
Currently, CrispyCrunch uses Amazon's Elasticbeanstalk for deployment and hosting. EB manages a web server (EC2) and a database (RDS) in one deployment environment (prod). Open the EB control panel at https://us-west-2.console.aws.amazon.com/elasticbeanstalk/home?region=us-west-2#/environment/dashboard?applicationName=crispycrunch&environmentId=e-vnvbedub4n.
Install EB CLI.
pip install awsebcli
Commit any changes you wish to deploy.
git commit -a -m'fancy stuff'
Deploy to Amazon Elasticbeanstalk.
Wait for deployment to finish, then view the live site at http://crispycrunch.czbiohub.org/.
To download fastq files stored in s3, you must configure
See https://docs.aws.amazon.com/elasticbeanstalk/latest/dg/environments-cfg-softwaresettings.html and https://boto3.amazonaws.com/v1/documentation/api/latest/guide/configuration.html#environment-variable-configuration.
admin user is created on first installation. Change the password of that first superuser on first deployment.
You can give any other user admin or superuser status here: https://crispycrunch.czbiohub.org/admin/auth/user/ .
To inspect the source of fastq files, open https://console.aws.amazon.com/s3/buckets/czb-seqbot/.
To read the error logs in prod:
eb ssh tail /opt/python/log/django.log
To login to prod postgres:
eb ssh psql -h RDS_HOSTNAME -U RDS_USERNAME RDS_DB_NAME
Hint: Look in
/opt/python/current/env for secrets.
To create pre-authenticaed URLs for sharing using https://github.com/aaugustin/django-sesame:
# local eb ssh # remote cd /opt/python/current/ source env source /opt/python/run/venv/bin/activate cd app && python manage.py shell # python shell >>> from django.contrib.auth.models import User >>> user = User.objects.get(username='demo') >>> from sesame import utils >>> utils.get_query_string(user)
There should be at least one downtime alert setup here: https://console.aws.amazon.com/cloudwatch/home?region=us-west-2#s=Alarms&alarm=awseb-e-vnvbedub4n-stack-Severe-KUZS17WH3VE9
And you should receive emails of Django errors if you are the owner of
ADMIN_EMAIL. They are throttled with https://github.com/krisys/django-error-email-throttle .
You can see a table of error counts at https://crispycrunch.czbiohub.org/admin/error_email_throttle/