Skip to content
Bioinformatics16: DeepChrome: Deep-learning for predicting gene expression from histone modifications
Branch: master
Clone or download
Latest commit 479327f May 9, 2019
Type Name Latest commit message Commit time
Failed to load latest commit information.
code Delete 8_featmap.lua Aug 30, 2016
talks add newly updated talk @ UCLA CGWI Mar 2, 2018
20171126-PNNL-AttentiveChrome.pdf back to PNNL talk that is more relevant Mar 9, 2018
CellInfo.pdf Add files via upload Feb 16, 2017
FeatureMaps and Add files via upload Jun 13, 2016 Update May 10, 2019


Reference Paper: DeepChrome: Deep-learning for predicting gene expression from histone modifications

BibTex Citation:

  title={DeepChrome: deep-learning for predicting gene expression from histone modifications},
  author={Singh, Ritambhara and Lanchantin, Jack and Robins, Gabriel and Qi, Yanjun},
  publisher={Oxford Univ Press}

DeepChrome is a unified CNN framework that automatically learns combinatorial interactions among histone modification marks to predict the gene expression. It is able to handle all the bins together, capturing both neighboring range and long range interactions among input features, as well as automatically extract important features. In order to interpret what is learned, and understand the interactions among histone marks for prediction, we also implement an optimizationbased technique for visualizing combinatorial relationships from the learnt deep models. Through the CNN model, DeepChrome incorporates representations of both local neighboring bins as well as the whole gene.

We have extended DeepChrome to AttentiveChrome @

AttentiveChrome is a unified architecture to model and to interpret dependencies among chromatin factors for controlling gene regulation. AttentiveChrome uses a hierarchy of multiple Long short-term memory (LSTM) modules to encode the input signals and to model how various chromatin marks cooperate automatically. AttentiveChrome trains two levels of attention jointly with the target prediction, enabling it to attend differentially to relevant marks and to locate important positions per mark. We evaluate the model across 56 different cell types (tasks) in human. Not only is the proposed architecture more accurate, but its attention scores also provide a better interpretation than state-of-the-art feature visualization methods such as saliency map.

Feature Generation for DeepChrome model:

We used the five core histone modification (listed in the paper) read counts from REMC database as input matrix. We downloaded the files from REMC dabase. We converted 'tagalign.gz' format to 'bam' by using the command:

gunzip <filename>.tagAlign.gz
bedtools bedtobam -i <filename>.tagAlign -g hg19chrom.sizes > <filename>.bam 

Next, we used "bedtools multicov" to get the read counts. Bins of length 100 base-pairs (bp) are selected from regions (+/- 5000 bp) flanking the transcription start site (TSS) of each gene. The signal value of all five selected histone modifications from REMC in bins forms input matrix X, while discretized gene expression (label +1/-1) is the output y.

For gene expression, we used the RPKM read count files available in REMC database. We took the median of the RPKM read counts as threshold for assigning binary labels (-1: gene low, +1: gene high).

We divided the genes into 3 separate sets for training, validation and testing. It was a simple file split resulting into 6601, 6601 and 6600 genes respectively.

We performed training and validation on the first 2 sets and then reported AUC scores of best performing epoch model for the third test data set.

Toy dataset has been provided inside "code/data" folder.

After downloading "code/" folder:

To perform training :

th doall.lua

To perform testing/Get visualization output:

the doall_eval.lua

The complete set of 56 Cell Type datasets is located at

You can’t perform that action at this time.