Visualization of electronic medical records or other sequence event data.
Python JavaScript HTML Shell CSS
Switch branches/tags
Nothing to show
Clone or download
Latest commit ab527a0 Mar 26, 2018
Permalink
Failed to load latest commit information.
feature_extraction
js fix Oct 16, 2015
lib update submodules Feb 2, 2016
pub
test
.gitattributes
.gitignore use cache as setting Oct 15, 2015
.gitmodules make server for transparently changing to a dynamic system Oct 13, 2015
.travis.yml revert upgrading some packages Oct 16, 2015
LICENSE
build_dictionary.py
burst.py remove shebangs May 17, 2015
call.sh
cms_analyze.py
cms_get_patient.py
cms_shelve.md clean up readme.md Oct 20, 2015
config_omop.txt example cdm/omop config file Oct 19, 2015
config_shelve.txt deidentify fs Oct 18, 2015
favicon.ico make server for transparently changing to a dynamic system Oct 13, 2015
format.json
format_shelve.json deidentify fs Oct 18, 2015
full_deploy.sh
index.html no slow mode Oct 17, 2015
inspect.html
omop.py Merge remote-tracking branch 'rkboyce/master' Feb 2, 2016
open_url.sh updating shebang May 31, 2015
overview.png update overview figure Mar 12, 2015
pca.html lasso selection in pca Jun 26, 2015
poke_json.py fix poke script Oct 19, 2015
readme.md link to presentation Apr 13, 2016
requirements.txt optionally install psycopg2 Oct 15, 2015
server.py
setup.sh
shelve_access.py deidentify fs Oct 18, 2015
simplify.py
spec.md
start.sh updating shebang May 31, 2015
style.css fingerprints (kind-of) May 12, 2015
style_classes.json read visits Oct 19, 2015
text.html update loading path for images Jun 23, 2015
util.py

readme.md

patient-viz

patient-viz is a tool allowing to view and explore electronic medical records or other time sequence event data. The web-based tool is mostly written in d3 and uses python and shell on the back-end. Example data from medical insurance claim data can be downloaded automatically. We also have a live demo! The project is a joint product of Josua Krause, Narges Sharif Razavian, Enrico Bertini, and David Sontag. A short description of how to read the visualization can be found in the PDFs linked in the publications section.

The tool in action!

Build Status

Setup

Setting up the project can be done without prerequisites on MacOS and linux. For windows you need to install git and python and use git BASH to execute shell commands.

patient-viz supports four data formats as input:

  • OMOP Common Data Model: A PostgreSQL based data model. Instructions for setting up the connection can be found here.

  • CMS Data Model: A tabular data model in CSV files. Example data is openly available. Instructions on how to set up the tool for CMS data and how to download example data can be found here.

  • Shelve DB: A faster wrapper for CMS data. Instructions can be found here.

  • JSON input files. Directly access JSON files using the URL http://localhost:8000/patient-viz/?p=json/ABC.json&d=json/DEF.json where json/ABC.json and json/DEF.json are respectively events and dictionary JSON files as specified here. A python -m SimpleHTTPServer server needs to be running in the parent dictionary.

OMOP Common Data Model

patient-viz can connect to PostgreSQL databases in the OMOP Common Data Model. In order to do so you can use the following commands (assuming a fresh clone of the repository):

./setup.sh --default-omop

or

./setup.sh --default-omop --apt

if apt-get is available on your system. On MacOS the installation of the dependency psycopg2 may fail. In this case please refer to the psycopg installation guide.

Note: Dependency installation may require sudo rights and will prompt as needed. Do not run setup.sh with sudo.

You will be prompted questions to configure the connection to the PostgreSQL database containing the data. Using the external CCS hierarchy and caching are recommended options that allow for a richer and smoother user experience.

After successfully configuring the connection you can run

./server.py

to start the visualization server. Please refer to ./server.py -h for command line arguments. With the default command line arguments (ie. none) you can now browse http://localhost:8080/patient-viz/ (Note that patient-viz in the URL depends on the name of the folder that contains server.py).

If you want to inspect a certain patient you can browse to the corresponding id directly. For example, to show the patient with the person_id 1234 as found in the person table you can browse:

http://localhost:8080/patient-viz/?p=json/1234&d=json/dictionary.json

You can also use the person_source_value using a different notation. The patient with the person_source_value of 12345678 can be found at:

http://localhost:8080/patient-viz/?p=json/12345678.json&d=json/dictionary.json

(Note the .json after the id)

If you want to stop the server you can type quit into its console or issue a keyboard interrupt via CTRL-C. Type help for available server commands.

Updating the git repository to the newest version found on Github should be done via ./setup.sh --update as it cleans the cache and updates dependencies as well.

Publications

Contributing

Pull requests are highly appreciated :) Also, feel free to open issues for any questions or bugs you may encounter.