Skip to content
A Python-based simulation framework for bionic vision
Python MATLAB Shell
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
.github/ISSUE_TEMPLATE Update issue templates Jun 8, 2019
data implement and address all review comments; add missing implants test … Mar 24, 2017
doc Add RTD integration: badge, updated conf.py, requirements.txt Aug 15, 2019
examples/notebooks move plot_fundus to viz module Aug 15, 2018
matlab
pulse2percept [ENH] Add class for the AlphaIMS implant (#87) Jun 19, 2019
scripts add load/save video utilities to files module Mar 24, 2017
.gitignore rebase onto mb/retinalcoord Oct 23, 2017
.travis.yml ENH: Switch to codecov (#91) May 3, 2019
CODE_OF_CONDUCT.md Create CODE_OF_CONDUCT.md Jun 10, 2019
CONTRIBUTING.md Create CONTRIBUTING.md Jun 8, 2019
LICENSE
README.md Add RTD integration: badge, updated conf.py, requirements.txt Aug 15, 2019
build-wheels.sh update build-wheels; release v0.4.3 May 21, 2018
requirements.txt BF: Import `factorial` from `scipy.special` (#94) Jun 8, 2019
setup.cfg
setup.py add build-wheels.sh; release 0.4.2 May 20, 2018

README.md

Build Status Coverage Status PyPI Documentation Status license

pulse2percept: A Python-based simulation framework for bionic vision

Summary

By 2020 roughly 200 million people will suffer from retinal diseases such as macular degeneration or retinitis pigmentosa. Consequently, a variety of retinal sight restoration procedures are being developed to target these diseases. Electronic prostheses (currently being implanted in patients) directly stimulate remaining retinal cells using electrical current, analogous to a cochlear implant. Optogenetic prostheses (soon to be implanted in human) use optogenetic proteins to make remaining retinal cells responsive to light, then use light diodes (natural illumination is inadequate) implanted in the eye to stimulate these light sensitive cells.

However, these devices do not restore anything resembling natural vision: Interactions between the electronics and the underlying neurophysiology result in significant distortions of the perceptual experience.

We have developed a computer model that has the goal of predicting the perceptual experience of retinal prosthesis patients. The model was developed using a variety of patient data describing the brightness and shape of phosphenes elicited by stimulating single electrodes, and validated against an independent set of behavioral measures examining spatiotemporal interactions across multiple electrodes.

The model takes as input a series of (simulated) electrical pulse trains---one pulse train per electrode in the array---and converts them into an image sequence that corresponds to the predicted perceptual experience of a patient:

If you use pulse2percept in a scholary publication, please cite as:

M Beyeler, GM Boynton, I Fine, A Rokem (2017). pulse2percept: A Python-based simulation framework for bionic vision. Proceedings of the 16th Python in Science Conference, p.81-88, doi:10.25080/shinma-7f4c6e7-00c.

Or use the following BibTex:

@InProceedings{ BeyelerSciPy2017,
  author    = { {M}ichael {B}eyeler and {G}eoffrey {M}. {B}oynton and {I}one {F}ine and {A}riel {R}okem },
  title     = { pulse2percept: {A} {P}ython-based simulation framework for bionic vision },
  booktitle = { {P}roceedings of the 16th {P}ython in {S}cience {C}onference },
  pages     = { 81 - 88 },
  year      = { 2017 },
  doi       = { 10.25080/shinma-7f4c6e7-00c },
  editor    = { {K}aty {H}uff and {D}avid {L}ippa and {D}illon {N}iederhut and {M} {P}acer }
}

Scientific studies referencing pulse2percept:

  • A Lozano, JS Suarez, C Soto-Sanchez, J Garrigos, J-J Martinez, JM Ferrandez Vicente, E Fernandez-Jover (2019). Neurolight Alpha: Interfacing Computational Neural Models for Stimulus Modulation in Cortical Visual Neuroprostheses. International Work-Conference on the Interplay Between Natural and Artificial Computation (IWINAC), doi:10.1007/978-3-030-19591-5_12.
  • NP Cottaris, H Jiang, X Ding, BA Wandell, DH Brainard (2019). A computational-observer model of spatial contrast sensitivity: Effects of wave-front-based optics, cone-mosaic structure, and inference engine. Journal of Vision 19(8), doi:10.1167/19.4.8.
  • L Wang, F Sharifian, J Napp, C Nath, S Pollmann (2018). Cross-task perceptual learning of object recognition in simulated retinal implant perception. Journal of Vision 18(22), doi:10.1167/18.13.22.
  • M Beyeler, D Nanduri, JD Weiland, A Rokem, GM Boynton, I Fine (2018). A model of ganglion axon pathways accounts for percepts elicited by retinal implants. bioRxiv 453035, doi:10.1101/453035.
  • J Huth, T Masquelier, A Arleo (2018). Convis: A toolbox to fit and simulate filter-based models of early visual processing. Frontiers in Neuroinformatics, doi:10.3389/fninf.2018.00009.
  • J Steffen, J Napp, S Pollmann, K Tönnies (2018). Perception Enhancement for Bionic Vision - Preliminary Study on Object Classification with Subretinal Implants. Proceedings of the 7th International Conference on Pattern Recognition Applications and Methods, 169-177. doi:10.5220/0006648901690177
  • JR Golden, C Erickson-Davis, NP Cottaris, N Parthasarathy, F Rieke, DH Brainard, BA Wandell, EJ Chichilnisky (2018): Simulation of visual perception and learning with a retinal prosthesis. bioRxiv 206409, doi:10.1101/206409.

Installation

Prerequisites

pulse2percept requires the following software installed for your platform:

  1. Python 2.7 or >= 3.4

  2. NumPy

  3. SciPy

  4. JobLib

  5. scikit-image

Optional packages:

  1. Dask for parallel processing (a joblib alternative). Use conda to install.

  2. Numba. Use conda to install.

  3. ffmpeg codec if you're on Windows and want to use functions in the files module.

Stable version

The latest stable release of pulse2percept can be installed with pip:

$ pip install pulse2percept

Development version

In order to get the bleeding-edge version of pulse2percept, use the commands:

$ git clone https://github.com/uwescience/pulse2percept.git
$ cd pulse2percept
$ python setup.py install

To test pulse2percept after installation, execute in Python:

>>> import pulse2percept

Getting started

A number of useful examples can be found in the "examples/notebooks" folder, including the following:

Detailed documentation can be found at pulse2percept.readthedocs.io.

You can’t perform that action at this time.