Evaluating 'Graphical Perception' with CNNs
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.

README.md

Evaluating 'Graphical Perception' with CNNs

Image

PAPER | SUPPLEMENTAL | FASTFORWARD | VIDEO

Convolutional neural networks can successfully perform many computer vision tasks on images. For visualization, how do CNNs perform when applied to graphical perception tasks? We investigate this question by reproducing Cleveland and McGill’s seminal 1984 experiments, which measured human perception efficiency of different visual encodings and defined elementary perceptual tasks for visualization. We measure the graphical perceptual capabilities of four network architectures on five different visualization tasks and compare to existing and new human performance baselines. While under limited circumstances CNNs are able to meet or outperform human task performance, we find that CNNs are not currently a good model for human graphical perception. We present the results of these experiments to foster the understanding of how CNNs succeed and fail when applied to data visualizations.

Note: This paper will be presented at IEEE Vis 2018 in Berlin!

Data

The data including trained models, experiments, and results are available on Dropbox.

Access it here!

Code

Everything is available in this repository!

git clone https://github.com/Rhoana/perception.git

cd perception

Setup

We need Anaconda or Miniconda (tested version 5.0.1 on Linux)! Get it here !

The virtual environment with all dependencies (keras, tensorflow, yadayada..) can then be created like this:

conda env create -f CONDAENV

The environment can then be directly activated

conda activate CP

And now jupyter notebook allows for execution of the IPY/ stuff! Or the driver codes can be run directly from the EXP/ folder.

Stimuli Generation

Regression code

BibTex

@article{haehn2018evaluating,
  title={Evaluating 'Graphical Perception' with CNNs},
  author={Haehn, Daniel and Tompkin, James and Pfister, Hanspeter},
  journal={IEEE Transactions on Visualization and Computer Graphics (IEEE VIS)},
  volume={to appear},
  number={X},
  pages={X--X},
  year={2018},
  month={October},
  publisher={IEEE},
  supplemental={http://danielhaehn.com/papers/haehn2018evaluating_supplemental.pdf},
  code={http://rhoana.org/perception/},
  data={http://rhoana.org/perception/},
  video={https://vimeo.com/280506639},
  fastforward={https://vimeo.com/285106317}
}

Feedback..

.. is very welcome! Please contact http://danielhaehn.com !

THANK YOU