Skip to content
forked from jaxball/advis.js

[Tensorflow.js] AdVis: Exploring real-time Adversarial Attacks in the browser with Fast Gradient Sign Method.

License

Notifications You must be signed in to change notification settings

git-kush/advis.js

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

19 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

AdVis.js

AdVis.js is an interactive webtool that lets anyone to explore adversarial attacks by dynamically updating the classification scores and Class Activation Map (CAM) heatmap visualization of an input image as one tunes the strength of perturbation (epsilon in Fast Gradient Sign Method) applied to generate the adversarial example, all rendered in real-time. Our image classification architecture uses MobileNetV1 as backbone and gradient calculations for depthwise convolution with respect to the input image. You can now upload your own images and animate the CAM differential with different epsilon multipliers on-demand. Demo is live at http://www.advisjs.com.

The JavaScript webtool is built with a TensorFlow.js backend and a React frontend referencing open source components. It is the brainchild of Advanced Computer Vision taught by James Hays at Georgia Tech, and has been featured on YouTube. Note: If you use our work, please cite with the BibTeX provided below.

  • Developers: Jason Lin, Dilara Soylu
  • Research Poster: here

Screenshot

Usage

Download or clone this repository:

git clone https://github.com/jaxball/advisjs.git

cd into the cloned repo and install the required depedencies:

yarn

To run, type:

yarn start

Citation

Please cite this project in your publications if it helps your research. The following is a BibTeX reference.

@techreport{advis18acv,
  author = {Lin, Jason and Soylu, Dilara},
  title = {{AdVis: Visualizing and Attributing ML Attacks to Adversarial Examples}},
  institution = {Georgia Institute of Technology},
  year = {2018},
  note = {Accessed: [Insert date here]}
}

To Do

  • Input slider to choose from 1000 classes for targeted adversarial attack
  • Port Robust Adversrial Example from IPython notebook
  • Adversarial Training with FGSM
  • Visualize perturbations in real time? i.e. scale the negative values so we have 0 in the middle of the RGB values
  • Explore Saliency Detection implementation (JS) methods

License

MIT License. See LICENSE.md.

Contact

For questions or support open an issue.

About

[Tensorflow.js] AdVis: Exploring real-time Adversarial Attacks in the browser with Fast Gradient Sign Method.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • JavaScript 90.0%
  • CSS 7.2%
  • HTML 1.8%
  • TypeScript 1.0%