Repository for code, models and datasets for the paper Game of Sketches: Deep Recurrent Models of Pictionary-style Word Guessing accepted at 36th AAAI Conference on Artificial Intelligence (AAAI-18), New Orleans, USA
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
data
models
src
HumanMime-AAAI-1.png
PAMI_SketchGuess_TwoPhase.pdf
README.md
pictionary-robot-camready-1.png

README.md

alt text

sketchguess

Repository for code, models and dataset for the paper Game of Sketches: Deep Recurrent Models of Pictionary-style Word Guessing accepted at 36th AAAI Conference on Artificial Intelligence (AAAI-18), New Orleans, USA.

License

This code is released under the MIT License (Please refer to the LICENSE file for details).

Citation

Please cite our paper in your publications if it helps your research:

@article{,
Author = {Sarvadevabhatla,Ravi Kiran and Surya, Shiv and Mittal, Trisha and
Babu R, Venkatesh},
    Title = {Game of Sketches: Deep Recurrent Models of Pictionary-style Word Guessing},
    Journal = {ArXiv e-prints},
    eprint = {},
    Keywords = {Computer Science - Computer Vision and Pattern Recognition},
    Year = {2018},
    Month = {February},
   }

Dependencies and Installation

  1. Code for Sketchguess is based on Lasagne\Theano. This code was tested on UBUNTU 14.04 on the folowing NVIDIA GPUs: NVIDIA TITAN X.

  2. Download CNN features that are input to the LSTM, Word2Vec dicitonary and dataset,

    Instructions are available here.

  3. To test on the Sketchguess recurrent on trained model:

    $ git clone https://github.com/val-iisc/sketchguess.git 
    $ bash models/download_models.sh
    $ bash src/run_model.sh
  4. The predictions of the Sketchguess recurrent model can be viewed in the log file : out/machine_generated_guesses.log .

  5. The embedding representations regressed by the lstm model are stored in : out/pred_release.npz . This file is used to generate the machine guesses via a KNN-search of "data/all_w2v.mat".

Q&A

  1. If automatic download of pre-trained models fail, you can find instructions for manual download here.

  2. Please send message to ravika@gmail.com or shiv.surya314@gmail.com if you have any query regarding the code.