The implementation of AAAI-17 paper "Collective Deep Quantization of Efficient Cross-modal Retrieval"
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
data/nuswide
dataset
models
.gitattributes
.gitignore
README.md
__init__.py
cdq.py
run_cdq.sh
train_script.py
validation_script.py

README.md

aaai17-cdq

This is the Tensorflow (Version 0.11) implementation of AAAI-17 paper "Collective Deep Quantization for Efficient Cross-modal Retrieval". The descriptions of files in this directory are listed below:

  • cdq.py: contains the main implementation of the proposed approach cdq.
  • train_script.py: gives an example to show how to train cdq model.
  • validation_script.py: gives an example to show how to evaluate the trained quantization model.
  • run_cdq.sh: gives an example to show the full procedure of training and evaluating the proposed approach cdq.

Data Preparation

In data/nuswide/train.txt and data/nuswide/text_train.txt, we give an example to show how to prepare image/text training data. In data/nuswide/test.txt, data/nuswide/text_test.txt, data/nuswide/database.txt and data/nuswide/text_database.txt, the list of testing and database images/texts could be processed during predicting procedure.

Training Model and Predicting

The AlexNet is used as the pre-trained model. If the NUS_WIDE dataset and pre-trained caffemodel is prepared, the example can be run with the following command:

"./run_cdq.sh"

Citation

@inproceedings{DBLP:conf/aaai/CaoL0L17,
  author    = {Yue Cao and
               Mingsheng Long and
               Jianmin Wang and
               Shichen Liu},
  title     = {Collective Deep Quantization for Efficient Cross-Modal Retrieval},
  booktitle = {Proceedings of the Thirty-First {AAAI} Conference on Artificial Intelligence,
               February 4-9, 2017, San Francisco, California, {USA.}},
  pages     = {3974--3980},
  year      = {2017},
  crossref  = {DBLP:conf/aaai/2017},
  url       = {http://aaai.org/ocs/index.php/AAAI/AAAI17/paper/view/14499},
  timestamp = {Mon, 06 Mar 2017 11:36:24 +0100},
  biburl    = {http://dblp2.uni-trier.de/rec/bib/conf/aaai/CaoL0L17},
  bibsource = {dblp computer science bibliography, http://dblp.org}
}