The code is based on Dassl, please follow the instructions in Dassl to install.
# Create a conda environment
conda create -y -n comc python=3.8
# Activate the environment
conda activate comc
# Install torch (requires version >= 1.8.1) and torchvision
# Please refer to https://pytorch.org/ if you need a different cuda version
conda install pytorch torchvision cudatoolkit=10.2 -c pytorch
# Clone this repo
git clone https://github.com/yic20/CoMC.git
cd CoMC
# Install Dassl
cd Dassl.pytorch-master/
# Install dependencies
pip install -r requirements.txt
# Install this library (no need to re-build if the source code is modified)
python setup.py develop
cd ..
Download the test images of MSCOCO-2014 from the official cite.
The text training data can be download from here.
cd scripts
bash main_eval.sh coco2014_distill rn50_coco2014 coco
cd scripts
bash main.sh coco2014_distill rn50_coco2014 experiment_1
We use the openAI API to generate text dataset. If you need to generate your own dataset, you need to fill in your openAI API key in generate_descriptions.py
python generate_descriptions.py
If you have any questions about the code, you can contact me through (yichengliu_e@163.com).