Skip to content

Commit

Permalink
prepro instruction
Browse files Browse the repository at this point in the history
  • Loading branch information
bezorro committed Apr 28, 2018
1 parent a1a3bc0 commit 1fff2e9
Show file tree
Hide file tree
Showing 3 changed files with 28 additions and 4 deletions.
31 changes: 28 additions & 3 deletions README.md
@@ -1,6 +1,6 @@
# Visual Question Reasoning on General Dependency Tree

This is the code for the paper
This is the code for the paper on CLEVR

**<a href="https://arxiv.org/abs/1804.00105">Visual Question Reasoning on General Dependency Tree</a>**
<br>
Expand Down Expand Up @@ -28,11 +28,36 @@ If you find this code useful in your research then please cite
}
```

# Requirement
* pytorch 0.3.0.post4
* python 3.5
* tensorboardX
* skimage
* scipy
* numpy
* torchvision
* h5py
* tqdm

# Data Preprocessing
Before you can train any models, you need to download the datasets; you also need to preprocess questions, and extract features for the images.

## Step 1: Download the data
You can follow the [instructions](https://github.com/jcjohnson/clevr-iep/blob/master/TRAINING.md) to download CLEVR dataset. Or you can skip this step by using our preprossed questions data(Step 2) and extracted image features(Step 3).

## Step 2: Preprocess Questions
Codes for preprocessing would be available soon. For now you can download our preprocessed data with the following commands:
```
sh ./data/download_preprocessed_questions.sh
```

## Step 3: Extract Image Features
Codes for image feature extraction and our extracted image features would be available soon. For now you can follow the [instructions](https://github.com/jcjohnson/clevr-iep/blob/master/TRAINING.md) to extract image features.
We assume the extracted features `features_train.h5`, `features_val.h5`, `features_test.h5` are placed in `./data/clevr/clevr_res101/`.

# TODO
```
1. data preprocess
2. image feature extract
1. data preprocess code
2. upload image feature
3. train and evaluation
```
Empty file.
1 change: 0 additions & 1 deletion requrements.txt
Expand Up @@ -3,7 +3,6 @@ tensorboardX
skimage
scipy
numpy
scipy
torchvision
h5py
tqdm

0 comments on commit 1fff2e9

Please sign in to comment.