HUAL

CVPR 2023 "Are Binary Annotations Sufficient? Video Moment Retrieval via Hierarchical Uncertainty-based Active Learning"

Prerequisites

• pip install

Preparation

The visual features of Charades-STA and ActivityNet Captions are available at Box Drive.

Download the word embeddings from here. Modify the path setting in ./configs/charades/SeqPAN.yaml.

Download the anet initiate pkl from Box Drive. , put it to ./results/anet/re0.pkl

Directory hierarchies are shown below:

HUAL
    |____ ckpt/
    |____ logs/
    |____ data_pkl/
    |____ data/
        |____ anet_gt/
        |____ anet_re0/
        |____ anet_re1/
        ...
        |____ anet_re10/
    |___ results/
        |____ anet/re0.pkl
        |____ charades/re0.pkl
    ...

Quick Start

Train

python run_charades.py
python run_anet.py

# it include three step:
# 1. Update pseudo label.
# 2. Train model.
# 3. Infer prediction of train dataset.

Citation

If you feel this project is helpful to your research, please cite our work.

@InProceedings{Ji_2023_CVPR,
    author    = {Ji, Wei and Liang, Renjie and Zheng, Zhedong and Zhang, Wenqiao and Zhang, Shengyu and Li, Juncheng and Li, Mengze and Chua, Tat-seng},
    title     = {Are Binary Annotations Sufficient? Video Moment Retrieval via Hierarchical Uncertainty-Based Active Learning},
    booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
    month     = {June},
    year      = {2023},
    pages     = {23013-23022}
}