🏆 We won the Best Science Paper Award at BMVC 2019! 🏆

Axel Sauer*, Elie Aljalbout*, Sami Haddadin

Munich School of Robotics and Machine Intelligence, Technical University of Munich

If you use this implementation, please cite our BMVC 2019 paper.

@inproceedings{Sauer2019BMVC,
  author={Sauer, Axel and Aljalbout, Elie and Haddadin, Sami},
  title={Tracking Holistic Object Representations},
  booktitle={British Machine Vision Conference (BMVC)},
  year={2019}
}

# install anaconda if you don't have it yet
wget https://repo.continuum.io/archive/Anaconda3-5.3.0-Linux-x86_64.sh
bash Anaconda3-5.3.0-Linux-x86_64.sh
source ~/.profile
# or use source ~/.bashrc - depending on where anaconda was added to PATH as the result of the installation

Clone the repo, build the environment and build the benchmark toolkits

git clone https://github.com/xl-sr/THOR.git
cd THOR

# create the conda environment
conda env create -f environment.yml
conda activate THOR

# build the vot toolkits
bash benchmark/make_toolkits.sh

The .pth for SiamFC is already in the repo since it is small. The SiamRPN and SiamMask models need to be downloaded and moved to their respective subfolder.

SiamRPN

get model here → move to ./trackers/SiamRPN/model.pth

SiamMask

download the model and move to subfolder

wget http://www.robots.ox.ac.uk/~qwang/SiamMask_VOT.pth
mv SiamMask_VOT.pth trackers/SiamMask/model.pth

Run the download script to get the OTB2015 and VOT2018 datasets

cd data/
bash get_test_data.sh

To reproduce the benchmark results from the paper run for example:

# on VOT2018, with THOR (ensemble) enabled, using SiamRPN
python bench.py -d VOT2018 -t SiamRPN --lb_type ensemble

# on VOT2018, with THOR disabled, using SiamRPN
python bench.py -d VOT2018 -t SiamRPN --vanilla

To run THOR on your webcam / camera, run the following command

# with THOR (ensemble) enabled, using SiamRPN
python webcam_demo.py --tracker SiamRPN

# with THOR disabled, using SiamRPN
python webcam_demo.py --tracker SiamRPN --vanilla

The code (with some modifications) and models of the trackers are from the following linked repositories:

SiamFC, SiamRPN, SiamMask