UPDATE: A new challenging subset is added!

We released a newly collected extension subset of 15 categories with 150 videos (very challenging!!!) for one-shot evaluation of tracking algorithms. Check the description in this paper. More details including the data, complete evaluation toolkit and results of 48 trackers are available at this project.

LaSOT_Evaluation_Toolkit

This toolkit is utilized for evaluating trackers' performance on a large-scale benchmark LaSOT (http://vision.cs.stonybrook.edu/~lasot/).

Notification (Downloading dataset and tracking results)

There is a problem with the data sever. Please use the following links to download dataset:}

• Download the whole dataset through Google driver: https://bit.ly/LaSOTAll
• Download each category through Google driver: https://bit.ly/LaSOTEach
• Download the whole dataset through Baidu Pan: https://pan.baidu.com/s/1UbcQIU-Fpps7Jqq4WHRRkA
• Download each category through Baidu Pan: https://pan.baidu.com/s/1xFANiqkBHytE7stMOLUpLQ

In order to download the tracking results, please directly use the following link (including toolkit and complete results):

• Download the toolkit and complete tracking results: http://vision.cs.stonybrook.edu/~lasot/LaSOT_Evaluation_Toolkit.zip

Usage

• Download the repository, unzip it to your computer
• Download tracking result, unzip it to folder tracking_results/ (if this is not working, use the above link)
• Run run_tracker_performance_evaluation.m in Matlab

Notes

In the file run_tracker_performance_evaluation.m, you can

• change evaluation_dataset_type (line 25) for evaluation on all 1,400 sequences or 280 testing sequences
• change norm_dst (line 28) for precision or normalized precision plots

In the file utils/plot_draw_save.m

• change the plotting settings to get the appropriate plots

Citation

If you use LaSOT and this evaluation toolkit for you researches, please consider citing our paper:

• LaSOT: A High-quality Large-scale Single Object Tracking Benchmark
  H. Fan*, H. Bai*, L. Lin, F. Yang, P. Chu, G. Deng, S. Yu, Harshit, M. Huang, J Liu, Y. Xu, C. Liao, L Yuan, and H. Ling
  arXiv:2009.03465, 2020.
• LaSOT: A High-quality Benchmark for Large-scale Single Object Tracking
  H. Fan*, L. Lin*, F. Yang*, P. Chu*, G. Deng, S. Yu, H. Bai, Y. Xu, C. Liao, and H. Ling
  In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019.

Contact

If you have any questions on LaSOT, please feel free to contact Heng Fan at hefan@cs.stonybrook.edu.