Skip to content

Latest commit

 

History

History
43 lines (30 loc) · 1.2 KB

README.md

File metadata and controls

43 lines (30 loc) · 1.2 KB
Raw

CC_WEB_VIDEO Downloader

Python downloader for CC_WEB_VIDEO dataset.

Official Download Instruction

Single thread version

python download.py --save_path='./downloaded'
usage: download.py [-h] [--save_path SAVE_PATH]

optional arguments:
  -h, --help            show this help message and exit
  --save_path SAVE_PATH
                        Path to save the CC_WEB_VIDEO dataset to be downloaded

Multi thread version

python download_multi_thread.py --save_path='./downloaded' --num_thread=8
usage: download_multi_thread.py [-h] [--save_path SAVE_PATH] [--num_thread NUM_THREAD] [--no_keyframes] [--no_videos]

optional arguments:
  -h, --help            show this help message and exit
  --save_path SAVE_PATH
                        Path to save the CC_WEB_VIDEO dataset to be downloaded.
  --num_thread NUM_THREAD
                        Number of thread using for downloading.
  --no_keyframes        Whether download Keyframes.
  --no_videos           Whether download videos.

The dataset provider suggest to use single thread to avoid the overload of the server. So tradeoff the thread you need to use.