datasets-utilies

Collection of utility scripts to do with data (download, setup, etc.)

Video

UVG dataset

https://uvgarment.org/download/

• UVG is a standard evaluation dataset for e.g. learnt video compression.
• uvg/uvg_setup.py downloads, extracts and covnerts the yuv files to png (treat videos as images).
  • you need to have ffmpeg installed for the yuv-to-png conversion (e.g. brew install ffmpeg or sudo apt install ffmpeg).
  • compressed (7z) and the unzipped yuv files are deleted.
  • total size of the unzipped image data ~16GB.

Vimeo-90k Septuplet dataset

http://toflow.csail.mit.edu/index.html#septuplet

• Vimeo-90k is a standard training dataset for e.g. neural image compression and neural video compression, video super-resolution, frame interpolation etc.
• viemo-90k/vimeo_setup.py downloads and extracts the dataset, which comes in the form of png images.
  • Size of zip file is ~82GB which gets deleted after it's unzipped.
  • Total size of the unzipped data ~169GB.

Audio

Coming.