LR | HR |
---|---|
Image Super Resolution is a machine learning task where the goal is to increase the resolution of an image, often by a factor of 4x or more, while maintaining its content and details as much as possible. The end result is a high resolution version of the original image. This task can be used for various applications such as improving image quality, enhancing visual detail, and increasing the accuracy of computer vision algorithms.
Video games require a lot of computing resources such as GPU, CPU, RAM, etc. To reduce the computing cost, some companies such as NVIDIA, AMD create their own solutions based on super resolution technologies. This is because it may be faster to render at a lower resolution and then upscale the image than to just render at high resolution.
We've collected a dataset mostly using the Unreal Engine game engine. There aren't a lot of datasets for super resolution in games, so we hope that the collected dataset will give independent developers more room to get started in this area.
Each part described below, and others such as the setup process, has a short overview on the README page, for more information see the wiki page.
Dataset was collected using Unreal Engine and consists of 2 independent datasets, each dataset has all images in 4 different resolutions - 270p, 360p, 540p, 1080p:
- GameEngineData: 14431 train and 3600 test images.
- DownscaleData: 29726 train and 7421 test images.
Name | Link | Type | Config | PSNR* | SSIM* | LPIPS* |
---|---|---|---|---|---|---|
Real-ESRGAN | xinntao/Real-ESRGAN | GAN | RealESRGAN_x4plus | 23.5409 | 0.7992 | 0.3924 |
EMT | Fried-Rice-Lab/EMT | Transformer | EMT_x4 | 24.5443 | 0.8231 | 0.3889 |
ResShift | zsyOAOA/ResShift | Diffusion | ResShift_RealSRx4 | 23.0368 | 0.7992 | 0.4829 |
* - metric was calculated using pretrained versions** of the models on the GameEngineData dataset with x4 scaling from 270p to 1080p.
** - the config field specifies the exact version of the model which was used to calculate metric.
A competition based on the SRGD dataset has been launched on the Kaggle platform and will run until August 26, 2024. The SRGD dataset will be publicly available on Huggingface after the competition ends.
@misc{srgd,
author = {Evgenii Pishchik},
title = {Super Resolution Gaming Dataset},
year = {2023},
url = {https://github.com/Pe4enIks/SRGD}
}