RealScaler - image/video AI upscaler app (Real-ESRGAN)

What is RealScaler?

RealScaler is a Windows app powered by RealESRGAN AI to enhance, upscale and de-noise photos and videos.

Other AI projects.🤓

• https://github.com/Djdefrag/QualityScaler / QualityScaler - image/video AI upscaler app
• https://github.com/Djdefrag/FluidFrames.RIFE / FluidFrames.RIFE - video AI interpolation app (RIFE-HDv3)

Credits.

Real-ESRGAN - https://github.com/xinntao/Real-ESRGAN

How is made. 🛠

RealScaler is completely written in Python, from backend to frontend. External packages are:

• AI -> torch / onnxruntime-directml
• GUI -> customtkinter
• Image/video -> OpenCV / moviepy
• Packaging -> nuitka

Requirements. 🤓

• Windows 11 / Windows 10
• RAM >= 8Gb
• Any Directx12 compatible GPU with >= 4GB VRAM

Features.

• Easy to use GUI
• Images and Videos upscale
• Multiple AI models
• Automatic image tiling and merging to avoid gpu VRAM limitation
• Resize image/video before AI upscaling
• Interpolation between the original and upscaled image/video
• Multiple Gpu support
• Compatible images - png, jpeg, bmp, webp, tif
• Compatible video - mp4, wemb, gif, mkv, flv, avi, mov, qt

Next steps. 🤫

• 1.X versions
  • Switch to Pytorch-directml to support all Directx12 compatible gpu (AMD, Intel, Nvidia)
  • New GUI with Windows 11 style
  • Include audio for upscaled video
  • Optimizing video frame resize and extraction speed
  • Multi GPU support (for pc with double GPU, integrated + dedicated)
  • Python 3.10 (expecting ~10% more performance)
• 2.X versions
  • New, completely redesigned graphical interface based on @customtkinter
  • Upscaling images and videos at once (currently it is possible to upscale images or single video)
  • Upscale multiple videos at once
  • Choose upscaled video extension
  • Interpolation between the original and upscaled image/video
  • More Interpolation levels (Low, Medium, High)
  • Show the remaining time to complete video upscaling
  • Support for SRVGGNetCompact AI architecture
  • Metadata extraction and application from original file to upscaled file (via exiftool)
• 3.X versions
  • New AI engine powered by onnxruntime-directml (https://pypi.org/project/onnxruntime-directml/)
  • Python 3.11 (~10% performance improvements)
  • Display images/videos upscaled resolution in the GUI
  • FFMPEG 6.1.1 (latest release)
  • Python 3.12
  • Video upscaling pause and restart

Some Examples.

Videos

• Original

• RealESRGANx4 - upscaled in 3 minutes and 23 seconds

RealESRGAN_plus_x4.mp4

• RealESR_Gx4 - upscaled in 57 seconds

RealESR_generalv3_x4.mp4

Images!