Editing - Enhancers - Mixing - Restoring - Denoisers - Deblurrers - Artifacts reduction - Colorization - Compression - Stabilizers - Other resources
Editing ⌂
| Resource | Short description | Language | License | Last commit |
|---|---|---|---|---|
| AIVideoEditor | An all-in-one collaborative AI audio and video editing application that is as simple to use as editing a Google Doc based on text extracted from transcription |  |
 |
|
| ai_video_editor | A yolov7 based, human aware video editor for real time video manipulation |  |
 |
|
| Framester | An AI driven Video manipulation toolkit |  |
 |
|
| VideoEditor | AI assisted video editor based on motion difference between the frames of given videos |  |
 |
|
| Automatic Video Editor for Reportages Assisted by Unsupervised Machine Learning | Code for Automatic Video Editor for Reportages Assisted by Unsupervised Machine Learning paper |  |
 |
|
| folioviz.ai | Video Editor driven by Ai |  |
 |
|
| ClipIQ | AI-powered video editor |  |
 |
|
| speech-separation | Use Deep Learning to automatically edit multicam videos |  |
 |
|
| Video Mashup | Uses Video Intelligence to analyse and edit a video based on a given sentence. |  |
 |
|
| soundblast-fe | Frontend for AI powered video editor backend |  |
 |
|
| TopView.ai | Just provide your raw materials and ideas; AI does the rest, from scriptwriting to selecting shots, editing, narrating, and beautifying your video |  |
 |
|
| Turn-Movie-Clips-to-Narration-Videos | Automatically extracts dialogue, identifies characters, generates commentary based on the plot, separates background noise, and aligns audio/video |  |
 |
Enhancers ⌂
| Resource | Short description | Language | License | Last commit |
|---|---|---|---|---|
| vs-mlrt | Efficient CPU/GPU/Vulkan ML Runtimes for VapourSynth (with built-in support for waifu2x, DPIR, RealESRGANv2/v3, Real-CUGAN, RIFE, SCUNet and more!) |  |
 |
|
| InterUpTool | GUI Tool for control, queue and automate video enhancing process, provided by FFMPEG video encoder, Real-ESRGAN image upscaler and RIFE/DAIN video frame interpolators |  |
 |
|
| enhancr | An elegant and easy to use GUI for Video Frame Interpolation and Video Upscaling which takes advantage of artificial intelligence |  |
 |
|
| flowframes | Windows GUI for video interpolation using DAIN (NCNN) or RIFE (CUDA/NCNN) |  |
 |
|
| PRINCIPI | Fully customizable video frame rate up-conversion and video resolution upscaling with sharpening and denoising editor with GUI |  |
 |
|
| QualityScaler | A Windows app powered by AI to enhance, upscale and de-noise photographs and videos |  |
 |
|
| RealScaler | A Windows app powered by RealESRGAN AI to enhance, upscale and de-noise photos and videos |  |
 |
|
| VSGAN-tensorrt-docker | Fastest (TensorRT) inference code to use super resolution and video frame interpolation models |  |
 |
Mixing ⌂
| Resource | Short description | Language | License | Last commit |
|---|---|---|---|---|
| Automatic Mixing of Audio and Video | Proposing a comprehensive method for assisting video editing tasks using neural networks |  |
 |
Restoring ⌂
| Resource | Short description | Language | License | Last commit |
|---|---|---|---|---|
| Samsung_Deflicker | A machine learning solution to remove flickering in high-speed videos |  |
 |
|
| TOFlow | Video Enhancement with Task-Oriented Flow IJCV publication implementation |  |
 |
|
| DeepRemaster | PyTorch implementation for the "DeepRemaster: Temporal Source-Reference Attention Networks for Comprehensive Video Enhancement" paper |  |
 |
|
| EMA-VFI-WebUI | Advanced AI-Based Video Renovation UI Using EMA-VFI & Real-ESRGAN |  |
 |
|
| BasicSR | Open Source Image and Video Restoration Toolbox for Super-resolution, Denoise, Deblurring, etc |  |
 |
|
| All-In-One-Deflicker | Code for Blind Video Deflickering by Neural Filtering with a Flawed Atlas paper |  |
 |
Denoisers ⌂
| Resource | Short description | Language | License | Last commit |
|---|---|---|---|---|
| Model-Blind Video Denoising Via Frame-to-frame Training | Model-blind Video Denoising Via Frame-to-frame Training implementation |  |
 |
|
| Non-local Bayesian Video Denoising | A C/C++ implementation of the Video Denoising via Empirical Bayesian Estimation of Space-Time Patches paper |  |
 |
|
| RNLF | Image noise estimation and RNL image and video denoising |  |
 |
|
| VIDOSAT video denoising | A video denoising framework based on online 3D spatio-temporal sparsifying transform learning |  |
 |
|
| SALT based Video Denoising | A video denoising method, based on a novel Sparse And Low-rank Tensor (SALT) model |  |
 |
|
| vnlnet | A Video denoising CNN with Non-locality information |  |
 |
|
| FastDVDnet | A state-of-the-art, simple and fast network for Deep Video Denoising which uses no motion compensation |  |
 |
|
| MaskDnGAN | This is the official implementation of "Multi-Stage Raw Video Denoising with Adversarial Loss and Gradient Mask" paper |  |
 |
|
| ViDeNN | Deep Blind Video Denoising implementation |  |
 |
|
| Deformable-Kernels-For-Video-Denoising | An implement of paper Learning Deformable Kernels for Image and Video Denoising in PyTorch |  |
 |
|
| PaCNet | This is the official implementation of "Patch Craft: Video Denoising by Deep Modeling and Patch Matching" paper |  |
 |
|
| STPAN | This is the official implementation of "Learning Spatial and Spatio-Temporal Pixel Aggregations for Image and Video Denoising" paper |  |
 |
|
| RViDeNet | This is the official implementation of "Supervised Raw Video Denoising with a Benchmark Dataset on Dynamic Scenes paper |  |
 |
Deblurrers ⌂
| Resource | Short description | Language | License | Last commit |
|---|---|---|---|---|
| Deep Video Deblurring for Hand-held Cameras | This is the demo code for "Deep Video Deblurring for Hand-held Cameras" paper |  |
 |
|
| PVDNet | Official PyTorch Implementation for "Recurrent Video Deblurring with Blur-Invariant Motion Estimation and Pixel Volumes"paper |  |
 |
|
| CDVD-TSP | Official implementation of "Cascaded Deep Video Deblurring Using Temporal Sharpness Prior" paper |  |
 |
|
| ESTRNN & BSD | This work presents an efficient RNN-based model and the first real-world dataset for image/video deblurring |  |
 |
|
| STFAN | Code repo for the "Spatio-Temporal Filter Adaptive Network for Video Deblurring" paper |  |
 |
Artifacts reduction ⌂
| Resource | Short description | Language | License | Last commit |
|---|---|---|---|---|
| MFQE 2.0 | Official repository of "MFQE 2.0: A New Approach for Multi-frame Quality Enhancement on Compressed Video" paper |  |
 |
|
| STDF | PyTorch implementation of Spatio-Temporal Deformable Convolution for Compressed Video Quality Enhancement paper |  |
 |
|
| NL-ConvLSTM | Non-Local ConvLSTM for Video Compression Artifact Reduction implementation |  |
 |
|
| QG-ConvLSTM | Project page of "Quality-Gated Convolutional LSTM for Enhancing Compressed Video" paper |  |
 |
Colorization ⌂
| Resource | Short description | Language | License | Last commit |
|---|---|---|---|---|
| Deep Exemplar-based Video Colorization | PyTorch implementation for the Deep Exemplar-based Video Colorization paper |  |
 |
|
| DeOldify | A Deep Learning based project for colorizing and restoring old images (and video!) |  |
 |
|
| Fully Automatic Video Colorization | Tensorflow implementation for the "Fully Automatic Video Colorization with Self-Regularization and Diversity" paper |  |
 |
|
| SVCNet | PyTorch implementation of the "SVCNet: Scribble-based Video Colorization Network with Temporal Aggregation" paper |  |
 |
|
| DDColor | Official PyTorch implementation of the "DDColor: Towards Photo-Realistic Image Colorization via Dual Decoders" paper |  |
 |
Compression ⌂
| Resource | Short description | Language | License | Last commit |
|---|---|---|---|---|
| Deep-Video-Compression | Video compression using deep neural networks |  |
 |
|
| Deep_Learning_Video_compression | Used deep learning for video compression |  |
 |
|
| Neural Video Compression | An implementation of the "Learning Binary Residual Representations for Domain-specific Video Streaming" paper |  |
 |
|
| neural-video-compress | Video compression using neural networks |  |
 |
|
| Video compression | Experimental project for neural image and video compression |  |
 |
|
| Video-Compression-Net | A new approach to video compression by refining the shortcomings of conventional approach and substituting each traditional component with their neural network counterpart |  |
 |
|
| Spacevid | A neural net based tool for transcoding large videos to fit a specified file size with minimal adjustment to the bitrate |  |
 |
|
| deepzipper | An Intelligent video compression framework utilizing neural networks |  |
 |
|
| HiNeRV | Code for "HiNeRV: Video Compression with Hierarchical Encoding-based Neural Representation" paper |  |
 |
|
| Hier-Video-Compression | Codebase for Hierarchical Autoregressive Modeling for Neural Video Compression |  |
 |
|
| Ureca-Deep-neural-network-based-video-compression | Investigate methodologies that combine neural networks and video compression |  |
 |
|
| video-compression-dnn | Video compression using deep convolutional neural networks and autoencoders |  |
 |
Stabilizers ⌂
| Resource | Short description | Language | License | Last commit |
|---|---|---|---|---|
| Deep3D Stabilizer | 3D Video Stabilization with Depth Estimation by CNN-based Optimization |  |
 |
|
| DIFRINT | Test code reference implementation of "Deep Iterative Frame Interpolation for Full-frame Video Stabilization", using PyTorch |  |
 |
|
| DUT | Pytorch implementation of "DUT: Learning Video Stabilization by Simply Watching Unstable Videos" |  |
 |
|
| FuSta | Hybrid Neural Fusion for Full-frame Video Stabilization |  |
 |
|
| Real-Time Selfie Video Stabilization | Official implementation of paper "Real-Time Selfie Video Stabilization" |  |
 |
|
| Trajectory Optimization based Video Stabilization | A custom MeshFlow implementation |  |
 |
Other resources ⌂
- Video Frame Interpolation Rankings and Video Deblurring Rankings
- Awesome Video Diffusion
- Awesome-Image-Colorization/Video Colorization
- Video restoration based on deep learning: a comprehensive survey
- Deep-Image-Compression-Video-Coding
- Learning-based-Image-Video-Compression
- Awesome Deep Learning Based Video Compression
- Awesome-Deep-Compression