Image-Extrapolation

What I cannot create, I do not understand.

This repository is a paper list of image extrapolation and inpainting inspired by @1900zyh's repository Awsome-Image-Inpainting and @geekyutao's repository Image Inpainting. As a conditional generation task, I learn from @xiaweihao's repository awesome-image-translation.

Benchmarks for Image Extrapolation

Dataset	Metrics	Method	Title
CelebA-HQ (75%)	PSNR=16.05 SSIM=0.6815 FID=21.17	SpiralNet	Spiral Generative Network for Image Extrapolation
Stanford cars (75%)	PSNR=14.31 SSIM=0.5775 FID=23.64	SpiralNet	Spiral Generative Network for Image Extrapolation
CUB (75%)	PSNR=16.22 SSIM=0.5313 FID=56.50	SpiralNet	Spiral Generative Network for Image Extrapolation
Flowers (75%)	PSNR=15.67 SSIM=0.5078 FID=52.14	SpiralNet	Spiral Generative Network for Image Extrapolation
Cityscapes (50%)	PSNR=20.43 SSIM=0.7125 FID=22.34	SpiralNet	Spiral Generative Network for Image Extrapolation
Paris StreetView (50%)	PSNR=17.43 SSIM=0.5970 FID=35.58	SpiralNet	Spiral Generative Network for Image Extrapolation
Places365-Sky (50%)	PSNR=21.75 SSIM=0.7834 FID=51.55	SpiralNet	Spiral Generative Network for Image Extrapolation
Places365-Desert Road (50%)	PSNR=20.22 SSIM=0.7026 FID=80.66	SpiralNet	Spiral Generative Network for Image Extrapolation
Places365 (25%)	PSNR=10.17 FID=0.79	Boundless	Boundless: Generative Adversarial Networks for Image Extension
Places365 (50%)	PSNR=8.63 FID=3.46	Boundless	Boundless: Generative Adversarial Networks for Image Extension
Places365 (75%)	PSNR=8.07 FID=8.79	Boundless	Boundless: Generative Adversarial Networks for Image Extension
SUN	IS=2.852 FID=13.713	NS-Outpainting	Very Long Natural Scenery Image Prediction by Outpainting
DeepFashion	PSNR=12.58 SSIM=0.5686	SRN	Wide-Context Semantic Image Extrapolation

Benchmarks for Image Inpainting

Dataset	Metrics	Method	Title
CelebA (25%)	PSNR=26.32 SSIM=0.910 FID=25.51	MEDFE	Rethinking Image Inpainting via a Mutual Encoder-Decoder with Feature Equalizations
CelebA (10-20%)	PSNR=34.69 SSIM=0.989 l1err.=0.72% l2err. =0.04%	CSA	Coherent Semantic Attention for Image Inpainting
CelebA (20-30%)	PSNR=32.58 SSIM=0.982 l1err.=0.94% l2err. =0.07%	CSA	Coherent Semantic Attention for Image Inpainting
CelebA (30-40%)	PSNR=25.32 SSIM=0.926 l1err.=2.18% l2err. =0.37%	CSA	Coherent Semantic Attention for Image Inpainting
CelebA (40-50%)	PSNR=24.14 SSIM=0.883 l1err.=2.85% l2err. =0.44%	CSA	Coherent Semantic Attention for Image Inpainting
CelebA-HQ	PSNR=29.4912 SSIM=0.9606 L2=0.14 LPIPS=0.0682	SC-FEGAN	SC-FEGAN: Face Editing Generative Adversarial Network with User’s Sketch and ColorRethinking Image Inpainting via a Mutual Encoder-Decoder with Feature Equalizations
Paris StreetView (10%-20%)	PSNR=28.73 SSIM=0.889	LBAM	Image Inpainting with Learnable Bidirectional Attention Maps
Paris StreetView (20%-30%)	PSNR=26.16 SSIM=0.795	LBAM	Image Inpainting with Learnable Bidirectional Attention Maps
Paris StreetView (30%-40%)	PSNR=24.26 SSIM=0.716	LBAM	Image Inpainting with Learnable Bidirectional Attention Maps
Paris StreetView (40%-50%)	PSNR=22.62 SSIM=0.621	LBAM	Image Inpainting with Learnable Bidirectional Attention Maps
Place2 (10%-20%)	PSNR=31.13 SSIM=0.957 FID=6.91	MEDFE	Rethinking Image Inpainting via a Mutual Encoder-Decoder with Feature Equalizations
Place2 (20%-30%)	PSNR=28.87 SSIM=0.923 FID=8.06	MEDFE	Rethinking Image Inpainting via a Mutual Encoder-Decoder with Feature Equalizations
Place2 (30%-40%)	PSNR=25.34 SSIM=0.854 FID=19.36	MEDFE	Rethinking Image Inpainting via a Mutual Encoder-Decoder with Feature Equalizations
Place2 (40%-50%)	PSNR=22.81 SSIM=0.719 FID=28.79	MEDFE	Rethinking Image Inpainting via a Mutual Encoder-Decoder with Feature Equalizations
Place2 (0-20%)	PSNR=32.029 SSIM=0.9738 FID=2.9420	StructureFlow	StructureFlow: Image Inpainting via Structure-aware Appearance Flow
Place2 (20%-40%)	PSNR=25.218 SSIM=0.9026 FID=7.0354	StructureFlow	StructureFlow: Image Inpainting via Structure-aware Appearance Flow
Place2 (40%-60%)	PSNR=21.090 SSIM=0.7561 FID=22.3803	StructureFlow	StructureFlow: Image Inpainting via Structure-aware Appearance Flow
Place2 (rectangular)	l1 err.=8.6% l2 err.=2.0%	SN-PatchGAN	StructureFlow: Image Inpainting via Structure-aware Appearance Flow
Place2 (free-form)	l1 err.=9.1% l2 err.=1.6%	SN-PatchGAN	Free-Form Image Inpainting with Gated Convolution

Deep-Learning-based Extrapolation Methods

Year	Proceeding	Title	Comment
2021	WACV 2021	Painting Outside as Inside: Edge Guided Image Outpainting via Bidirectional Rearrangement with Progressive Step Learning [paper] [code]
2021	WACV 2021	DeepCFL: Deep Contextual Features Learning from a Single Image [paper]	InGAN
2020	ECCV 2020	Spiral Generative Network for Image Extrapolation [paper] [Springer] [code]
2020	CVPR 2020	Semantic Pyramid for Image Generation [paper] [code]	Re-painting
2020	WACV 2020	Multimodal Image Outpainting with Regularized Normalized Diversification [paper] [code]	GAN-based
2020	WACV 2020	360 Panorama Synthesis from a Sparse Set of Images with Unknown Field of View [paper] [code]	GAN-based
2020	ITNEC 2020	Image extrapolation based on multi-column convolutional attention network [paper]
2020	SPL 2020	SiENet: Siamese Expansion Network for Image Extrapolation [paper] [code]	SCI-3
2020	ICIP 2020	Image Completion and Extrapolation with Contextual Cycle Consistency [paper]
2019	ICCV 2019	Boundless: Generative Adversarial Networks for Image Extension [pdf] [code]
2019	ICCV 2019	Very Long Natural Scenery Image Prediction by Outpainting [pdf] [code]	LSTM
2019	ICCV 2019	COCO-GAN: Generation by Parts via Conditional Coordinating [pdf] [official code] [unofficial code]
2019	SIGGRAPH 2019	Structure-Aware Image Expansion with Global Attention [paper]
2019	CVPR 2019	Wide-Context Semantic Image Extrapolation [paper] [code]
2019	TIP 2019	Deep Portrait Image Completion and Extrapolation [paper]
2018	ECCV 2018	Unsupervised Holistic Image Generation from Key Local Patches [paper] [code]	GAN-based
2018	arXiv:1808.08483	Painting Outside the Box: Image Outpainting with GANs [paper] [code] [code]	GAN-based

Traditional Extrapolation Methods

Year	Proceeding	Title	Comment
2003	ACM TOG 2003	Poisson Image Editing [paper]
2007	ACM TOG 2007	Seam Carving for Content-Aware Image Resizing [paper]
2008	CVPRW 2008	Creating and Exploring a Large Photorealistic Virtual Space [paper] [paper]
2009	ACM TOG 2009	PatchMatch: A Randomized Correspondence Algorithm for Structural Image Editing [paper]
2012	SIGGRAPH 2012	Quality Prediction for Image Completion [paper]
2013	CVPR 2013	FrameBreak: Dramatic Image Extrapolation by Guided Shift-Maps [paper] [code]
2014	ECCV 2014	Photo uncrop [paper] [code]
2014	ACM TOG 2014	BiggerPicture: data-driven image extrapolation using graph matching [paper]

Inpainting Deep-Learning-based Methods

Year	Proceeding	Title	Comment
2012	NIPS 2012	Image denoising and inpainting with deep neural networks [pdf]
2014	GCPR 2014	Mask-specific inpainting with deep neural networks [pdf]
2014	NIPS 2014	Deep Convolutional Neural Network for Image Deconvolution [pdf]
2015	NIPS 2015	Shepard Convolutional Neural Networks [pdf] [code]
2015	PR 2015	Application of GRNN neural network in non-texture image inpainting and restoration [paper]	CNN-based
2015	AICCSA 2015	Moving objects detection based on thresholding operations for video surveillance systems [paper]	GAN-based
2016	CVPR 2016	Context Encoders: Feature Learning by Inpainting [pdf] [code] [blog1] [blog2]	CNN-based
2016	SIGGRAPH 2016	High-resolution multi-scale neural texture synthesis [pdf]
2016	ELCVIA 2016	A block-based background model for moving object detection [paper]	GAN-based
2016	JEI 2016	Moving object detection using a background modeling based on entropy theory and quad-tree decomposit [paper]	GAN-based
2017	CVPR 2017	Semantic image inpainting with deep generative models [pdf] [code] [blog]
2017	CVPR 2017	High-resolution image inpainting using multi-scale neural patch synthesis [pdf] [code] [blog]
2017	CVPR 2017	Generative Face Completion [pdf] [code] [blog]
2017	CVPR 2017	Joint gap detection and inpainting of line drawings [paper]	CNN-based
2017	SIGGRAPH 2017	Globally and Locally Consistent Image Completion [pdf] [code] [blog]
2017	VC 2017	Blind inpainting using the fully convolutional neural network [paper]	CNN-based
2017	ICVISP 2017	High-resolution image inpainting through multiple deep networks [paper]	CNN-based
2017	ICDAR 2017	Scene Text Eraser [paper]	CNN-based
2017	ICCC 2017	A Deep Network Architecture for Image Inpainting [paper]	CNN-based
2018	CVPR 2018	Generative Image Inpainting with Contextual Attention [pdf] [code]
2018	CVPR 2018	Natural and Effective Obfuscation by Head Inpainting [pdf]
2018	CVPR 2018	Eye In-Painting With Exemplar Generative Adversarial Networks [pdf] [code]
2018	CVPR 2018	UV-GAN: Adversarial Facial UV Map Completion for Pose-invariant Face Recognition [pdf]
2018	CVPR 2018	Disentangling Structure and Aesthetics for Style-aware Image Completion [pdf]
2018	ECCV 2018	Image Inpainting for Irregular Holes Using Partial Convolutions [pdf] [code] [blog]
2018	ECCV 2018	Contextual-based Image Inpainting: Infer, Match, and Translate [pdf]
2018	ECCV 2018	Shift-Net: Image Inpainting via Deep Feature Rearrangement [pdf] [code]	CNN-based
2018	NIPS 2018	Image Inpainting via Generative Multi-column Convolutional Neural Networks [pdf] [code]
2018	TOG 2018	Faceshop: Deep sketch-based face image editing [pdf]
2018	ACM MM 2018	Structural inpainting [pdf]
2018	ACM MM 2018	Semantic Image Inpainting with Progressive Generative Networks [pdf] [code]
2018	BMVC 2018	SPG-Net: Segmentation Prediction and Guidance Network for Image Inpainting [pdf] [code]	Segmentation
2018	BMVC 2018	MC-GAN: Multi-conditional Generative Adversarial Network for Image Synthesi [pdf] [code]
2018	ACCV 2018	Face Completion with Semantic Knowledge and Collaborative Adversarial Learning [pdf]
2018	ICASSP 2018	Edge-Aware Context Encoder for Image Inpainting [pdf]
2018	ICPR 2018	Deep Structured Energy-Based Image Inpainting [pdf] [code]
2018	AISTATS 2019	Probabilistic Semantic Inpainting with Pixel Constrained CNNs [pdf]
2018	ICRA 2018	Just-in-time reconstruction: Inpainting sparse maps using single view depth predictors as priors [paper]	CNN-based
2018	SPIC 2018	A deep learning approach to patch-based image inpainting forensics [paper]	CNN-based
2018	MS 2018	Semantic object removal with convolutional neural network feature-based inpainting approach [paper]	CNN-based
2018	NCA 2018	Occluded offline handwritten Chinese character recognition using deep convolutional generative adversarial network and improved GoogLeNet [paper]	GAN-based
2018	TIP 2018	Perceptual Adversarial Networks for Image-to-Image Transformation [paper]	GAN-based
2018	GRSL 2018	Inpainting of Remote Sensing SST Images With Deep Convolutional Generative Adversarial Network [paper]	GAN-based
2018	PRRS 2018	Preliminary Investigation on Single Remote Sensing Image Inpainting Through a Modified GAN [paper]	GAN-based
2018	ICCES 2018	Semantic Image Inpainting Vsing Self-Learning Encoder-Decoder and Adversarial Loss [paper]	GAN-based
2018	ICNC-FSKD 2018	Image Inpainting Based on Generative Adversarial Networks [paper]	GAN-based
2019	ICRA 2019	Empty Cities: Image Inpainting for a Dynamic-Object-Invariant Space [pdf]
2019	AAAI 2019	Video Inpainting by Jointly Learning Temporal Structure and Spatial Details [pdf]	Video
2019	CVPR 2019	Pluralistic Image Completion [pdf] [code] [project]	Diversity
2019	CVPR 2019	PEPSI: Fast Image Inpainting with Parallel Decoding Network [pdf] [code]
2019	CVPR 2019	Deep Reinforcement Learning of Volume-guided Progressive View Inpainting for 3D Point Scene Completion from a Single Depth Image [pdf]
2019	CVPR 2019	Foreground-aware Image Inpainting [pdf]
2019	CVPR 2019	Privacy Protection in Street-View Panoramas using Depth and Multi-View Imagery [pdf]
2019	CVPR 2019	Learning Pyramid-Context Encoder Network for High-Quality Image Inpainting [pdf] [code]	ATN
2019	CVPR 2019	Blind Visual Motif Removal from a Single Image [paper]	CNN-based
2019	CVPR 2019	Deep Flow-Guided Video Inpainting [pdf] [project]	Video
2019	CVPR 2019	Deep video inpainting [pdf]	Video
2019	CVPR Workshop 2019	VORNet: Spatio-temporally Consistent Video Inpainting for Object Removal [pdf]	Video
2019	TNNLS 2019	PEPSI++: Fast and Lightweight Network for Image Inpainting [pdf]	GAN-based
2019	IJCAI 2019	MUSICAL: Multi-Scale Image Contextual Attention Learning for Inpainting [pdf]
2019	IJCAI 2019	Generative Image Inpainting with Submanifold Alignment [pdf]
2019	IJCAI 2019	Coarse-to-Fine Image Inpainting via Region-wise Convolutionsand Non-Local Correlation [pdf]
2019	ACM MM 2019	Progressive Image Inpainting with Full-Resolution Residual Network [pdf] [code]
2019	ACM MM 2019	Deep Fusion Network for Image Completion [pdf] [code]	CNN-based Fusion Block
2019	ACM MM 2019	GAIN: Gradient Augmented Inpainting Network for Irregular Holes [pdf] [blog]
2019	ACM MM 2019	Single-shot Semantic Image Inpainting with Densely Connected Generative Networks [pdf]
2019	ICCVW 2019	EdgeConnect: Generative Image Inpainting with Adversarial Edge Learning [pdf] [code]
2019	ICCV 2019	Coherent Semantic Attention for Image Inpainting [pdf] [code] [blog]	Attention
2019	ICCV 2019	StructureFlow: Image Inpainting via Structure-aware Appearance Flow [pdf] [code]
2019	ICCV 2019	Progressive Reconstruction of Visual Structure for Image Inpainting [pdf] [code]
2019	ICCV 2019	Localization of Deep Inpainting Using High-Pass Fully Convolutional Network [pdf]
2019	ICCV 2019	Image Inpainting with Learnable Bidirectional Attention Maps [pdf] [code]
2019	ICCV 2019	Free-Form Image Inpainting with Gated Convolution [pdf] [code] [project] [blog1] [blog2]
2019	ICCV 2019	CIIDefence: Defeating Adversarial Attacks by Fusing Class-specific Image Inpainting and Image Denoising [pdf]
2019	ICCV 2019	FiNet: Compatible and Diverse Fashion Image Inpainting [pdf]	Fashion
2019	ICCV 2019	SC-FEGAN: Face Editing Generative Adversarial Network with User's Sketch and Color [pdf] [code] [blog]	Face
2019	ICCV 2019	Human Motion Prediction via Spatio-Temporal Inpainting [pdf] [code]	Motion
2019	ICCV 2019	Copy-and-Paste Networks for Deep Video Inpainting [pdf]	Video
2019	ICCV 2019	Free-form Video Inpainting with 3D Gated Convolution and Temporal PatchGAN [pdf] [code]	Video
2019	ICCV 2019	An Internal Learning Approach to Video Inpainting [pdf]	Video
2019	ICCV 2019	Vision-Infused Deep Audio Inpainting [pdf] [code]	Audio
2019	ACCESS 2019	Artist-Net: Decorating the Inferred Content With Unified Style for Image Inpainting [paper]	CNN-based
2019	NPL 2019	An Improved Method for Semantic Image Inpainting with GANs: Progressive Inpainting [paper]	GAN-based
2019	NPL 2019	Image inpainting: A review [paper]	Deep learning
2019	PCS 2019	New Inpainting Algorithm Based on Simplified Context Encoders and Multi-Scale Adversarial Network [paper]	GAN-based
2019	PRL 2019	Peeking behind objects: Layered depth prediction from a single image [paper]	GAN-based
2019	VISAPP 2019	Semantic image inpainting through improved Wasserstein generative adversarial networks [paper]	GAN-based
2020	AAAI 2020	Region Normalization for Image Inpainting [pdf] [code]
2020	AAAI 2020	Learning to Incorporate Structure Knowledge for Image Inpainting [pdf] [code]	ATN
2020	WACV 2020	Evaluation of Image Inpainting for Classification and Retrieval [paper]
2020	ACCESS 2020	PiiGAN: Generative Adversarial Networks for Pluralistic Image Inpainting [paper][code]	Diversity
2020	CVPR 2020	Contextual Residual Aggregation for Ultra High-Resolution Image Inpainting [paper] [code] [code]	Huawei
2020	CVPR 2020	UCTGAN: Diverse Image Inpainting Based on Unsupervised Cross-Space Translation [paper]	Diverse
2020	CVPR 2020	Recurrent Feature Reasoning for Image Inpainting [paper] [code]	Recurrent
2020	CVPR 2020	Prior Guided GAN Based Semantic Inpainting [paper]
2020	CVPR 2020	Attentive Normalization for Conditional Image Generation [paper] [code]	Attention
2020	CVPR 2020	Instance-aware Image Colorization [paper] [code]	Colorization
2020	CVPR 2020	Intuitive, Interactive Beard and Hair Synthesis with Generative Models [paper]	Image Editing
2020	CVPR 2020	Wish You Were Here: Context-Aware Human Generation [paper]
2020	CVPR 2020	Assessing Eye Aesthetics for Automatic Multi-Reference Eye In-Painting [paper]	Eye
2020	CVPR 2020	3D Photography using Context-aware Layered Depth Inpainting [paper] [code]	3D
2020	CVPR 2020	FeatureFlow: Robust Video Interpolation via Structure-to-texture Generation [paper] [code]	Video
2020	ECCV 2020	Rethinking image inpainting via a mutual encoder-decoder with feature equalization [paper] [official code]	oral
2020	ECCV 2020	Learning Object Placement by Inpainting for Compositional Data Augmentation [paper]
2020	ECCV 2020	High-Resolution Image Inpainting with Iterative Confidence Feedback and Guided Upsampling [paper] [code]
2020	ECCV 2020	VCNet: A Robust Approach to Blind Image Inpainting [paper]
2020	ECCV 2020	Guidance and Evaluation: Semantic-Aware Image Inpainting for Mixed Scenes [paper]
2020	ECCV 2020	Short-Term and Long-Term Context Aggregation Network for Video Inpainting [paper]	video
2020	ECCV 2020	DVI: Depth Guided Video Inpainting for Autonomous Driving [paper]	video
2020	ECCV 2020	Learning Joint Spatial-Temporal Transformations for Video Inpainting [paper]	video
2020	ECCVW 2020 (AIM 2020)	AIM 2020 Challenge on Image Extreme Inpainting [paper] [code] [webpage]	workshop
2020	ECCVW 2020	Image Fine-grained Inpainting [paper] [code]	1st
2020	ECCVW 2020	DeepGIN: Deep Generative Inpainting Networkfor Extreme Image Inpainting [paper] [code]	9th
2020	ACM MM 2020	Image Inpainting Based on Multi-frequency Probabilistic Inference Model [paper]
2021	WACV 2021	Hyperrealistic Image Inpainting With Hypergraphs [paper] [code]
2021	WACV 2021	Multi-Level Generative Chaotic Recurrent Network for Image Inpainting [paper]
2021	WACV 2021	R-MNet: A Perceptual Adversarial Network for Image Inpainting [paper] [code]

Inpainting Traditional Methods

Year	Proceeding	Title	Comment
2000	SIGGRAPH 2000	Image Inpainting [pdf] [paper]	Diffusion-based
2001	TIP 2001	Filling-in by joint interpolation of vector fields and gray levels [pdf]	Diffusion-based
2001	CVPR 2001	Navier-stokes, fluid dynamics, and image and video inpainting [pdf]
2001	SIGGRAPH 2001	Image Quilting for Texture Synthesis and Transfer [pdf]
2001	SIGGRAPH 2001	Synthesizing Natural Textures [pdf]
2002	EJAM 2002	Digital inpainting based on the mumford–shah–euler image model [pdf]	Diffusion-based
2003	CVPR 2003	Object removal by exemplar-based inpainting [pdf]
2003	TIP 2003	Simultaneous structure and texture image inpainting [pdf]	Diffusion-based
2003	TIP 2003	Structure and Texture Filling-In of Missing Image Blocks in Wireless Transmission and Compression Applications [pdf]
2003	ICCV 2003	Learning How to Inpaint from Global Image Statistics [pdf]	Diffusion-based
2003	TOG 2003	Fragment-based image completion [pdf]	Patch-based
2004	TIP 2004	Region Filling and Object Removal by Exemplar-Based Image Inpainting [pdf]	Patch-based; Inpainting order
2004	TPAMI 2004	Space-Time Video Completion [pdf]
2005	SIGGRAPH 2005	Image Completion with Structure Propagation [pdf]	Patch-based
2006	ISCS 2006	Image Compression with Structure Aware Inpainting [pdf]
2006	JIVP 2006	Spatio-temporal consistent depth-image-based rendering using layered depth image and inpainting [paper]	Object removal
2007	TOG 2007	Scene completion using millions of photographs [pdf]
2007	CSVT 2007	Image Compression With Edge-Based Inpainting [pdf]	Diffusion-based
2007	TPAMI 2007	Space-Time Video Completion [pdf]	video
2008	CVPR 2008	Summarizing Visual Data Using Bidirectional Similarity [pdf]
2009	SIGGRAPH 2009	PatchMatch: a randomized correspondence algorithm for structural image editing [pdf]	Patch-based
2010	TIP 2010	Image inpainting by patch propagation using patch sparsity [pdf]	Patch-based
2011	FTCGV 2011	Structured learning and prediction in computer vision [pdf]
2011	ICIP 2011	Examplar-based inpainting based on local geometry [pdf]	Inpainting order
2012	TOG 2012	Combining inconsistent images using patch-based synthesis [pdf]	Patch-based
2012	ACM TOG 2012	Image Melding: Combining Inconsistent Images using Patch-based Synthesis [pdf]	Patch-based
2014	TOG 2014	Image completion using Planar structure guidance [pdf]	Patch-based
2014	TIP 2014	Context-aware patch-based image inpainting using markov random field modeling [paper] [code]	Patch-based
2014	TPAMI 2014	Image Completion Approaches Using the Statistics of Similar Patches [paper]
2014	TVCG 2014	High-Quality Real-Time Video Inpainting with PixMix [pdf]	Video
2014	SIAM 2014	Video inpainting of complex scenes [pdf]	Video
2015	TIP 2015	Annihilating Filter-Based Low-Rank Hankel Matrix Approach for Image Inpainting [pdf]
2015	TIP 2015	Exemplar-Based Inpainting: Technical Review and New Heuristics for Better Geometric Reconstructions [pdf]
2015	TVCG 2015	Diminished reality based on image inpainting considering background geometry [paper]
2015	JGO 2015	Fast algorithm for color texture image inpainting using the non-local ctv model [paper]	Patch-based
2016	MTA 2016	Rate-distortion optimized image compression based on image inpainting [paper]	Patch-based
2016	SIVP 2016	Domain-based structure-aware image inpainting [paper]	Patch-based
2016	SC 2016	Image inpainting algorithm based on TV model and evolutionary algorithm [paper]	Diffusion-based
2016	ICAC 2016	Image Inpainting Approaches – A Review [paper]
2016	TOG 2016	Temporally coherent completion of dynamic video [pdf]	Video
2017	TVCG 2017	Patch-Based Image Inpainting via Two-Stage Low Rank Approximation [paper]	Patch-based
2017	TIP 2017	Depth image inpainting: Improving low rank matrix completion with low gradient regularization [paper] [code]	Patch-based
2017	MTA 2017	Exemplar-based image inpainting using svd-based approximation matrix and multi-scale analysis [paper]	Patch-based
2017	EURASIP 2017	Damaged region filling and evaluation by symmetrical exemplar-based image inpainting for Thangka [paper]	Patch-based
2017	TIFS 2017	Localization of diffusion-based inpainting in digital images [paper]	Diffusion-based
2018	MTA 2018	Gradient-based low rank method and its application in image inpainting [paper]	Patch-based
2018	MTA 2018	A novel patch matching algorithm for exemplar-based image inpainting [paper]	Patch-based
2018	MTA 2018	A robust forgery detection algorithm for object removal by exemplar-based image inpainting [paper]	Patch-based
2018	TIP 2018	Image Inpainting Using Nonlocal Texture Matching and Nonlinear Filtering [paper]	Patch-based
2018	TMM 2018	Structure-guided image inpainting using homography transformation [paper]	Patch-based
2018	CC 2018	Damaged region filling by improved criminisi image inpainting algorithm for thangka [paper]	Patch-based
2018	CC 2018	The research of image inpainting algorithm using self-adaptive group structure and sparse representation [paper]	dictionary learning-based
2018	ACCESS 2018	Sparsity-based image inpainting detection via canonical correlation analysis with low-rank constraints [paper]	Sparsity-based
2019	AJSE 2019	Image Inpainting Algorithm Based on Saliency Map and Gray Entropy [paper]	Patch-based
2019	CSSP 2019	Image inpainting based on fractional-order nonlinear diffusion for image reconstruction [paper]	Diffusion-based

ArXiv or Unpublished

Year	Proceeding	Title	Comment
2018	arXiv:1801.07632	High Resolution Face Completion with Multiple Controllable Attributes via Fully End-to-End Progressive Generative Adversarial Networks [pdf]
2018	arXiv:1803.07422	Patch-Based Image Inpainting with Generative Adversarial Networks [pdf] [code]
2018	arXiv:1808.04432	X-GANs: Image Reconstruction Made Easy for Extreme Cases [pdf]
2018	arXiv:1811.03911	Unsupervised Learnable Sinogram Inpainting Network (SIN) for Limited Angle CT reconstruction [paper]	CNN-based
2018	arXiv:1811.07104	On Hallucinating Context and Background Pixels from a Face Mask using Multi-scale GANs [pdf]
2018	arXiv:1811.09012	Multi-View Inpainting for RGB-D Sequence [pdf]
2018	arXiv:1812.01458	Deep Inception Generative network for Cognitive Image Inpainting [pdf]
2018	arXiv:1808.08483	Painting Outside the Box: Image Outpainting with GANs [paper]	GAN-based
2019	arXiv:1901.03396	Detecting Overfitting of Deep Generative Networks via Latent Recovery [pdf]
2019	arXiv:1902.00301	Deep Hyperspectral Prior: Denoising, Inpainting, Super-Resolution [paper]	CNN-based
2019	arXiv:1902.09225	Harmonizing Maximum Likelihood with GANs for Multimodal Conditional Generation [pdf]
2019	arXiv:1903.00450	Multi-Object Representation Learning with Iterative Variational Inference [pdf]
2019	arXiv:1903.04842	Unsupervised motion saliency map estimation based on optical flow inpainting [pdf]
2019	arXiv:1903.10885	Learning Quadrangulated Patches For 3D Shape Processing [pdf]
2019	arXiv:1904.10795	Graph-based Inpainting for 3D Dynamic Point Clouds [pdf]	Point Cloud
2019	arXiv:1905.02882	Frame-Recurrent Video Inpainting by Robust Optical Flow Inference [pdf]	Video
2019	arXiv:1905.02949	Deep Blind Video Decaptioning by Temporal Aggregation and Recurrence [pdf]	Video
2019	arXiv:1905.12384	Coherent Semantic Attention for Image Inpainting [paper]	CNN-based
2019	arXiv:1905.13066	Align-and-Attend Network for Globally and Locally Coherent Video Inpainting [pdf]	Video
2019	arXiv:1906.00884	Fashion Editing with Multi-scale Attention Normalization [pdf]
2019	arXiv:1912.01834	Diversity-Generated Image Inpainting with Style Extraction [paper] [code]	GAN-based
2019	arXiv:1912.11711	Controllable and Progressive Image Extrapolation [paper]	GAN-based
2019	arXiv:1912.10960v2	Image Outpainting and Harmonization using Generative Adversarial Networks [paper] [code]	GAN-based
2020	arXiv:2001.04568	180-degree Outpainting from a Single Image [paper]	GAN-based

Interesting Applications of GAN

Year	Proceeding	Title	Comment
2019	arXiv:1903.10146v1	PI-REC: Progressive Image Reconstruction Network With Edge and ColorDomain [paper] [code]	edge2image

The Survey of GAN

Year	Proceeding	Title	Comment
2020	arXiv:1906.01529v5	Generative Adversarial Networks in Computer Vision: A Survey and Taxonomy [paper]	Overview
2019	arXiv:1809.06222v3	GANs for Medical Image Analysis [paper] [link]	Medical

Related Link

CVPR 2020

CVPR 2020 Workshops

CVPR 2019

ICCV 2019

ECCV 2018-2020

ECCV 2018

ECCV 90-2018

NeurlPS 1988-2019

ACM MM 2020

ICLR 2019

ICML 2019

AAAI 2019

WACV 2021

WACV 2020

IJCAI 2019

ACL 2019

Extrapolation arXiv paper search

Outpainting arXiv paper search

Inpainting arXiv paper search