AwesomeAnimeResearch

signal processing or machine learning related to anime or manga

Papers

Summary of published or preprint papers

Dataset

Paper	Conference	Links
The Amazing Mysteries of the Gutter: Drawing Inferences Between Panels in Comic Book Narratives	CVPR2017	Github
Creative Flow+ Dataset	CVPR2019	HP
Building a Manga Dataset ”Manga109” with Annotations for Multimedia Applications	IEEE MultiMedia,2020	HP
DanbooRegion: An Illustration Region Dataset	ECCV2020	Github
Unconstrained Text Detection in Manga: a New Dataset and Baseline	ECCVW2020	Github
Cartoon Face Recognition: A Benchmark Dataset	ACM MM2020	Github
DAF:RE: A CHALLENGING, CROWD-SOURCED, LARGE-SCALE, LONG-TAILED DATASET FOR ANIME CHARACTER RECOGNITION		Github
AnimeCeleb: Large-Scale Animation CelebHeads Dataset for Head Reenactment	ECCV2022	Github
A Challenging Benchmark of Anime Style Recognition	CVPRW2022
COO: Comic Onomatopoeia Dataset for Recognizing Arbitrary or Truncated Texts	ECCV2022	Github
AnimeRun: 2D Animation Visual Correspondence from Open Source 3D Movies		HP
Parsing-Conditioned Anime Translation: A New Dataset and Method	ACM TG2023	Github
Semi-supervised reference-based sketch extraction using a contrastive learning framework	ACM TG2023	Github

Image Generation

Subcategory	Paper	Conference	Links
Generation	Towards the Automatic Anime Characters Creation with Generative Adversarial Networks	Comiket92	HP
	Full-body High-resolution Anime Generation with Progressive Structure-conditional Generative Adversarial Networks	ECCVW2018	HP
	Generate Novel Image Styles using Weighted Hybrid Generative Adversarial Nets	IJCNN2018
	Towards Diverse Anime Face Generation: Active Label Completion and Style Feature Network	EUROGRAPHICS2019
	An Adaptive Control Algorithm for Stable Training of Generative Adversarial Networks	IEEE Access2019
	Overcoming Long-term Catastrophic Forgetting through Adversarial Neural Pruning and Synaptic Consolidation
	Autoencoding Generative Adversarial Networks		Github
	Classification Representations Can be Reused for Downstream Generations
	GAN Memory with No Forgetting	NeurIPS2020	Github
	Generating Full-Body Standing Figures of Anime Characters and Its Style Transfer by GAN
	HistoGAN: Controlling Colors of GAN-Generated and Real Images via Color Histograms	CVPR2021	Github
	Efficient Continual Adaptation for Generative Adversarial Networks
	Generating "Ideal" Anime Opening Frames Using Neural Networks	ElConRus2021
	CoPE: Conditional image generation using Polynomial Expansions
	StyleGAN-NADA: CLIP-Guided Domain Adaptation of Image Generators	SIGGRAPH2022	Github
	DisUnknown: Distilling Unknown Factors for Disentanglement Learning	ICCV2021	Github
	Combating Mode Collapse in GANs via Manifold Entropy Estimation		Github
Few-shot	Image Generation From Small Datasets via Batch Statistics Adaptation	ICCV2019	Github
	FEW-SHOT ADAPTATION OF GENERATIVE ADVERSARIAL NETWORKS		Github
	MineGAN: effective knowledge transfer from GANs to target domains with few images	CVPR2020	Github
	Freeze the Discriminator: a Simple Baseline for Fine-Tuning GANs	CVPRW2020	Github
	DATA INSTANCE PRIOR FOR TRANSFER LEARNING IN GANS
	MineGAN++: Mining Generative Models for Efficient Knowledge Transfer to Limited Data Domains
	Data InStance Prior (DISP) in Generative Adversarial Networks	WACV2022
	Controlling StyleGANs Using Rough Scribbles via One-shot Learning	CAVW2022	HP
Interpretability	RPGAN: GANs Interpretability via Random Routing		Github
	Unsupervised Discovery of Interpretable Directions in the GAN Latent Space	ICML2020	Github
	Closed-Form Factorization of Latent Semantics in GANs	CVPR2021	Github
	Unsupervised Discovery of Disentangled Manifolds in GANs
	Do Generative Models Know Disentanglement? Contrastive Learning is All You Need		Github
	Surrogate Gradient Field for Latent Space Manipulation	CVPR2021
	EigenGAN: Layer-Wise Eigen-Learning for GANs		Github
	Discovering Interpretable Latent Space Directions of GANs Beyond Binary Attributes	CVPR2021
	Discovering Density-Preserving Latent Space Walks in GANs for Semantic Image Transformations	MM 2021
	Self-supervised Enhancement of Latent Discovery in GANs	AAAI2022
	Unsupervised Discovery of Disentangled Interpretable Directions for Layer-Wise GAN	Big Data2022
Montage	MontageGAN: Generation and Assembly of Multiple Components by GANs	ICPR2022	Github
Text-to-Image	Adding Conditional Control to Text-to-Image Diffusion Models		Github
	DreamArtist: Towards Controllable One-Shot Text-to-Image Generation via Positive-Negative Prompt-Tuning		Github

Image-to-image Translation

Subcategory	Paper	Conference	Link
Face2anime	Improving Shape Deformation in Unsupervised Image-to-Image Translation	ECCV2018	Github
	Twin-GAN – Unpaired Cross-Domain Image Translation with Weight-Sharing GANs		Github
	DA-GAN: Instance-level Image Translation by Deep Attention Generative Adversarial Networks	CVPR2018	Github
	Landmark Assisted CycleGAN for Cartoon Face Generation
	Generating Anime from Real Human Image with Adversarial Training	ICASERT2019
	Auto-Encoding for Shared Cross Domain Feature Representation and Image-to-Image Translation
	Few-shot Knowledge Transfer for Fine-grained Cartoon Face Generation
	Unsupervised Image-to-Image Translation via Pre-trained StyleGAN2 Network		Github
	A Note on Data Biases in Generative Models	NeurIPSW2020
	Turn Real People into Anime Cartoonization	ICCECE2021
	AniGAN: Style-Guided Generative Adversarial Networks for Unsupervised Anime Face Generation		Github
	Multi-CartoonGAN for Conditional Artistic Face Translation	JSAI2021
	GANs N’ Roses: Stable, Controllable, Diverse Image to Image Translation (works for videos too!)		Github
	FINE-TUNING STYLEGAN2 FOR CARTOON FACE GENERATION		Github
	AgileGAN: Stylizing Portraits by Inversion-Consistent Transfer Learning	ACM Trans. Graph. 2021	Github
	A Domain Gap Aware Generative Adversarial Network for Multi-domain Image Translation
	Cross-Domain Style Mixing for Face Cartoonization	CVPRW2022	HP
	Neural Optimal Transport
	Appearance-preserved Portrait-to-anime Translation via Proxy-guided Domain Adaptation	TVCG2022
	StyO: Stylize Your Face in Only One-Shot
Selfie2anime	U-GAT-IT: Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translation	ICLR2020	Github
	Breaking the cycle—Colleagues are all you need	CVPR2020	Github
	AttentionGAN: Unpaired Image-to-Image Translation using Attention-Guided Generative Adversarial Networks	IJCNN2019	Github
	Unpaired Image-to-Image Translation using Adversarial Consistency Loss	ECCV2020	Github
	Feature Quantization Improves GAN Training	ICML2020	Github
	Interpolation based Anime Face Style Transfer	MAPR2020
	SPatchGAN: A Statistical Feature Based Discriminator for Unsupervised Image-to-Image Translation
	Good Artists Copy, Great Artists Steal: Model Extraction Attacks Against Image Translation Generative Adversarial Networks
	Unaligned Image-to-Image Translation by Learning to Reweight	ICCV2021
	UVCGAN: UNET VISION TRANSFORMER CYCLE-CONSISTENT GAN FOR UNPAIRED IMAGE-TO-IMAGE TRANSLATION
	Unpaired Cartoon Image Synthesis via Gated Cycle Mapping	CVPR2022
	Unpaired Image-to-Image Translation using Negative Learning for Noisy Patches	IEEE MM2022
	Hyprogan: Breaking the Dimensional wall From Human to Anime	ICIP2022
	Alleviating Semantics Distortion in Unsupervised Low-Level Image-to-Image Translation via Structure Consistency Constraint	CVPR2022
Photo2anime	CartoonGAN: Generative Adversarial Networks for Photo Cartoonization	CVPR2018	Github
	Comixify: Transform video into a comics		Github
	GANILLA: Generative adversarial networks for image to illustration translation		Github
	CartoonRenderer: An Instance-based Multi-Style Cartoon Image Translator	MMM2020
	Learning to Cartoonize Using White-box Cartoon Representations	CVPR2020	Github
	Generative Adversarial Networks for photo to Hayao Miyazaki style cartoons		Github
	AnimeGAN: a novel lightweight GAN for photo animation		Github
	GAN-based Multi-Style Photo Cartoonization	IEEE TVCG2021
	Pseudo-Supervised Learning for Semantic Multi-Style Transfer	IEEE Access (Vol. 9)
	Cartoonize Images using TinyML Strategies with Transfer Learning	IEEE 2021
	Transfer photo to anime with dual discriminators GAN	ICCECE2022
	ARGAN: Fast Converging GAN for Animation Style Transfer	MVIP2022	Github
	Unsupervised Coherent Video Cartoonization with Perceptual Motion Consistency	AAAI2022
	Learning to Incorporate Texture Saliency Adaptive Attention to Image Cartoonization	ICML2022
	Cartoon-Flow: A Flow-Based Generative Adversarial Network for Arbitrary-Style Photo Cartoonization	MM2022
Sketch2anime	SmartPaint: a co-creative drawing system based on generative adversarial networks	FITEE2019
	PI-REC: Progressive Image Reconstruction Network With Edge and Color Domain		Github
	Modeling Artistic Workflows for Image Generation and Editing	ECCV2020	Github
	Deep Sketch-guided Cartoon Video Inbetweening	IEEE2021
	How to train your conditional GAN: An approach using geometrically structured latent manifolds
	PMSGAN: Parallel Multistage GANs for Face Image Translation	TNNLS2022
	AniFaceDrawing: Anime Portrait Exploration during Your Sketching	ACM TG2023	HP
Photo2manga	MangaGAN: Unpaired Photo-to-Manga Translation Based on The Methodology of Manga Drawing	AAAI2021
Anime2costume	Anime-to-Real Clothing: Cosplay Costume Generation via Image-to-Image Translation
Style transfer	Anime Style Space Exploration Using Metric Learning and Generative Adversarial Networks
	Disentangling Style and Content in Anime Illustrations		Github
	RAG: Facial Attribute Editing by Learning Residual Attributes	IEEE Access2019
	StarGAN Based Facial Expression Transfer for Anime Characters	CSICC2020
	Few-shot Semantic Image Synthesis Using StyleGAN Prior		Github
	Fine-Grained Control of Artistic Styles in Image Generation
	JoJoGAN: One Shot Face Stylization		Github
	Unsupersived Image Texture Transfer Based On Generative Adversarial Network	ICCECE2022
	Styleverse: Towards Identity Stylization across Heterogeneous Domains
	Cross-modal and Semantics-Augmented Asymmetric CycleGAN for Data-Imbalanced Anime Style Face Translation	VSIP2021
	Mind the Gap: Domain Gap Control for Single Shot Domain Adaptation for Generative Adversarial Networks	ICLR2022	Github
	Pastiche Master: Exemplar-Based High-Resolution Portrait Style Transfer	CVPR2022	Github
	Towards Diverse and Faithful One-shot Adaption of Generative Adversarial Networks		Github
	LANIT: Language-Driven Image-to-Image Translation for Unlabeled Data		Github
	HRInversion: High-Resolution GAN Inversion for Cross-Domain Image Synthesis	TCSVT2022
Author style transfer	Translation of Illustration Artist Style Using Sailormoonredraw Data	ICIP2022

Automatic Line Art Colorization

Subcategory	Paper	Conference	Links
NoHint	Automatic Sketch Colorization with Tandem Conditional Adversarial Networks	ISCID2018
	Do You Like Sclera? Sclera-region Detection and Colorization for Anime Character Line Drawings	IJNDC2019
	Colorization for Anime Sketches with Cycle-Consistent Adversarial Network	IJPE2019
	Seg2pix: Few Shot Training Line Art Colorization with Segmented Image Data	Appl. Sci. 2021
	Semi-automatic Manga Colorization Using Conditional Adversarial Networks		Github
	Stylized-Colorization for Line Arts	ICPR2021
	Generative Probabilistic Image Colorization
	FlatMagic: Improving Flat Colorization through AI-driven Design for Digital Comic Professionals	CHI2022	Github
	Attention-Based Unsupervised Sketch Colorization of Anime Avatar	ICCIR2022
Atari	Manga Colorization	ACM Trans. Graph. 2006
	TexToons: Practical Texture Mapping for Hand-drawn Cartoon Animations	NPAR2011
	Outline Colorization through Tandem Adversarial Networks
	A Fast and Efficient Semi-guided Algorithm for Flat Coloring Line-arts	EG2018
	Auto-painter: Cartoon Image Generation from Sketch by Using Conditional Wasserstein Generative Adversarial Networks	Neurocomputing2018	Github
	User-Guided Deep Anime Line Art Colorization with Conditional Adversarial Networks	ACMMC2018	Github
	Two-stage Sketch Colorization	ACM Trans. Graph. 2018	Github
	Anime Sketch Coloring with Swish-gated Residual U-net and Spectrally Normalized GAN		Github
	PaintsTorch: a User-Guided Anime Line Art Colorization Tool with Double Generator Conditional Adversarial Network	CVMP2019
	Interactive Anime Sketch Colorization with Style Consistency via a Deep Residual Neural Network	TAAI2019
	Semi-Auto Sketch Colorization Based on Conditional Generative Adversarial Networks	CISP-BMEI2019
	MANGAN: ASSISTING COLORIZATION OF MANGA CHARACTERS CONCEPT ART USING CONDITIONAL GAN	ICIP2019	Github
	Two-Stage Sketch Colorization With Color Parsing	IEEE Access2019
	User Guided Digital Artwork Colorization	CSAI2019
	Cartoon image colorization based on emotion recognition and superpixel color resolution	ICCST2020
	Automatic Colorization of Anime Style Illustrations Using a Two-Stage Generator	Appl. Sci. 2020
	Line Art Colorization with Concatenated Spatial Attention	CVPRW2021
	User-Guided Line Art Flat Filling with Split Filling Mechanism	CVPR2021	HP
	Deep Edge-Aware Interactive Colorization against Color-Bleeding Effects
	Dual Color Space Guided Sketch Colorization	IEEE Trans. on Img. Proc. 2021
	Interactive Manga Colorization with Fast Flat Coloring	SIGGRAPH Asia2021
	Late-resizing: A Simple but Effective Sketch Extraction Strategy for Improving Generalization of Line-art Colorization	WACV2022
	StencilTorch: An Iterative and User-Guided Framework for Anime Lineart Colorization	IVCNZ2022
	Guiding Users to Where to Give Color Hints for Efficient Interactive Sketch Colorization via Unsupervised Region Prioritization	WACV2023
	Diffusart: Enhancing Line Art Colorization with Conditional Diffusion Models	CVPRW2023
Reference	Unsupervised Colorization of Black-and-White Cartoons	NPAR2004
	Reference-based Manga Colorization by Graph Correspondence Using Quadratic Programming	SIGGRAPH2014
	Deep Manga Colorization with Color Style Extraction by Conditional Adversarially Learned Inference	IIAI2017
	Style Transfer for Anime Sketches with Enhanced Residual U-net and Auxiliary Classifier GAN	ACPR2017
	cGAN-based Manga Colorization Using a Single Training Image	ICDAR2017	Github
	Comicolorization: Semi-Automatic Manga Colorization	SIGGRAPH2017	Github
	Automatic manga colorization with color style by generative adversarial nets	2017 18th IEEE/ACIS SNPD
	Attentioned Deep Paint		Github
	Fully Automatic Colorization for Anime Character Considering Accurate Eye Colors	SIGGRAPH2019
	Semantic Example Guided Image-to-Image Translation	IEEE Transactions on Multimedia2020
	Graph Matching based Anime Colorization with Multiple References	SIGGRAPH2019
	Reference-Based Sketch Image Colorization using Augmented-Self Reference and Dense Semantic Correspondence	CVPR2020	Github
	Multi-Density Sketch-to-Image Translation Network
	Deep-Eyes: Fully Automatic Anime Character Colorization with Painting of Details on Empty Pupils	EG2020
	Colorization of Line Drawings with Empty Pupils	PG2020
	Anime Sketch Colorization by Component-based Matching using Deep Appearance Features and Graph Representation	ICPR2021
	Anime Style Transfer With Spatially-Adaptive Normalization	ICME2021
	Exploring Sketch-based Character Design Guided by Automatic Colorization
	PAINTING STYLE-AWARE MANGA COLORIZATION BASED ON GENERATIVE ADVERSARIAL NETWORKS	ICIP2021
	The Animation Transformer: Visual Correspondence via Segment Matching	ICCV2021
	Disentangled and controllable sketch creation based ondisentangling the structure and color enhancement
	Reference-guided structure-aware deep sketch colorization for cartoons	CVM2022
	Anime Character Colorization using Few-shot Learning	SIGGRAPH Asia2021
	Exemplar-Based Sketch Colorization with Cross-Domain Dense Semantic Correspondence	Mathematics2022
	Eliminating Gradient Conflict in Reference-based Line-Art Colorization	ECCV2022	Github
	Improving Reference-Based Image Colorization For Line Arts Via Feature Aggregation And Contrastive Learning	ICASSP2022
	Semi-Automatic Colorization Pipeline for Anime Characters and its Evaluation in Production	NicoInt2022
	ATTENTION-AWARE ANIME LINE DRAWING COLORIZATION
	AnimeDiffusion: Anime Face Line Drawing Colorization via Diffusion Models
	Two-Step Training: Adjustable Sketch Colourization via Reference Image and Text Tag	CG Forum2023	Github
Tag	Tag2Pix: Line Art Colorization Using Text Tag With SECat and Changing Loss	ICCV2019	Github
	Line Art Colorization Based on Explicit Region Segmentation	PG 2021
Video	Automatic Temporally Coherent Video Colorization		Github
	Artist-Guided Semiautomatic Animation Colorization	ICCVW2019
	Deep Line Art Video Colorization with a Few References
	Line Art Correlation Matching Feature Transfer Network for Automatic Animation Colorization	WACV2021

Automatic Character Lighting

Paper	Conference	Links
Ink-and-Ray: Bas-Relief Meshes for Adding Global Illumination Effects to Hand-Drawn Characters	ACM Trans. Graph. 2014
Deep Normal Estimation for Automatic Shading of Hand-Drawn Characters	ECCVW2018	Github
Automatic Illumination Effects for 2D Characters	NIPSW2018
2D shading for cel animation	NPAR2018	HP
Augmenting Hand-Drawn Art with Global Illumination Effects through Surface Inflation	CVMP 2019	HP
Generating Digital Painting Lighting Effects via RGB-space Geometry	ACM Trans. Graph. 2020	Github
Learning to Shadow Hand-drawn Sketches	CVPR2020	Github
SmartShadow: Artistic Shadow Drawing Tool for Line Drawings	ICCV2021
Automatic Illumination of Flat-Colored Drawings by 3D Augmentation of 2D Silhouettes	ICIP2022

Automatic Illustration Editing

Paper	Conference	Links
Decomposing Images into Layers with Advanced Color Blending	PG2018	Github
Spatially Controllable Image Synthesis with Internal Representation Collaging		Github
Erasing Appearance Preservation in Optimization-based Smoothing	ECCV2020	Github
Cross-Domain and Disentangled Face Manipulation with 3D Guidance		Github
L2M-GAN: Learning to Manipulate Latent Space Semantics for Facial Attribute Editing	CVPR2021
Deep Unfolding with Normalizing Flow Priors for Inverse Problems
Sketch-based Anime Hairstyle Editing with Generative Inpainting	NicoInt2021
DyStyle: Dynamic Neural Network for Multi-Attribute-Conditioned Style Editing
Improving The Quality Of Illustrations: Transforming Amateur Illustrations To A Professional Standard	ICIP2021
Universal Face Restoration With Memorized Modulation
Unsupervised Learning of Compositional Energy Concepts	NeurIPS2021	Github
Reference-based Image Composition with Sketch via Structure-aware Diffusion Model		Github

Automatic Sketch Editing

Paper	Conference	Links
Temporal Noise Control for Sketchy Animation	NPAR2011
Learning to Simplify: Fully Convolutional Networks for Rough Sketch Cleanup	ACM Trans. Graph. 2016	Github
Deep Extraction of Manga Structural Lines	ACM Trans. Graph. 2017	Github
Mastering Sketching: Adversarial Augmentation for Structured Prediction	ACM Trans. Graph. 2018	Github
Real-Time Data-Driven Interactive Rough Sketch Inking	ACM Trans. Graph. 2018	Github
Unpaired Sketch-to-Line Translation via Synthesis of Sketches	SIGGRAPH2019
Perceptual-aware Sketch Simplification Based on Integrated VGG Layers	TVCG2019
Progressive Full Data Convolutional Neural Networks for Line Extraction from Anime-Style Illustrations	Appl. Sci. 2020
SketchMan: Learning to Create Professional Sketches	MM2020	Github
One-shot Line Extraction from Color Illustrations	NicoInt2021
Learning to Generate Artistic Character Line Drawing
A Drawing Support System for Sketching Aging Anime Faces	CW2022
Reference Based Sketch Extraction via Attention Mechanism	ACM TG2022	Github
Semi-supervised reference-based sketch extraction using a contrastive learning framework	ACM TG2023	Github
Joint Geometric-Semantic Driven Character Line Drawing Generation	ICMR2023

Automatic Animation Inbetweening

Paper	Conference	Links
A filter based approach for inbetweening (Japanese)		Movie
DiLight: Digital light table – Inbetweening for 2D animations using guidelines	CMV2017
Optical Flow Based Line Drawing Frame Interpolation Using Distance Transform to Support Inbetweenings	ICIP2019
Deep Animation Video Interpolation in the Wild	CVPR2021	Github
Improving the Perceptual Quality of 2D Animation Interpolation	ECCV2022	Github
ENHANCED DEEP ANIMATION VIDEO INTERPOLATION	ICIP2022	Github

Automatic Image Enhancement

Paper	Conference	Links
Enhancement of Anime Imaging Enlargement using Modified Super-Resolution CNN	JSCI2021	Github
Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Data	ICCVW2021	Github
A Transformer-Based Model for Super-Resolution of Anime Image	Sensors2022
AnimeSR: Learning Real-World Super-Resolution Models for Animation Videos		Github

Character Animating

Paper	Conference	Links
MakeItTalk: Speaker-Aware Talking-Head Animation	SIGGRAPH Asia2020
CPTNet: Cascade Pose Transform Network for Single Image Talking Head Animation	ACCV2020
Collaborative Neural Rendering using Anime Character Sheets		Github
Language-Guided Face Animation by Recurrent StyleGAN-based Generator		Github

Manga Application

Subcategory	Paper	Conference	Links
Generation	Synthesis of Screentone Patterns of Manga Characters	ISM2019
	Manga Filling Style Conversion with Screentone Variational Autoencoder	SIGGRAPH2020
	Generating Manga from Illustrations via Mimicking Manga Workflow	CVPR2021	HP
	Hair Shading Style Transfer for Manga with cGAN	ICAART2020
Restoration	Exploiting Aliasing for Manga Restoration	CVPR2021	Github
Inpainting	Seamless Manga Inpainting with Semantics Awareness
Text Detection	Method for Real Time Text Extraction of Digital Manga Comic	IJIP2011
	CNN based Extraction of Panels/Characters from Bengali Comic Book Page Images	ICDARW2019
	Deep Learning-Based Classification of the Polar Emotions of “Moe”-Style Cartoon Pictures	TST2020
	Learning from the Past: Meta-Continual Learning withKnowledge Embedding for Jointly Sketch, Cartoon, andCaricature Face Recognition	MM2020
Landmark Detection	Facial Landmark Detection for Manga Images
Segmentation	Extraction of Frame Sequences in the Manga Context	2020 IEEE International Symposium on Multimedia (ISM)
Translation	Towards Fully Automated Manga Translation	AAAI2021
Depth Estimation	Estimating Image Depth in the Comics Domain	WACV2022
Vectorization	Vectorization of Raster Manga by Deep Reinforcement Learning
Re-identification	Unsupervised Manga Character Re-identification via Face-body and Spatial-temporal Associated Clustering

Representation Learning

Paper	Conference	Links
Illustration2Vec: A Semantic Vector Representation of Illustrations	SIGGRAPH2015	Github

Pose Estimation

Paper	Conference	Links
Pose Estimation of Anime/Manga Characters: A Case for Synthetic Data	MANPU2016
Transfer Learning for Pose Estimation of Illustrated Characters	WACV2022	Github

Image Retrieval

Paper	Conference	Links
Sketch-based Manga Retrieval using Manga109 Dataset	MTA2017
AugNet: End-to-End Unsupervised Visual Representation Learning with Image Augmentation		Github

Visual Correspondence

Paper	Conference	Links
Globally Optimal Toon Tracking	ACM Trans. Graph. 2016	HP

Character Recognition

Paper	Conference	Links
Object Detection for Comics using Manga109 Annotations
Progressive Deep Feature Learning for Manga Character Recognition via Unlabeled Training Data	ACM TURC2019
CNN based Extraction of Panels/Characters from Bengali Comic Book Page Images	ICDARW2019
Deep Learning-Based Classification of the Polar Emotions of “Moe”-Style Cartoon Pictures	TST2020
Learning from the Past: Meta-Continual Learning withKnowledge Embedding for Jointly Sketch, Cartoon, andCaricature Face Recognition	MM2020
Graph Jigsaw Learning for Cartoon Face Recognition
ACFD: Asymmetric Cartoon Face Detector	IJCAI2020
CAST: CHARACTER LABELING IN ANIMATION USING SELF-SUPERVISION BY TRACKING	EG2022
Open-Vocabulary DETR with Conditional Matching		Github
AniWho : A Quick and Accurate Way to Classify Anime Character Faces in Images
GCN-Based Multi-Modal Multi-Label Attribute Classification in Anime Illustration Using Domain-Specific Semantic Features	ICIP2022
Hierarchical Multi-Label Attribute Classification With Graph Convolutional Networks on Anime Illustration	IEEE Access2023

3D Character Creation

Paper	Conference	Links
Automatic Generation of 3D Natural Anime-like Non-Player Characters with Machine Learning	ICCW2020

Robotics

Paper	Conference	Links
Making Robots Draw A Vivid Portrait In Two Minutes

Speech Synthesis

Paper	Conference	Links
Comic-Guided Speech Synthesis	ACM Trans. Graph. 2019	HP

Adult Content Detection

Paper	Conference	Links
KidsGUARD: Fine Grained Approach for Child Unsafe Video Representation and Detection	ACM SAC2019	Github
An Evaluation of Traditional and CNN-Based Feature Descriptors for Cartoon Pornography Detection	IEEE Access2021
A Deep Learning-Based Approach for Inappropriate Content Detection and Classification of YouTube Videos	IEEE Access2022

Survey

Paper	Conference
A Survey of Comics Research in Computer Science
Computational Approaches to Comics Analysis
Image Colorization: A Survey and Dataset

Projects

Summary of github or other types of projects that are related to anime or manga except above.

Dataset

• Layered Temporal Dataset for Anime Drawings
• TRIGGER dataset

Representation Learning

• Classification and vectorization of key-frames and face characters of anime

Image Generation

• makegirlsmoe
• ANIME305/Anime-GAN-tensorflow
• jayleicn/AnimeGAN
• FangYang970206/Anime_GAN
• pavitrakumar78/Anime-Face-GAN-Keras
• forcecore/Keras-GAN-Animeface-Character
• tdrussell/IllustrationGAN
• m516825/Conditional-GAN
• bchao1/Anime-Generation
• Diffusion models
  • harubaru/waifu-diffusion
  • DGSpitzer/Cyberpunk-Anime-Diffusion
  • NovelAI
  • Stable Diffusion Models

Image-to-Image Tranlation

• Aixile/chainer-cyclegan
• SystemErrorWang/FacialCartoonization
• experience-ml/cartoonize
• racinmat/anime-style-transfer
• TachibanaYoshino/AnimeGANv2
• XiaoSanGit/Real2Animation-video-generation
• Avatar Artist Using GAN
• Generating Cartoon Style Facial Expressions with StackGAN

Automatic Line Art Colorization

• style2paints
• PaintsChainer
• Ugness/Line-Art-Colorization-SPADE
• sanjay235/Sketch2Color-anime-translation
• Pengxiao-Wang/Style2Paints_V3
• GANime: Generating Anime and Manga Character Drawings from Sketches
• Line Drawing Colorization

Character Animating

• Talking Head Anime from a Single Image
• Talking Head Anime from a Single Image 2: More Expressive
• Talking Head(?) Anime from a Single Image 3: Now the Body Too
• Neural Rendering with Attention: An Incremental Improvement for Anime Character Animation

Super Resolution

• waifu2x
• Anime4K
• goldhuang/SRGAN-PyTorch
• Real-CUGAN

Segmentation

• jerryli27/AniSeg
• zymk9/Yet-Another-Anime-Segmenter

Landmark Detection

• Anime face landmark detection by deep cascaded regression
• Anime Face Detector using mmdet and mmpose