Overview

This application generates your favorite anime character by using multiple machine learning algorithms (GANs, AutoEncoder, I2V).

Tools

Machine Learning: PyTorch

Application: Flask / MySQL / NGINX / uWSGI / Docker

Infrastructure: AWS / Docker

Machine Learning Algorithms

• Use multiple meachine learning algorithms for generating images, recommender system, and tag extraction.

SNGAN

• Use SNGAN (Spectral Normalized GAN) for generating high quality images.

• Code -> ml_infra/machine_learning/sngan

Auto Encoder

• Use customized Auto Encoder model for image retrieval (image to image recommendation).

• AutoEncoder extracts feature of image and calculates similarity between submitted ones and generated ones.

• Code -> ml_infra/machine_learning/auto_encoder

Illustration2Vec

• Illustration2Vec is the VGG based image classifier to predict tags (hair color, eye color...).

• This model enables tag based recommendation.

• Paper -> https://dl.acm.org/doi/abs/10.1145/2820903.2820907

• Code -> https://github.com/rezoo/illustration2vec

Machine Learning Infrastructure

• Use AWS for automaticaly and efficiently training models.

• Most process are described with boto3 and its high level API (e.g. Step Functions Data Science SDK).

• Codes -> app/

Web Application