Images Classification Recipe
Convolutional Neural Networks (CNN) and Transfer Learning for Heritage Images Classification
This recipe exposes an image classification scenario, aiming to deduce the technique or genre of images (picture, drawing, map...) using a Convolutional Neural Networks trained model (supervised approach with transfer learning).
This recipe may have various library use cases, particularly for cataloguing and information retrieval systems.
This recipe is based on BnF materials
This recipes includes a basic introduction to neural networks and deep learning (formal neuron model, neural networks, convolutional neural networks, transfer learning) and a hands-on session:
- Creation of an images dataset for training
- Training of a classification model with commercial APIs or open source IA frameworks
- Application of the model to the heritage images to be classified
The IIIF standard API is leveraged to extract images from digital repositories, but raw files may also be used.
For the theory, see the BnF github for a 45 mn introduction course (FR and EN versions, direct link).
Prerequisites: IBM Watson Studio account or Google Cloud AutoML account (see the setup document)
A 4 classes scenario dataset (picture/drawing/map/noise) can be downloaded here, but it's up to you to build your own use case.
IBM Watson Studio and Google Cloud AutoML have been tested and this howto documents the setup of a new user account and the creation of a visual recognition project for both platforms.
The following steps suppose you are using Watson Studio, but the Google AutoML case is very similar.
Once Watson Studio web app is launched, choose the "Classify Images" custom model to create your new classification project.
In the platform
Outside the platform, using code
Prerequisites: basic scripting and command line skills (Python scripts are used)
https://cloud.google.com/vision/automl/docs/beginners-guide?hl=en ...