Code, demos and data for SketchParse (a neural network for sketch segmentation). Paper:
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
exp-src
retrieval-src
valsketch
.gitignore
LICENSE
README.md
SketchLab-sketches-qualitative-results-ACMMM.svg
model.svg

README.md

sketch-parse

This repository contains code and additional material for our paper titled "SketchParse: Towards Rich Descriptions For Poorly Drawn Sketches Using Multi-Task Deep Networks", ACM Multimedia (ACMMM) 2017.

This is a neural network for (semantic) sketch segmentation. Use it to associate semantics with your freehand sketches!

Results

The four panels are chosen from the 100th, 75th, 50th, 25th percentile accuracy of segmentation (by IoU) respectively. As you can see, even in (relatively) bad cases, we can provide fairly accurate segmentations!

Model

We have a multi-task deep neural network that can segment freehand sketches as well as predict a global pose:

Results

Contents

Requirements

This code was developed and tested on an Ubuntu 14.04 machine with python 2.7 and pyTorch (v0.1.12). We used an NVIDIA TITAN X for training and evaluating our model.

If you use this work, please cite the paper:

SketchParse: Towards Rich Descriptions For Poorly Drawn Sketches Using Multi-Task Deep Networks

Questions ?