Skip to content
SageMaker Groundtruth custom workflow
Python JavaScript HTML CSS Shell
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Type Name Latest commit message Commit time
Failed to load latest commit information.
server minor change in Lambda Role May 20, 2019
.gitignore reorganizations of project Mar 14, 2019

Build your own custom labeling workflow using SageMaker Ground Truth

Successful machine learning models are built on the shoulders of large volumes of high-quality training data, but the process to create the training data necessary to build these models is expensive, complicated, and time-consuming. The majority of models created today require a human to manually label data in a way that allows the model to learn how to make correct decisions.

Amazon SageMaker Ground Truth provides built-in workflows for image classification, bounding boxes, text classification, and semantic segmentation use cases. You also have the option of building your own custom workflows where you define the user interface (UI) for performing data labeling. To help you move quickly, SageMaker provides you a number of commonly used custom UI templates for image, text, and audio data labeling use cases. These templates take advantage of SageMaker Ground Truth’s crowd HTML elements that are meant to simplify the process of building data labeling UIs. You can also specify your own arbitrary HTML for the UI.

You may need to build custom workflow for various reasons, such as:

  • Your own custom data labeling requirements
  • Complex input consisting of multiple elements per task (e.g., images, text, or custom metadata)
  • Dynamic decision making on task input to prevent certain items from going to labelers
  • Custom logic for consolidating labeling output to improve labeling accuracy

In this blog post, we demonstrate a custom text annotation labeling workflow to build labelled dataset for Natural language processing (NLP) problem

Augumented Manifest

server/data/manifest.json server/data/mini_manifest.json

Script to extract text using Amazon Textract


Script to create Manifest


Cloudformation script to deploy Lambda


Pre and post labeling lambdas

server/processing/ server/processing/

React Components

web/ web/package.json web/src/App.css web/src/App.js web/src/App.test.js web/src/index.css web/src/index.js web/public/index.html web/public/manifest.json web/public/template.html web/publuc/test_template.html

You can’t perform that action at this time.