A simple transformation/data processing pipeline for CrisisNET. Pulls jobs from a FIFO queue and runs each through a series of predefined tasks. These tasks add metadata to content retrieved by Sucka.
New tasks can be added to the
tasks package, and included in the pipeline in
Very much a work in progress. Watch this space.