Datahub custom API source

This repository integrates the Justice Data API with Datahub.

Prerequisites

Set up the Datahub CLI

Usage

This ingestion currently needs to be run via the Datahub CLI.

First run poetry shell to make sure this library is on the python path.

Then create recipe.yaml:

source:
  type: datahub_custom_api_source.source.JusticeDataAPISource
  config:
    base_url: "https://data.justice.gov.uk/api"

Finally, run datahub ingest -c recipe.yaml

See https://datahubproject.io/docs/how/add-custom-ingestion-source/ for more information.