Skip to content
Adrian Wilke edited this page Jun 24, 2020 · 5 revisions

Development notes for the OPAL converter component

Architecture

architecture

The configuration of used queues (bindings) can be found in converter-configuration.

Configuration

Starting locally

  • If you also run the opaldata component locally, both components want to use the Elasticsearch port 9200. To handle this, change that port in docker-compose.yml.
  • Comments on the configuration can be found in Issue 12.

Reading data

  • dataset-fetcher uses the variables starting with CRAWLER_TRIPLESTORE_
  • dataset-file-fetcher uses the variable DATASET_FOLDER
Clone this wiki locally