CKAN Harvester

Installation

npm install -g '52North/ckan-harvester'

ckan-harvester uses bunyan as the logging component. The JSON output of bunyan can be best viewed using the bunyan CLI tool:

npm install -g bunyan

Configuration

Call ckan-harvester with the path to a JSON configuration file as the first argument. E.g. ckan-harvester /etc/ckan-harvester.json.

Default Configuration Options

{
  "logging": {
    "level": "info"
  },
  "harvester": {
    "ckan": {
      "enabled": false,
      "url": "http://demo.ckan.org",
      "updateInterval": 0,
      "rowsPerRequest": 500
    },
    "domains": []
  }
}

Logging

You can use bunyan configuration options in the settings:

{
  "logging": {
    "level": "info",
    "type": "rotating-file",
    "path": "/var/log/ckan-harvester.log",
    "period": "1d",
    "count": 3
  }
}