CKAN Resource uploader for Pentaho Data Integration (Kettle)
Switch branches/tags
Nothing to show
Clone or download
Pull request Compare This branch is 13 commits ahead, 1 commit behind OpenGov-OpenData:master.
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
source
steps/ckan-updater-plugin
LICENSE
README.md
_config.yml
package.bat
pom.xml

README.md

CKAN-Resource-Updater-for-Pentaho-Data-Integration

CKAN Resource Updater for Pentaho Data Integration (Kettle)

Installation

Copy the files below to their respective folders under the Pentaho Data Integration installation directory:

  • ../data-integration/plugins/steps/ckan-updater-plugin/ckan_ckanUpdater.jar
  • ../data-integration/plugins/steps/ckan-updater-plugin/ckan_logo.png
  • ../data-integration/plugins/steps/ckan-updater-plugin/plugin.xml
  • ../data-integration/plugins/steps/ckan-updater-plugin/lib/commons-logging-1.2.jar
  • ../data-integration/plugins/steps/ckan-updater-plugin/lib/gson-2.2.jar
  • ../data-integration/plugins/steps/ckan-updater-plugin/lib/httpclient-4.2.jar
  • ../data-integration/plugins/steps/ckan-updater-plugin/lib/httpcore-4.2.jar
  • ../data-integration/plugins/steps/ckan-updater-plugin/lib/httpmime-4.2.jar
  • ../data-integration/plugins/steps/ckan-updater-plugin/lib/jsoup-1.8.1.jar

User Guide

The CKAN Resource Updater plugin allows users to upload tabular data to a CKAN data portal. Drag and drop the CKAN DataStore Upload step from the output category to the workspace. Link another step to the CKAN Resource Resource step to upload the output of the previous step.

Options

To create an new resource provide a valid Package ID and omit the Resource ID

Option Description
Step name Name of the step. This name should be unique in a single transformation.
Domain The domain of the CKAN data portal to which data will be uploaded. (eg: http://demo.ckan.org)
API Key Users can find their API key in their user profile on the CKAN data portal.
Package ID The ID of an existing package where data will be uploaded in a DataStore resource. (eg: test-dataset)
Resource Title The title of the resource.
Description A short description about the resource. (optional)
Resource ID The ID of an existing DataStore resource to update. If left empty a new DataStore resource will be made.

PDI Sample Transformation

You can find an article (spanish) in our blog: http://blog.localidata.com/2017/07/como-actualizar-recursos-de-ckan-traves.html