Skip to content

Commit

Permalink
Merge pull request #4 from caiomsouza/master
Browse files Browse the repository at this point in the history
Added a PDI Sample Transformation to demo the plugin
  • Loading branch information
Joel Natividad committed Jul 10, 2017
2 parents bbc7af1 + 3ec5632 commit 06ba579
Show file tree
Hide file tree
Showing 16 changed files with 642 additions and 0 deletions.
2 changes: 2 additions & 0 deletions .gitignore
@@ -0,0 +1,2 @@

marketplace.xml
18 changes: 18 additions & 0 deletions README.md
Expand Up @@ -35,3 +35,21 @@ To create an new Datastore resource provide a valid Package ID and omit the Reso
| Resource ID |The ID of an existing DataStore resource to update. If left empty a new DataStore resource will be made. |
| Batch Size |The writer will upload rows of data in batches of this amount. (default: 5000) |
| Primary Key |If a Primary Key is specified then data will be upserted instead of inserted. Multiple fields can be specified as the Primary Key, use double semicolons to delineate the fields (eg: field1;;field2) |

### PDI Sample Transformation
http://blog.professorcoruja.com/2017/06/unlock-your-data-using-pdi-and-ckan-pdi.html

### Install the plugin using your own PDI Marketplace

The way to override the metadata url is to edit system/karaf/etc/pentaho.marketplace.di.cfg <BR>
And change the value of the marketplace.site property.<BR>

Change to: <BR>
marketplace.site = https://raw.githubusercontent.com/caiomsouza/marketplace-metadata/master/marketplace.xml<BR>

and then start PDI.<BR>

### Publish Plugin to Official PDI Markeplace

I created an issue asking the authors to publish it to Official PDI Markeplace<BR>
https://github.com/OpenGov-OpenData/CKAN-DataStore-Writer-for-Pentaho-Data-Integration/issues/1
@@ -0,0 +1,17 @@
#
# URL for the plugins xml metadata file used by marketplace
#
# marketplace.site = http://marketplace.pentaho.com/marketplace-plugins.xml
#

marketplace.site = https://raw.githubusercontent.com/caiomsouza/marketplace-metadata/master/marketplace.xml

#
# URL for the telemetry service
#
telemetry.site = http://marketplace.pentaho.com/telemetry-servlet/telemetry

#
# Whether marketplace should send telemetry information or not
#
telemetry.enabled = true
17 changes: 17 additions & 0 deletions pdi-example/README.md
@@ -0,0 +1,17 @@
# Unlock your data using PDI and CKAN PDI Plugin

Data is the new bacon and open data is the future for a better world.<BR>

Today I want to share an easy way to share data using PDI to CKAN Data Platform.<BR>

Use case:<BR>
- Organizations want to share one or more dataset(s) in an automatic way to CKAN, the world’s leading Open Source data portal platform.

Solution:<BR>
- PDI - Pentaho Data Integration
- CKAN
- CKAN-DataStore-Writer-for-Pentaho-Data-Integration Plugin
- [Simple transformation](https://github.com/caiomsouza/CKAN-DataStore-Writer-for-Pentaho-Data-Integration/blob/master/pdi-example/src/t_ckan_pdi_plugin_test_github_example.ktr)

Read the blog to learn more:<BR>
http://blog.professorcoruja.com/2017/06/unlock-your-data-using-pdi-and-ckan-pdi.html<BR>
Binary file added pdi-example/img/CKAN01.PNG
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added pdi-example/img/CKAN02.PNG
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added pdi-example/img/CKAN03.PNG
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added pdi-example/img/CKAN04.PNG
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added pdi-example/img/CKAN05.PNG
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added pdi-example/img/CKAN06.PNG
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added pdi-example/img/CKAN07.PNG
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added pdi-example/img/CKAN08.PNG
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added pdi-example/img/CKAN09.PNG
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added pdi-example/img/CKAN10.PNG
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added pdi-example/img/CKAN11.PNG
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit 06ba579

Please sign in to comment.