Skip to content

NorthConcepts/DataPipeline-Examples

master
Switch branches/tags

Name already in use

A tag already exists with the provided branch name. Many Git commands accept both tag and branch names, so creating this branch may cause unexpected behavior. Are you sure you want to create this branch?
Code

Latest commit

 

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

DataPipeline Examples

This repo contains DataPipeline's Java code examples. These are the same examples you get when you download DataPipeline and requires a license to run.

DataPipeline License

  1. You can get your free trial license here: https://northconcepts.com/contact/try/small-business/.
  2. Once you receive your license by email, place the attached NorthConcepts-DataPipeline.license file from the email into the src/main/resources folder.
  3. Start running the examples.

Setting up development environment

Developers on Windows need to

  1. Have the HADOOP_HOME environment variable set
  2. Add %HADOOP_HOME%\bin to PATH in my environment variable

See the following info:

Running Examples

This repo relies on the Gradle tool for build automation. It also contains project files for the Eclipse IDE.

Eclipse

Inside Eclipse, you can right-click any example and select Run As --> Java Application.

Command Line / Gradle

You can also run examples with the following Gradle command. Just replace com.northconcepts.datapipeline.examples.cookbook.WriteACsvFileToFixedWidth with the example you want to run.

./gradlew run --quiet -PclassToExecute="com.northconcepts.datapipeline.examples.cookbook.WriteACsvFileToFixedWidth"

Data

Most examples read from the example/data/input folder and write to example/data/output.

DataPipeline Resources

About

DataPipeline Examples

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages