streamsx.hdfs

This toolkit provides operators and functions for interacting with Hadoop File System.

Releases

HDFS Toolkit v4.5.0 is officially released to support IBM Streams on IBM Cloud:

• https://github.com/IBMStreams/streamsx.hdfs/releases

Changes

CHANGELOG.md

Demos and Samples

Check out the binary read / write support!

• https://github.com/IBMStreams/streamsx.hdfs/tree/develop/demos/HDFSBinary
• https://github.com/IBMStreams/streamsx.hdfs/tree/develop/samples/CompressedHdfsFiles

Check out the Cloud sample!

• https://github.com/IBMStreams/streamsx.hdfs/wiki/How-to-connect-to-IAE-via-HDFS-Toolkit

Kerberos configuration:

• https://github.com/IBMStreams/streamsx.hdfs/wiki/How-to-use-kerberos-authentication-in-streamsx.hdfs-toolkit

Getting started with development

• https://github.com/IBMStreams/streamsx.hdfs/wiki/Getting-Started-with-Developing-HDFS-Toolkit

• Messages and National Language Support for toolkits

Main Site:

• http://ibmstreams.github.io/streamsx.hdfs/

To learn more about Streams:

• IBM Streams on Github
• Introduction to Streams Quick Start Edition
• Streams Getting Started Guide

To learn more about Apache HDFS and Hadoop WebHDFS REST API:

• Apache HDFS User Guide
• Hadoop WebHDFS REST API