Skip to content

Release of streamsx.hdfs toolkit Version 5.0.0
Compare
Choose a tag to compare
@anouri anouri released this 02 Sep 14:52
v5.0.0
b59b518

Release of streamsx.hdfs toolkit Version 5.0.0

What is new in version 5.0.0

  • The streamsx.hdfs toolkit has been improved with a new operator HDFS2FileCopy.

    HDFS2FileCopy copies files in to directions:
    copyFromLocalFile : Copies a file from local disk to the HDFS file system.
    copyToLocalFile : Copies a file from HDFS file system to the local disk.

  • It supports also two new parameters for all operators:
    credentials : credentials is a JSON string that contains key/value pairs for user , password and webhdfs .
    appConfigName : Streams application configuration that support credentials. And credentials is a JSON string that contains user, password and webhdfs.

  • Adapting of streamsx.hdfs to support HDP 2.x and HDP 3.x file systems.

  • Adapting of com.ibm.streamsx.hdfs.client.webhdfs java package to support knox HttpURLConnection.

  • The pom.xml file has been upgraded to use Hadoop version 3.1.0 libraries.

Assets 4