Skip to content

jaysara/spark-cobol-jay

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

28 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Using Cobrix with java.

I ran in to some version mismatch issues while running this project in my IDE and through spark-submit.

  • Use the pom.xml that is attached with this project.

  • Make sure you download the latest build for spark-cobo-2.6.5-bundle.jar from https://github.com/AbsaOSS/cobrix/releases/tag/v2.6.5

  • Make sure following command runs successfully,
    mvn clean install exec:exec

  • You can submit the command through spark-submit by passing the location of the spark-cobo-2.6.5-bundle.jar that you downloaded.

spark-submit --class com.test.cobol.App --jars ~/Downloads/spark-cobol_2.12-2.6.5-bundle.jar --master local target/spark-cobol-jay-1.0-SNAPSHOT.jar

Processing Variable Length ASCII file without LF/CR

  • The file FixedWidthApp.java demonstrate how you can process a variable length ascii file that has length of the record identified in the beginning of the file. The sample file is located at data/variable-length-file.txt

About

test spark program to use cobrix library

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages