Spark data generator
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
.idea
src/main/java/com/otterinasuit/spark/datagenerator
.gitignore
HbaseRecords.iml
README.md
dependency-reduced-pom.xml
pom.xml

README.md

Spark data generator

Spark example for my blog article "Update an HBase table with Hive... or sed": https://otter-in-a-suit.com/blog/?p=12

Build

mvn clean install

Run

cd target spark-submit \ --class com.otterinasuit.spark.datagenerator.Main \ --master localhost:9000 \ --deploy-mode client \ CreateTestHBaseRecords-1.0-SNAPSHOT.jar \ 2000000 \ # number of records 4 # threads