Skip to content

jakeeqsb/EntreeETLPipeline_spark_streaming

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
EntreeETLPipeline
EntreeETLPipeline
 
 
EntreePipelineModel.xml
EntreePipelineModel.xml
 
 
README.md
README.md
 
 

Repository files navigation

EntreeETLPipeline_spark_streaming

screen shot 2018-04-03 at 2 07 46 am

To run the program

1. Run the zookeeper

zkServer start

2. Run the kafka

kafka-server-start <... server.properties>

3. Run the producer script

python3 EntreeKafkaProd.py

4. Run the pipeline script

spark-submit --jars <jars...> EntreePipeline.py

About

No description or website provided.

Topics

python kafka spark etl pyspark datapipeline sparkstreaming entree

Resources

Readme
Activity

Stars

1 star

Watchers

1 watching

Forks

0 forks
Report repository

Releases

No releases published

Packages

No packages published

Languages