pyspark-template

This is a pyspark project template

Describe here your project

This is a very simple HelloWorld example in pyspark.

Run the task 1 by submitting the task to spark-submit.

spark-submit main.py ./data/ 40000 results

Name		Name	Last commit message	Last commit date
Latest commit History 5 Commits
data		data
figures		figures
LICENSE		LICENSE
README.md		README.md
evaluation.py		evaluation.py
main.py		main.py
prep.py		prep.py
results.txt		results.txt
train.py		train.py