Student Name: Aadit Barua
Student UT EID: ab68445
Student Name: Daniel Lim
Student UT EID: dwl667
Student Name: Bruce Fan
Student UT EID: bxf64
Student Name: Kous Nyshadham
Student UT EID: kn8794
This is a very simple HelloWorld example in pyspark.
If your assignment has 3 tasks you need to commit the 3 scripts only and overwrite them. You can then delete the script number 4 ( main_task4.py )
If your assignment has 4 tasks then you can use all of them.
You can write your task description in this Markdown file or You can generate PDF file and added to the doc/ folder of your repository.
Please note in your README.md file where your task description file is.
Run the task 1 by submitting the task to spark-submit.
spark-submit main_task1.py spark-submit main_task2.py spark-submit main_task3.py