Detailed code for basic operations of pyspark
In order to use this file.
- You need to have spark installed and set up in your machine. If you have installed you can check it using 'spark' command.
- You can check pyspark installation by simply running 'pyspark' command. This should also open Spark UI.
- You can run the file using 'spark-submit pyspark101.py'.