Skip to content

amalaj7/Pyspark-Notes

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

17 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Prerequisite : For you to execute these notebooks, you have to setup the Pyspark in Local Mode or you can log in to Databricks Platform and execute in their environment.

You can refer the below blog to setup the local mode installation and to execute programs in jupyter notebook.

https://sigdelta.com/blog/how-to-install-pyspark-locally/

For Architecture and Documentation

Refer This Link For Detailed Architecture of Pyspark => SparkTutorial

You can also refer the official documentation of Spark(I'm using 3.0.2) => officalDoc

Releases

No releases published

Packages

No packages published