pyspark-tutorial

A diary of my learning journey into the world of Apache Spark (pyspark) from an developer (Data Engineering) perspective

To follow my journey you will need:

My learning path:

Name		Name	Last commit message	Last commit date
Latest commit History 1 Commit
data		data
screenshots		screenshots
LICENSE		LICENSE
Pipfile		Pipfile
Pipfile.lock		Pipfile.lock
README.md		README.md
day-001_installing_local_spark_environment		day-001_installing_local_spark_environment
day-002_my_first_spark_applications_and_basic_concepts.ipynb		day-002_my_first_spark_applications_and_basic_concepts.ipynb
day-003_deeper_insight_into_dataframes.ipynb		day-003_deeper_insight_into_dataframes.ipynb
day-004_pyspark_sql_module_overview.ipynb		day-004_pyspark_sql_module_overview.ipynb
day-005_doing_some_math.ipynb		day-005_doing_some_math.ipynb
day-006_the_date_and_time_challenge.ipynb		day-006_the_date_and_time_challenge.ipynb
day-007_null_problems.ipynb		day-007_null_problems.ipynb
day-008_complex_types_analysing_unstructured_data.ipynb		day-008_complex_types_analysing_unstructured_data.ipynb
day-009_joins.ipynb		day-009_joins.ipynb
day-010_connectors.ipynb		day-010_connectors.ipynb
day-011_catalog_and_tables.ipynb		day-011_catalog_and_tables.ipynb

Provide feedback