Skip to content

Latest commit

 

History

History

1-Functional-Programming-Data_Wrangling-Spark

Folders and files

NameName
Last commit message
Last commit date

parent directory

..

.ipynb_checkpoints

.ipynb_checkpoints

 
 

data

data

 
 

1_procedural_vs_functional_in_python.ipynb

1_procedural_vs_functional_in_python.ipynb

 
 

2_spark_maps_and_lazy_evaluation.ipynb

2_spark_maps_and_lazy_evaluation.ipynb

 
 

3_data_inputs_and_outputs.ipynb

3_data_inputs_and_outputs.ipynb

 
 

4_data_wrangling.ipynb

4_data_wrangling.ipynb

 
 

6_dataframe_quiz_solution.ipynb

6_dataframe_quiz_solution.ipynb

 
 

7_data_wrangling-sql.ipynb

7_data_wrangling-sql.ipynb

 
 

8_spark_sql_quiz-Copy1.ipynb

8_spark_sql_quiz-Copy1.ipynb

 
 

8_spark_sql_quiz.ipynb

8_spark_sql_quiz.ipynb

 
 

9_spark_sql_quiz_solution.ipynb

9_spark_sql_quiz_solution.ipynb

 
 

README.md

README.md

 
 

exercise.ipynb

exercise.ipynb

 
 

README.md

Data Wrangling with Functional Programming

Under the hood, spark is written with a functional programming language called scala

PySpark

Pyspark is a python API that was created to help interface with spark using the ame functional programming architecture.


# Install pyspark from pip
pip install pyspark