Unit Testing in Pyspark

Unit testing is a software testing technique where individual units or components of a software application are tested in isolation to ensure they function correctly. A unit typically refers to the smallest testable part of an application, such as a function, method, or class.

Full Description:

Important Files

• Business Logic: pyspark_unit_testing/business_logic_features/grades.py
• Test Data: test_data/test_data.csv
• Using unittest: pyspark_unit_testing/grade_unittest.py
• Using pytest: pyspark_unit_testing/grade_pytest.py