Skip to content
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.


Type Name Latest commit message Commit time
Failed to load latest commit information.
requirements.txt first commit Jun 14, 2018 first commit Jun 14, 2018


This project showcases how we can use pytest to create unit test cases for pyspark application

The spark application analyses flight data to create an ordered list of the flights with maximum times late arrivals.

Pytest fixtures are used to create spark sessions and supplied them automatically to the pipeline unit cases. Some of the important files are:

  1. : Defines the spark pytest fixture with module scope
  2. : creates dataframes used for the unit test cases

unit test can be run as: pytest

You can’t perform that action at this time.