pyspark-testing is testing framework for pyspark
pyspark-testing is available at the PyPI
# PyPI $ pip install pyspark-testing
from pyspark_testing import assert_dateframe_equal
def test_sample():
data = [('sample', 1)]
left = spark.createDataFrame(data)
right = spark.createDataFrame(data)
assert_dataframe_equal(left, right)
MIT License (see LICENSE).