Join GitHub today
GitHub is home to over 28 million developers working together to host and review code, manage projects, and build software together.Sign up
Welcome to the spark-testing-base wiki!
Project Main Modules:
SparkContextto be used in testing.
- RDDComparisons: Compares two RDDs.
- DataFrameSuiteBase: Checks for dataframe equality.
- DatasetSuiteBase: Checks for dataset equality.
- StreamingSuiteBase: Applies given operation on given input stream and compare with expected output.
- StreamingActionBase: Tests actions that don't have output on input streams.
- RDDGenerator: Generates arbitrary RDDs.
- DataFrameGenerator: Generates arbitrary DataFrames.
- DatasetGenerator: Generates arbitrary Datasets.
Clone this wiki locally
Press h to open a hovercard with more details.