Release standardized dataframe after its saving in the combined job #1968
Labels
Conformance
Conformance Job affected
feature
New feature
priority: high
Critical to the health of the project
Standardization
Standardization Job affected
Background
When running Standardization and Conformance in one go, the standardized data remain cached even when already in conformance phase of processing.
Feature
Release standardized dataframe after its saving in the combined job
Proposed Solution [Optional]
User
DataFrame.unpersist()
method.The text was updated successfully, but these errors were encountered: