New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-30578][SQL][TEST] Explicitly set conf to use DSv2 for orc in OrcFilterSuite #27285
Conversation
@@ -44,6 +46,11 @@ import org.apache.spark.sql.types._ | |||
*/ | |||
class OrcFilterSuite extends OrcTest with SharedSparkSession { | |||
|
|||
override protected def sparkConf: SparkConf = |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
shall we do the same for the one in v1.2?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
+1 for @cloud-fan 's comment.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Addressed for v1.2. Thanks!
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Please update the PR title and description accordingly.
Test build #117070 has finished for PR 27285 at commit
|
Test build #117064 has finished for PR 27285 at commit
|
retest this please |
Test build #117098 has finished for PR 27285 at commit
|
thanks, merging to master! |
thanks all @cloud-fan @dongjoon-hyun |
+1, late LGTM. Thanks! |
What changes were proposed in this pull request?
Explicitly set conf to let orc use DSv2 in
OrcFilterSuite
in both v1.2 and v2.3.Why are the changes needed?
Tests should not rely on default conf when they're going to test something intentionally, which can be fail when conf changes.
Does this PR introduce any user-facing change?
No.
How was this patch tested?
Pass Jenkins.