[SPARK-38405][SQL] Supports customization of the entire optimizer and planner#35721
[SPARK-38405][SQL] Supports customization of the entire optimizer and planner#35721chenjunbiao001 wants to merge 1 commit intoapache:masterfrom
Conversation
|
Can one of the admins verify this patch? |
| val catalogManagerTypeName = Class.forName("org.apache.spark.sql.connector.catalog.CatalogManager") | ||
| val sessionCatalogTypeName = Class.forName("org.apache.spark.sql.catalyst.catalog.SessionCatalog") | ||
| val experimentalMethodsTypeName = Class.forName("org.apache.spark.sql.ExperimentalMethods") | ||
| val optimizerInstance = Class.forName(optimizerClassName).getConstructor(catalogManagerTypeName, sessionCatalogTypeName, experimentalMethodsTypeName).newInstance(catalogManager, catalog, experimentalMethods) |
There was a problem hiding this comment.
file line length exceeds 100 characters on line 247,248,250 and 304
There was a problem hiding this comment.
@chenjunbiao001 @nyingping Could we use spark.sql.extensions to add custom optimizer rules?
| override def preCBORules: Seq[Rule[LogicalPlan]] = | ||
| super.preCBORules ++ customPreCBORules | ||
| override def preCBORules: Seq[Rule[LogicalPlan]] = | ||
| super.preCBORules ++ customPreCBORules |
There was a problem hiding this comment.
nit. redundant space on line 257,258.
|
It might be clearer if the PR title could be changed to : PR description may be in the default format to make the community better understand your intention. What changes were proposed in this pull request?Why are the changes needed?Does this PR introduce any user-facing change?How was this patch tested?Please open GA in your fork repository |
chenjunbiao001
changed the title
|
We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue manageable. |
|
这是来自QQ邮箱的假期自动回复邮件。
您好，邮件已收到，感谢您的来信！
|
4 participants
linked to issue:https://issues.apache.org/jira/browse/SPARK-38405