Skip to content

[SPARK-44343][CONNECT] Prepare ScalaReflection to the move to SQL/API#41920

Closed
hvanhovell wants to merge 1 commit intoapache:masterfrom
hvanhovell:SPARK-44343
Closed

[SPARK-44343][CONNECT] Prepare ScalaReflection to the move to SQL/API#41920
hvanhovell wants to merge 1 commit intoapache:masterfrom
hvanhovell:SPARK-44343

Conversation

@hvanhovell
Copy link
Contributor

What changes were proposed in this pull request?

This PR moves all catalyst specific internals out of ScalaReflection into other catalyst classes:

  • Serializer Expression Generation is moved to SerializerBuildHelper.
  • Deaerializer Expression Generation is moved to DeserializerBuildHelper.
  • Common utils are moved to EncoderUtils.

Why are the changes needed?

We want to use ScalaReflection based encoder inference both for SQL/Core and Connect.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Existing tests.

@hvanhovell
Copy link
Contributor Author

cc @amaliujia

@github-actions github-actions bot added the SQL label Jul 10, 2023
@hvanhovell
Copy link
Contributor Author

Merging.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

Comments