Skip to content

[FLINK-37076][table-planner] Support PTFs until ExecNode level#26019

Merged
twalthr merged 1 commit intoapache:masterfrom
twalthr:FLINK-37076_2
Jan 21, 2025
Merged

[FLINK-37076][table-planner] Support PTFs until ExecNode level#26019
twalthr merged 1 commit intoapache:masterfrom
twalthr:FLINK-37076_2

Conversation

@twalthr
Copy link
Contributor

@twalthr twalthr commented Jan 20, 2025

What is the purpose of the change

This implements a first skeleton for integrating PTFs into the planner. The PR prepares the code base for implementing a corresponding StreamExecNode.

It also prepares the CompiledPlan but concrete RestoreTests will follow.

Brief change log

  • Integration into changelog inference
  • Adjust rules for both constant and non-constant table functions
  • Implement physical rel node

Verifying this change

This change added tests and can be verified as follows: ProcessTableFunctionTest

Does this pull request potentially affect one of the following parts:

  • Dependencies (does it add or upgrade a dependency): no
  • The public API, i.e., is any changed class annotated with @Public(Evolving): yes
  • The serializers: no
  • The runtime per-record code paths (performance sensitive): no
  • Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: no
  • The S3 file system connector: no

Documentation

  • Does this pull request introduce a new feature? yes
  • If yes, how is the feature documented? JavaDocs

@flinkbot
Copy link
Collaborator

flinkbot commented Jan 20, 2025

CI report:

Bot commands The @flinkbot bot supports the following commands:
  • @flinkbot run azure re-run the last Azure build

@twalthr twalthr force-pushed the FLINK-37076_2 branch 2 times, most recently from 2dbf7e5 to 284ff25 Compare January 20, 2025 11:39
* limitations under the License.
*/

package org.apache.flink.table.planner.plan.nodes.physical.stream;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sorry I forgot to mention
the same issue with this class (it is in scala/* folder)

* limitations under the License.
*/

package org.apache.flink.table.planner.plan.nodes.physical.stream;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sorry I forgot to mention
the same issue with this class (it is in scala/* folder)

@twalthr
Copy link
Contributor Author

twalthr commented Jan 20, 2025

@flinkbot run azure

@snuyanzin
Copy link
Contributor

fyi: the failure seems to be fixed in later commits 1afe645

rebase might help

@twalthr
Copy link
Contributor Author

twalthr commented Jan 20, 2025

@flinkbot run azure

@twalthr
Copy link
Contributor Author

twalthr commented Jan 21, 2025

@flinkbot run azure

@twalthr twalthr merged commit 5749a07 into apache:master Jan 21, 2025
ryanvanhuuksloot pushed a commit to ryanvanhuuksloot/flink that referenced this pull request Feb 19, 2025
Au-Miner pushed a commit to Au-Miner/flink that referenced this pull request Feb 23, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants