Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support UDTF (user defined tabular functions) #1830

Open
miguno opened this issue Sep 5, 2018 · 0 comments

Comments

@miguno
Copy link
Member

commented Sep 5, 2018

In this ticket, we want to allow KSQL users to create their own tabular functions via UDTFs, similar to the existing support for UDFs and UDAFs.

Functions such as EXPLODE (not yet supported out of the box) are examples of functions in the UDTF category. Another example is flatMap in the Kafka Streams DSL and in Scala.

UDTF vs. UDF vs. UDAF

What's the difference between UDF (supported since 5.0), UDAF (supported since 5.0), and UDTF?

  • UDF: user defined function (ex: SUBSTRING)
    • Takes 1 input record, produces 1 output record
  • UDAF: user defined aggregate function (ex: SUM, COUNT)
    • Takes N input records, produces 1 output record
  • UDTF (this ticket): user defined tabular function
    • Takes 1 input record, produces 0,1, or N output records

Related tickets

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
1 participant
You can’t perform that action at this time.