Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[SPARK-5579][SQL][DataFrame] Support for project/filter using SQL expressions #4348

Closed
wants to merge 3 commits into from
Closed

[SPARK-5579][SQL][DataFrame] Support for project/filter using SQL expressions #4348

wants to merge 3 commits into from

Commits on Feb 4, 2015

  1. [SPARK-5578][SQL][DataFrame] Provide a convenient way for Scala users… 

    … to use UDFs

A more convenient way to define user-defined functions.

Author: Reynold Xin <rxin@databricks.com>

Closes apache#4345 from rxin/defineUDF and squashes the following commits:

639c0f8 [Reynold Xin] udf tests.
0a0b339 [Reynold Xin] defineUDF -> udf.
b452b8d [Reynold Xin] Fix UDF registration.
d2e42c3 [Reynold Xin] SQLContext.udf.register() returns a UserDefinedFunction also.
4333605 [Reynold Xin] [SQL][DataFrame] defineUDF.
    @rxin
    rxin committed Feb 4, 2015
    Configuration menu
    Copy the full SHA
    1077f2e View commit details
    Browse the repository at this point in the history

  2. [SPARK-5579][SQL][DataFrame] Support for project/filter using SQL exp… 

    …ressions.

e.g.

df.selectExpr("abs(colA)", "colB")

df.filter("age > 21")
    @rxin
    rxin committed Feb 4, 2015
    Configuration menu
    Copy the full SHA
    b416372 View commit details
    Browse the repository at this point in the history

  3. Fix Python.

    @rxin
    rxin committed Feb 4, 2015
    Configuration menu
    Copy the full SHA
    2baeef2 View commit details
    Browse the repository at this point in the history