Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects #28983

Closed
wants to merge 19 commits into from
Closed

[SPARK-32159][SQL] Fix integration between Aggregator[Array[_], _, _] and UnresolvedMapObjects #28983

wants to merge 19 commits into from

Commits on Jul 2, 2020

  1. fix SPARK-32159 - intercept null function in MapObjects

    @erikerlandson
    erikerlandson committed Jul 2, 2020
    Configuration menu
    Copy the full SHA
    1a501d9 View commit details
    Browse the repository at this point in the history

Commits on Jul 5, 2020

  1. revert println

    @erikerlandson
    erikerlandson committed Jul 5, 2020
    Configuration menu
    Copy the full SHA
    73299e8 View commit details
    Browse the repository at this point in the history

  2. add informative exception for null function

    @erikerlandson
    erikerlandson committed Jul 5, 2020
    Configuration menu
    Copy the full SHA
    20012b3 View commit details
    Browse the repository at this point in the history

  3. move resolution of ScalaAggregator inputEncoder to new rule ResolveEn… 

    …codersInScalaAgg
    @erikerlandson
    erikerlandson committed Jul 5, 2020
    Configuration menu
    Copy the full SHA
    a8dd23d View commit details
    Browse the repository at this point in the history

  4. add ResolveEncodersInScalaAgg rule to TestHive

    @erikerlandson
    erikerlandson committed Jul 5, 2020
    Configuration menu
    Copy the full SHA
    bc2d880 View commit details
    Browse the repository at this point in the history

  5. add unit test for array input type

    @erikerlandson
    erikerlandson committed Jul 5, 2020
    Configuration menu
    Copy the full SHA
    399cbab View commit details
    Browse the repository at this point in the history

Commits on Jul 6, 2020

  1. add ResolveEncodersInScalaAgg rule to HiveSessionStateBuilder

    @erikerlandson
    erikerlandson committed Jul 6, 2020
    Configuration menu
    Copy the full SHA
    2139c14 View commit details
    Browse the repository at this point in the history

  2. revert session extension in TestHive

    @erikerlandson
    erikerlandson committed Jul 6, 2020
    Configuration menu
    Copy the full SHA
    2092b3a View commit details
    Browse the repository at this point in the history

  3. revert spacing

    @erikerlandson
    erikerlandson committed Jul 6, 2020
    Configuration menu
    Copy the full SHA
    ac22ccf View commit details
    Browse the repository at this point in the history

Commits on Jul 7, 2020

  1. revert space

    @erikerlandson
    erikerlandson committed Jul 7, 2020
    Configuration menu
    Copy the full SHA
    1351b76 View commit details
    Browse the repository at this point in the history

  2. move jira into test name

    @erikerlandson
    erikerlandson committed Jul 7, 2020
    Configuration menu
    Copy the full SHA
    e923d2f View commit details
    Browse the repository at this point in the history

  3. add comment to new rule

    @erikerlandson
    erikerlandson committed Jul 7, 2020
    Configuration menu
    Copy the full SHA
    a4858d5 View commit details
    Browse the repository at this point in the history

  4. make ResolveEncodersInScalaAgg an object

    @erikerlandson
    erikerlandson committed Jul 7, 2020
    Configuration menu
    Copy the full SHA
    d3c5d4d View commit details
    Browse the repository at this point in the history

  5. add bufferEncoder as a parameter to ScalaAggregator to make resolutio… 

    …n easier
    @erikerlandson
    erikerlandson committed Jul 7, 2020
    Configuration menu
    Copy the full SHA
    814956c View commit details
    Browse the repository at this point in the history

  6. test Array type with input, buffer and output encoders

    @erikerlandson
    erikerlandson committed Jul 7, 2020
    Configuration menu
    Copy the full SHA
    aca7b51 View commit details
    Browse the repository at this point in the history

Commits on Jul 8, 2020

  1. more detail on array test name

    @erikerlandson
    erikerlandson committed Jul 8, 2020
    Configuration menu
    Copy the full SHA
    e679c01 View commit details
    Browse the repository at this point in the history

  2. add type link to scaladoc

    @erikerlandson
    erikerlandson committed Jul 8, 2020
    Configuration menu
    Copy the full SHA
    c632437 View commit details
    Browse the repository at this point in the history

  3. improved exception message and corresponding comments

    @erikerlandson
    erikerlandson committed Jul 8, 2020
    Configuration menu
    Copy the full SHA
    ee96cc0 View commit details
    Browse the repository at this point in the history

  4. too much 'an'

    @erikerlandson
    erikerlandson committed Jul 8, 2020
    Configuration menu
    Copy the full SHA
    622ac1c View commit details
    Browse the repository at this point in the history