Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[SPARK-19008][SQL] Improve performance of Dataset.map by eliminating boxing/unboxing #17172

Closed
wants to merge 12 commits into from
Closed

[SPARK-19008][SQL] Improve performance of Dataset.map by eliminating boxing/unboxing #17172

wants to merge 12 commits into from

Commits on Mar 6, 2017

  1. Initial commit

    @kiszk
    kiszk committed Mar 6, 2017
    Configuration menu
    Copy the full SHA
    d8b5f8d View commit details
    Browse the repository at this point in the history

  2. fix scala style error

    @kiszk
    kiszk committed Mar 6, 2017
    Configuration menu
    Copy the full SHA
    a885907 View commit details
    Browse the repository at this point in the history

  3. Simplify scope of varibles as needed

    @kiszk
    kiszk committed Mar 6, 2017
    Configuration menu
    Copy the full SHA
    65fa05a View commit details
    Browse the repository at this point in the history

Commits on Mar 8, 2017

  1. add new benchmark suite with results

    @kiszk
    kiszk committed Mar 8, 2017
    Configuration menu
    Copy the full SHA
    1f9ece4 View commit details
    Browse the repository at this point in the history

  2. address review comments

    @kiszk
    kiszk committed Mar 8, 2017
    Configuration menu
    Copy the full SHA
    dfbce2a View commit details
    Browse the repository at this point in the history

Commits on Mar 9, 2017

  1. support Boolean for returnType 

    Use compositional approach instead of enumeration approach
    @kiszk
    kiszk committed Mar 9, 2017
    Configuration menu
    Copy the full SHA
    8ee91af View commit details
    Browse the repository at this point in the history

  2. add test cases for boolean type

    @kiszk
    kiszk committed Mar 9, 2017
    Configuration menu
    Copy the full SHA
    89c896e View commit details
    Browse the repository at this point in the history

  3. fix scala type failure

    @kiszk
    kiszk committed Mar 9, 2017
    Configuration menu
    Copy the full SHA
    1fb2933 View commit details
    Browse the repository at this point in the history

Commits on Mar 10, 2017

  1. Generate a call to specialized method for Dataset.filter()

    @kiszk
    kiszk committed Mar 10, 2017
    Configuration menu
    Copy the full SHA
    35ba2c6 View commit details
    Browse the repository at this point in the history

  2. update test cases for map() 

    add test cases for filter()
    @kiszk
    kiszk committed Mar 10, 2017
    Configuration menu
    Copy the full SHA
    4c88c03 View commit details
    Browse the repository at this point in the history

  3. add benchmark suite for Dataset.filter()

    @kiszk
    kiszk committed Mar 10, 2017
    Configuration menu
    Copy the full SHA
    200cec7 View commit details
    Browse the repository at this point in the history

  4. update benchmark result

    @kiszk
    kiszk committed Mar 10, 2017
    Configuration menu
    Copy the full SHA
    b25b191 View commit details
    Browse the repository at this point in the history