Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[DO NOT MERGE][HUDI-6198][0.13.0] Testing Spark 3.4.0 Upgrade #8813

Closed
wants to merge 12 commits into from
Closed

[DO NOT MERGE][HUDI-6198][0.13.0] Testing Spark 3.4.0 Upgrade #8813

wants to merge 12 commits into from
+8,460 −95

Commits on May 10, 2023

  1. Spark 3.4.0 upgrade

    @mansipp
    mansipp committed May 10, 2023
    Configuration menu
    Copy the full SHA
    5369ed0 View commit details
    Browse the repository at this point in the history

  2. spark 3.4 profile

    @mansipp
    mansipp committed May 10, 2023
    Configuration menu
    Copy the full SHA
    0d87576 View commit details
    Browse the repository at this point in the history

  3. bot.yml changes

    @mansipp
    mansipp committed May 10, 2023
    Configuration menu
    Copy the full SHA
    c23f6ed View commit details
    Browse the repository at this point in the history

  4. bot.yml flink test change

    @mansipp
    mansipp committed May 10, 2023
    Configuration menu
    Copy the full SHA
    d3756a6 View commit details
    Browse the repository at this point in the history

Commits on May 16, 2023

  1. [HUDI-5868] Make hudi-spark compatible against Spark 3.3.2 (apache#8082) 

    * Disable vectorized reader for spark 3.3.2 only
* Keep compile version to be Spark 3.3.1

---------

Co-authored-by: Rahil Chertara <rchertar@amazon.com>
    @rahil-c @mansipp
    2 people authored and mansipp committed May 16, 2023
    Configuration menu
    Copy the full SHA
    7db547f View commit details
    Browse the repository at this point in the history

  2. Temp change

    @mansipp
    mansipp committed May 16, 2023
    Configuration menu
    Copy the full SHA
    81109c4 View commit details
    Browse the repository at this point in the history

  3. added functinal test logic to bot.yml

    @mansipp
    mansipp committed May 16, 2023
    Configuration menu
    Copy the full SHA
    7cc4d1b View commit details
    Browse the repository at this point in the history

Commits on May 17, 2023

  1. Debugging ParquetFileFormat for Spark 34

    Shawn Chang committed May 17, 2023
    Configuration menu
    Copy the full SHA
    768fe01 View commit details
    Browse the repository at this point in the history

Commits on May 26, 2023

  1. Fix ConstantColumnVector casting issue for Spark 3.4

    Shawn Chang authored and Rahil Chertara committed May 26, 2023
    Configuration menu
    Copy the full SHA
    4f9a321 View commit details
    Browse the repository at this point in the history

  2. Fix Casting Issue UnSafeRow To ColumnarBatch

    Rahil Chertara committed May 26, 2023
    Configuration menu
    Copy the full SHA
    7715616 View commit details
    Browse the repository at this point in the history

Commits on May 30, 2023

  1. Disable StructedStreaming test, add continue on error flag

    Rahil Chertara committed May 30, 2023
    Configuration menu
    Copy the full SHA
    445e56a View commit details
    Browse the repository at this point in the history

  2. move FT up

    Rahil Chertara committed May 30, 2023
    Configuration menu
    Copy the full SHA
    c748b5d View commit details
    Browse the repository at this point in the history