Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

FEAT-#6398: Improved performance of list-like objects insertion into HDK DataFrames #6412

Merged
merged 6 commits into from
Jan 26, 2024
Merged

FEAT-#6398: Improved performance of list-like objects insertion into HDK DataFrames #6412

merged 6 commits into from
Jan 26, 2024

Commits on Jan 26, 2024

  1. FEAT-modin-project#6398: Improved performance of list-like objects in… 

    …sertion into HDK DataFrames

If the partition contains either pandas DataFrame or pyarrow Table,
insert the object directly into the frame/table, otherwise create
a single-column frame and join the frames by rowid.

Signed-off-by: Andrey Pavlenko <andrey.a.pavlenko@gmail.com>
    @AndreyPavlenko
    AndreyPavlenko committed Jan 26, 2024
    Configuration menu
    Copy the full SHA
    944c818 View commit details
    Browse the repository at this point in the history

  2. Apply suggestions from code review 

    Co-authored-by: Dmitry Chigarev <dmitry.chigarev@intel.com>
Co-authored-by: Anatoly Myachev <anatoly.myachev@intel.com>
    @AndreyPavlenko @dchigarev @anmyachev
    3 people committed Jan 26, 2024
    Configuration menu
    Copy the full SHA
    5ce1156 View commit details
    Browse the repository at this point in the history

  3. Apply suggestions from code review

    @AndreyPavlenko
    AndreyPavlenko committed Jan 26, 2024
    Configuration menu
    Copy the full SHA
    0d48cd8 View commit details
    Browse the repository at this point in the history

  4. Update modin/experimental/core/execution/native/implementations/hdk_o… 

    …n_native/dataframe/dataframe.py

Co-authored-by: Anatoly Myachev <anatoliimyachev@mail.com>
    @AndreyPavlenko @anmyachev
    AndreyPavlenko and anmyachev committed Jan 26, 2024
    Configuration menu
    Copy the full SHA
    ab03652 View commit details
    Browse the repository at this point in the history

  5. Apply suggestions from code review

    @AndreyPavlenko
    AndreyPavlenko committed Jan 26, 2024
    Configuration menu
    Copy the full SHA
    372267a View commit details
    Browse the repository at this point in the history

  6. Apply suggestions from code review

    @AndreyPavlenko
    AndreyPavlenko committed Jan 26, 2024
    Configuration menu
    Copy the full SHA
    2e73aea View commit details
    Browse the repository at this point in the history