Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[SPARK-31253][SQL][FOLLOW-UP] Improve the partition data size metrics in CustomShuffleReaderExec #28175

Closed
wants to merge 11 commits into from
Closed

[SPARK-31253][SQL][FOLLOW-UP] Improve the partition data size metrics in CustomShuffleReaderExec #28175

wants to merge 11 commits into from

Commits on Apr 10, 2020

  1. improve the partition data size metrics in CustomShuffleReaderExec

    @JkSelf
    JkSelf committed Apr 10, 2020
    Copy the full SHA
    fc766a5 View commit details
    Browse the repository at this point in the history

  2. resolve the comments

    @JkSelf
    JkSelf committed Apr 10, 2020
    Copy the full SHA
    a885f30 View commit details
    Browse the repository at this point in the history

  3. rebase code

    @JkSelf
    JkSelf committed Apr 10, 2020
    Copy the full SHA
    4aabfaa View commit details
    Browse the repository at this point in the history

Commits on Apr 13, 2020

  1. resolve comments

    @JkSelf
    JkSelf committed Apr 13, 2020
    Copy the full SHA
    e6c50df View commit details
    Browse the repository at this point in the history

  2. resolve comments

    @JkSelf
    JkSelf committed Apr 13, 2020
    Copy the full SHA
    ae1824a View commit details
    Browse the repository at this point in the history

  3. resolve comment

    @JkSelf
    JkSelf committed Apr 13, 2020
    Copy the full SHA
    fda6846 View commit details
    Browse the repository at this point in the history

Commits on Apr 14, 2020

  1. add method postDriverMetricsUpdatedByValue to pass all the partition … 

    …data size once
    @JkSelf
    JkSelf committed Apr 14, 2020
    Copy the full SHA
    efdd9b7 View commit details
    Browse the repository at this point in the history

  2. resolve the comment

    @JkSelf
    JkSelf committed Apr 14, 2020
    Copy the full SHA
    3ee19f8 View commit details
    Browse the repository at this point in the history

Commits on Apr 16, 2020

  1. send all the driver metrics together

    @JkSelf
    JkSelf committed Apr 16, 2020
    Copy the full SHA
    6c70108 View commit details
    Browse the repository at this point in the history

  2. resolve comment

    @JkSelf
    JkSelf committed Apr 16, 2020
    Copy the full SHA
    72d46eb View commit details
    Browse the repository at this point in the history

  3. fix the failed ut

    @JkSelf
    JkSelf committed Apr 16, 2020
    Copy the full SHA
    2e2dfb8 View commit details
    Browse the repository at this point in the history