Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ddl: support checkpoint for ingest mode #42769

Merged
merged 21 commits into from Apr 12, 2023
Merged

ddl: support checkpoint for ingest mode #42769

merged 21 commits into from Apr 12, 2023

Commits on Apr 3, 2023

  1. ddl: support checkpoint for ingest mode

    @tangenta
    tangenta committed Apr 3, 2023
    Configuration menu
    Copy the full SHA
    2b185f6 View commit details
    Browse the repository at this point in the history

Commits on Apr 4, 2023

  1. ddl: fix data inconsistency issue

    @tangenta
    tangenta committed Apr 4, 2023
    Configuration menu
    Copy the full SHA
    73ddb5d View commit details
    Browse the repository at this point in the history

  2. fix test for build and refine code

    @tangenta
    tangenta committed Apr 4, 2023
    Configuration menu
    Copy the full SHA
    31a774a View commit details
    Browse the repository at this point in the history

  3. make job.RowCount more accurate

    @tangenta
    tangenta committed Apr 4, 2023
    Configuration menu
    Copy the full SHA
    e0f7dbb View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'upstream/master' into add-index-checkpo… 

    …int-v2
    @tangenta
    tangenta committed Apr 4, 2023
    Configuration menu
    Copy the full SHA
    6a9b52e View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'upstream/master' into add-index-checkpo… 

    …int-v2
    @tangenta
    tangenta committed Apr 4, 2023
    Configuration menu
    Copy the full SHA
    d85eb4b View commit details
    Browse the repository at this point in the history

Commits on Apr 5, 2023

  1. move checkpoint to ingest package

    @tangenta
    tangenta committed Apr 5, 2023
    Configuration menu
    Copy the full SHA
    d3241b7 View commit details
    Browse the repository at this point in the history

Commits on Apr 6, 2023

  1. add part of test for checkpoint manager

    @tangenta
    tangenta committed Apr 6, 2023
    Configuration menu
    Copy the full SHA
    0b5b1ab View commit details
    Browse the repository at this point in the history

  2. add more test for checkpoint manager

    @tangenta
    tangenta committed Apr 6, 2023
    Configuration menu
    Copy the full SHA
    a8d490f View commit details
    Browse the repository at this point in the history

  3. fix linter

    @tangenta
    tangenta committed Apr 6, 2023
    Configuration menu
    Copy the full SHA
    c14674e View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'upstream/master' into add-index-checkpo… 

    …int-v2
    @tangenta
    tangenta committed Apr 6, 2023
    Configuration menu
    Copy the full SHA
    a378b11 View commit details
    Browse the repository at this point in the history

Commits on Apr 7, 2023

  1. update bazel

    @tangenta
    tangenta committed Apr 7, 2023
    Configuration menu
    Copy the full SHA
    1abad96 View commit details
    Browse the repository at this point in the history

Commits on Apr 10, 2023

  1. add comments

    @tangenta
    tangenta committed Apr 10, 2023
    Configuration menu
    Copy the full SHA
    b4b454d View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2023

  1. remove redundant file

    @tangenta
    tangenta committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    9a3ca75 View commit details
    Browse the repository at this point in the history

  2. refine code

    @tangenta
    tangenta committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    87987c6 View commit details
    Browse the repository at this point in the history

  3. Merge remote-tracking branch 'upstream/master' into add-index-checkpo… 

    …int-v2
    @tangenta
    tangenta committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    92dc8b5 View commit details
    Browse the repository at this point in the history

Commits on Apr 12, 2023

  1. Merge remote-tracking branch 'upstream/master' into add-index-checkpo… 

    …int-v2
    @tangenta
    tangenta committed Apr 12, 2023
    Configuration menu
    Copy the full SHA
    b08d9b9 View commit details
    Browse the repository at this point in the history

  2. use checkpoint manager only if distributed exec is disabled

    @tangenta
    tangenta committed Apr 12, 2023
    Configuration menu
    Copy the full SHA
    a562d83 View commit details
    Browse the repository at this point in the history

  3. update the checkpoint flush interval to 10 min

    @tangenta
    tangenta committed Apr 12, 2023
    Configuration menu
    Copy the full SHA
    f3f2b55 View commit details
    Browse the repository at this point in the history

  4. add task ID allocator

    @tangenta
    tangenta committed Apr 12, 2023
    Configuration menu
    Copy the full SHA
    e535400 View commit details
    Browse the repository at this point in the history

  5. Merge remote-tracking branch 'upstream/master' into add-index-checkpo… 

    …int-v2
    @tangenta
    tangenta committed Apr 12, 2023
    Configuration menu
    Copy the full SHA
    9ef599f View commit details
    Browse the repository at this point in the history