Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add direct path code path #30764

Closed
wants to merge 11 commits into from
Closed

Add direct path code path #30764

wants to merge 11 commits into from

Commits on Apr 16, 2024

  1. integrate direct path code path in streaming dataflow worker

    @m-trieu
    m-trieu committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    df46ff9 View commit details
    Browse the repository at this point in the history

  2. encapsulate work execution, status pages, etc common logic shared bet… 

    …ween harness to their own classes/files. Add different harness implementations for Dispatched, Appliance, and Direct Path streaing jobs. StreamingDataflowWorker is now just a main method
    @m-trieu
    m-trieu committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    4aef673 View commit details
    Browse the repository at this point in the history

  3. fix broken tests, use new components in direct path worker impl

    @m-trieu
    m-trieu committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    96bf741 View commit details
    Browse the repository at this point in the history

  4. mark public classes as internal

    @m-trieu
    m-trieu committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    952a01c View commit details
    Browse the repository at this point in the history

  5. address cl comments

    @m-trieu
    m-trieu committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    17c063b View commit details
    Browse the repository at this point in the history

  6. fix bad import

    @m-trieu
    m-trieu committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    a2edf60 View commit details
    Browse the repository at this point in the history

  7. add tests, remove some unneeded classes

    @m-trieu
    m-trieu committed Apr 16, 2024
    Configuration menu
    Copy the full SHA
    af4f202 View commit details
    Browse the repository at this point in the history

Commits on Apr 17, 2024

  1. allow get data stream to be closed properly, populate get data stream… 

    … in work processing context, guard for null dataflowServiceOptions in StreamingEngineClient
    @m-trieu
    m-trieu committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    6c7b399 View commit details
    Browse the repository at this point in the history

  2. fix rebase issues

    @m-trieu
    m-trieu committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    6791c75 View commit details
    Browse the repository at this point in the history

  3. fix test

    @m-trieu
    m-trieu committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    f8732c8 View commit details
    Browse the repository at this point in the history

Commits on Apr 29, 2024

  1. address cl comments

    @m-trieu
    m-trieu committed Apr 29, 2024
    Configuration menu
    Copy the full SHA
    e60cb1e View commit details
    Browse the repository at this point in the history