Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Dataproc submit job operator async #25302

Merged
merged 31 commits into from
Aug 22, 2022
Merged

Dataproc submit job operator async #25302

merged 31 commits into from
Aug 22, 2022

Commits on Aug 16, 2022

  1. Initial changes

    @bjankie1
    bjankiewicz authored and bjankie1 committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    cf8fab4 View commit details
    Browse the repository at this point in the history

  2. Move trigger to a dedicated file

    @bjankie1
    bjankiewicz authored and bjankie1 committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    1ab3ac8 View commit details
    Browse the repository at this point in the history

  3. Trigger fixes

    @bjankie1
    bjankiewicz authored and bjankie1 committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    2f390cd View commit details
    Browse the repository at this point in the history

  4. Deferrable operators for Dataproc

    @bjankie1
    bjankiewicz authored and bjankie1 committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    e431d34 View commit details
    Browse the repository at this point in the history

  5. Tests

    @bjankie1
    bjankiewicz authored and bjankie1 committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    452d403 View commit details
    Browse the repository at this point in the history

  6. Remove unused import

    @bjankie1
    bjankiewicz authored and bjankie1 committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    e8cec42 View commit details
    Browse the repository at this point in the history

  7. Fixes

    @bjankie1
    bjankiewicz authored and bjankie1 committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    a0c515c View commit details
    Browse the repository at this point in the history

  8. Tests

    @bjankie1
    bjankiewicz authored and bjankie1 committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    c1125c8 View commit details
    Browse the repository at this point in the history

  9. Tests

    @bjankie1
    bjankiewicz authored and bjankie1 committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    125b54a View commit details
    Browse the repository at this point in the history

  10. Tests

    @bjankie1
    bjankiewicz authored and bjankie1 committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    98ddda3 View commit details
    Browse the repository at this point in the history

  11. DataProcAsyncHook implementation

    @bjankie1
    bjankiewicz authored and bjankie1 committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    6830cfc View commit details
    Browse the repository at this point in the history

  12. DataprocAsyncHook tests

    @bjankie1
    bjankiewicz authored and bjankie1 committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    0ad9868 View commit details
    Browse the repository at this point in the history

  13. Async tests

    @bjankie1
    bjankiewicz authored and bjankie1 committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    8ec99be View commit details
    Browse the repository at this point in the history

  14. Async tests

    @bjankie1
    bjankiewicz authored and bjankie1 committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    d0122cd View commit details
    Browse the repository at this point in the history

  15. Async tests

    @bjankie1
    bjankiewicz authored and bjankie1 committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    3531692 View commit details
    Browse the repository at this point in the history

  16. Fixes

    @bjankie1
    bjankiewicz authored and bjankie1 committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    3d2f159 View commit details
    Browse the repository at this point in the history

  17. Add examples and documentation

    @bjankie1
    bjankiewicz authored and bjankie1 committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    f640fe8 View commit details
    Browse the repository at this point in the history

  18. Code review fixes

    @bjankie1
    bjankiewicz authored and bjankie1 committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    1b2ce11 View commit details
    Browse the repository at this point in the history

  19. Fixes

    @bjankie1
    bjankiewicz authored and bjankie1 committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    46b6535 View commit details
    Browse the repository at this point in the history

  20. Fixes

    @bjankie1
    bjankiewicz authored and bjankie1 committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    e754dcb View commit details
    Browse the repository at this point in the history

  21. Update airflow/providers/google/cloud/operators/dataproc.py 

    Co-authored-by: Pankaj Singh <98807258+pankajastro@users.noreply.github.com>
    @bjankie1 @pankajastro
    bjankie1 and pankajastro committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    619f625 View commit details
    Browse the repository at this point in the history

  22. Update airflow/providers/google/cloud/operators/dataproc.py 

    Co-authored-by: Pankaj Singh <98807258+pankajastro@users.noreply.github.com>
    @bjankie1 @pankajastro
    bjankie1 and pankajastro committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    572f7c6 View commit details
    Browse the repository at this point in the history

  23. Fixing tests

    @bjankie1
    bjankiewicz authored and bjankie1 committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    ff772cf View commit details
    Browse the repository at this point in the history

  24. Test fixes

    @bjankie1
    bjankiewicz authored and bjankie1 committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    848f321 View commit details
    Browse the repository at this point in the history

  25. Text fixes

    @bjankie1
    bjankiewicz authored and bjankie1 committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    edbe501 View commit details
    Browse the repository at this point in the history

  26. Documentation fix

    @bjankie1
    bjankiewicz authored and bjankie1 committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    f385f57 View commit details
    Browse the repository at this point in the history

  27. Documentation fixes

    @bjankie1
    bjankiewicz authored and bjankie1 committed Aug 16, 2022
    Configuration menu
    Copy the full SHA
    9679ca1 View commit details
    Browse the repository at this point in the history

Commits on Aug 22, 2022

  1. Merge branch 'main' into DataprocSubmitJobOperator-async

    @bjankie1
    bjankie1 committed Aug 22, 2022
    Configuration menu
    Copy the full SHA
    2cea9a2 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into DataprocSubmitJobOperator-async

    @bjankie1
    bjankie1 committed Aug 22, 2022
    Configuration menu
    Copy the full SHA
    3b1dd4e View commit details
    Browse the repository at this point in the history

  3. Sync with master fix

    bjankiewicz committed Aug 22, 2022
    Configuration menu
    Copy the full SHA
    e7e3956 View commit details
    Browse the repository at this point in the history

  4. Fix test after merge

    bjankiewicz committed Aug 22, 2022
    Configuration menu
    Copy the full SHA
    00afe22 View commit details
    Browse the repository at this point in the history