Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs #4633

Merged
merged 28 commits into from Jul 19, 2019
Merged

AIRFLOW-3791: Dataflow - Support check status if pipeline spans on multiple jobs #4633

merged 28 commits into from Jul 19, 2019

Commits on Jan 31, 2019

  1. AIRFLOW-3791: Dataflow 

    Support to check if job is already running before starting java job
In case dataflow creates more than one job, we need to track all jobs for status
    @chaimt
    chaimt committed Jan 31, 2019
    Configuration menu
    Copy the full SHA
    0fbc4dc View commit details
    Browse the repository at this point in the history

Commits on Feb 3, 2019

  1. AIRFLOW-3791: Dataflow 

    Support to check if job is already running before starting java job
In case dataflow creates more than one job, we need to track all jobs for status
    @chaimt
    chaimt committed Feb 3, 2019
    Configuration menu
    Copy the full SHA
    d576bf6 View commit details
    Browse the repository at this point in the history

Commits on Jun 23, 2019

  1. Update airflow/contrib/hooks/gcp_dataflow_hook.py 

    Co-Authored-By: Fokko Driesprong <fokko@driesprong.frl>
    @chaimt @Fokko
    chaimt and Fokko committed Jun 23, 2019
    Configuration menu
    Copy the full SHA
    fbfac70 View commit details
    Browse the repository at this point in the history

  2. Update airflow/contrib/hooks/gcp_dataflow_hook.py 

    Co-Authored-By: Fokko Driesprong <fokko@driesprong.frl>
    @chaimt @Fokko
    chaimt and Fokko committed Jun 23, 2019
    Configuration menu
    Copy the full SHA
    0046685 View commit details
    Browse the repository at this point in the history

  3. Update gcp_dataflow_hook.py

    @chaimt
    chaimt committed Jun 23, 2019
    Configuration menu
    Copy the full SHA
    3203570 View commit details
    Browse the repository at this point in the history

  4. Update dataflow_operator.py

    @chaimt
    chaimt committed Jun 23, 2019
    Configuration menu
    Copy the full SHA
    3d8ad47 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow int… 

    …o AIRFLOW-3791_Dataflow
    @chaimt
    chaimt committed Jun 23, 2019
    Configuration menu
    Copy the full SHA
    41231a9 View commit details
    Browse the repository at this point in the history

Commits on Jun 24, 2019

  1. Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow int… 

    …o AIRFLOW-3791_Dataflow
    @chaimt
    chaimt committed Jun 24, 2019
    Configuration menu
    Copy the full SHA
    c40d8f0 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow int… 

    …o AIRFLOW-3791_Dataflow
    @chaimt
    chaimt committed Jun 24, 2019
    Configuration menu
    Copy the full SHA
    2f6b606 View commit details
    Browse the repository at this point in the history

Commits on Jun 25, 2019

  1. Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow int… 

    …o AIRFLOW-3791_Dataflow
    @chaimt
    chaimt committed Jun 25, 2019
    Configuration menu
    Copy the full SHA
    840bd8a View commit details
    Browse the repository at this point in the history

  2. Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow int… 

    …o AIRFLOW-3791_Dataflow
    @chaimt
    chaimt committed Jun 25, 2019
    Configuration menu
    Copy the full SHA
    a34e8c2 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow int… 

    …o AIRFLOW-3791_Dataflow
    @chaimt
    chaimt committed Jun 25, 2019
    Configuration menu
    Copy the full SHA
    cacd7ea View commit details
    Browse the repository at this point in the history

  4. Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow int… 

    …o AIRFLOW-3791_Dataflow
    @chaimt
    chaimt committed Jun 25, 2019
    Configuration menu
    Copy the full SHA
    b175c21 View commit details
    Browse the repository at this point in the history

Commits on Jun 26, 2019

  1. Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow int… 

    …o AIRFLOW-3791_Dataflow
    @chaimt
    chaimt committed Jun 26, 2019
    Configuration menu
    Copy the full SHA
    f6516ec View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2019

  1. Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow int… 

    …o AIRFLOW-3791_Dataflow
    @chaimt
    chaimt committed Jun 27, 2019
    Configuration menu
    Copy the full SHA
    5673ab6 View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2019

  1. Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow int… 

    …o AIRFLOW-3791_Dataflow
    @chaimt
    chaimt committed Jun 28, 2019
    Configuration menu
    Copy the full SHA
    280c40c View commit details
    Browse the repository at this point in the history

Commits on Jul 14, 2019

  1. Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow int… 

    …o AIRFLOW-3791_Dataflow
    @chaimt
    chaimt committed Jul 14, 2019
    Configuration menu
    Copy the full SHA
    aca5540 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow int… 

    …o AIRFLOW-3791_Dataflow
    @chaimt
    chaimt committed Jul 14, 2019
    Configuration menu
    Copy the full SHA
    093deb6 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow int… 

    …o AIRFLOW-3791_Dataflow
    @chaimt
    chaimt committed Jul 14, 2019
    Configuration menu
    Copy the full SHA
    578b555 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow int… 

    …o AIRFLOW-3791_Dataflow
    @chaimt
    chaimt committed Jul 14, 2019
    Configuration menu
    Copy the full SHA
    07a81fe View commit details
    Browse the repository at this point in the history

Commits on Jul 16, 2019

  1. Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow int… 

    …o AIRFLOW-3791_Dataflow

change default for check if running
    @chaimt
    chaimt committed Jul 16, 2019
    Configuration menu
    Copy the full SHA
    a0125a2 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow int… 

    …o AIRFLOW-3791_Dataflow

merge redundant code of _get_job_id_from_name
    @chaimt
    chaimt committed Jul 16, 2019
    Configuration menu
    Copy the full SHA
    cf49fd4 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow int… 

    …o AIRFLOW-3791_Dataflow

merge redundant code of _get_job_id_from_name
    @chaimt
    chaimt committed Jul 16, 2019
    Configuration menu
    Copy the full SHA
    7bda854 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow int… 

    …o AIRFLOW-3791_Dataflow

merge redundant code of _get_job_id_from_name
    @chaimt
    chaimt committed Jul 16, 2019
    Configuration menu
    Copy the full SHA
    f7d1579 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow int… 

    …o AIRFLOW-3791_Dataflow

merge redundant code of _get_job_id_from_name
    @chaimt
    chaimt committed Jul 16, 2019
    Configuration menu
    Copy the full SHA
    805d4dd View commit details
    Browse the repository at this point in the history

  6. Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow int… 

    …o AIRFLOW-3791_Dataflow

merge redundant code of _get_job_id_from_name
    @chaimt
    chaimt committed Jul 16, 2019
    Configuration menu
    Copy the full SHA
    baaf8f7 View commit details
    Browse the repository at this point in the history

  7. Merge branch 'master' of https://github.com/apache/airflow into AIRFL… 

    …OW-3791_Dataflow
    @chaimt
    chaimt committed Jul 16, 2019
    Configuration menu
    Copy the full SHA
    6ff96c5 View commit details
    Browse the repository at this point in the history

  8. Merge branch 'AIRFLOW-3791_Dataflow' of github.com:chaimt/airflow int… 

    …o AIRFLOW-3791_Dataflow

merge redundant code of _get_job_id_from_name
    @chaimt
    chaimt committed Jul 16, 2019
    Configuration menu
    Copy the full SHA
    3343d83 View commit details
    Browse the repository at this point in the history