Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[AIRFLOW-6572] Move AWS classes to providers.amazon.aws package #7178

Merged
merged 30 commits into from Jan 17, 2020

Conversation

mik-laj
Copy link
Member

@mik-laj mik-laj commented Jan 15, 2020


Issue link: AIRFLOW-6572

Make sure to mark the boxes below before creating PR: [x]

  • Description above provides context of the change
  • Commit message/PR title starts with [AIRFLOW-NNNN]. AIRFLOW-NNNN = JIRA ID*
  • Unit tests coverage for changes (not needed for documentation changes)
  • Commits follow "How to write a good git commit message"
  • Relevant documentation is updated including usage instructions.
  • I will engage committers as explained in Contribution Workflow Example.

* For document-only changes commit message can start with [AIRFLOW-XXXX].


In case of fundamental code change, Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in UPDATING.md.
Read the Pull Request Guidelines for more information.

@boring-cyborg boring-cyborg bot added provider:amazon-aws AWS/Amazon - related issues provider:microsoft-azure Azure-related issues labels Jan 15, 2020
@mik-laj mik-laj added the AIP-21 label Jan 15, 2020
@mik-laj mik-laj changed the title [AIRFLOW-6572] Move AWS classes to providers.amazon.aws package [AIRFLOW-6572][depends on AIRFLOW-6552] Move AWS classes to providers.amazon.aws package Jan 15, 2020
@codecov-io
Copy link

codecov-io commented Jan 15, 2020

Codecov Report

Merging #7178 into master will decrease coverage by 1.04%.
The diff coverage is 93.61%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master    #7178      +/-   ##
==========================================
- Coverage   85.37%   84.32%   -1.05%     
==========================================
  Files         723      753      +30     
  Lines       39558    39685     +127     
==========================================
- Hits        33771    33466     -305     
- Misses       5787     6219     +432
Impacted Files Coverage Δ
...rflow/contrib/sensors/sagemaker_training_sensor.py 0% <0%> (-100%) ⬇️
airflow/contrib/operators/s3_list_operator.py 100% <100%> (ø) ⬆️
.../contrib/operators/emr_create_job_flow_operator.py 100% <100%> (+8%) ⬆️
...ntrib/operators/emr_terminate_job_flow_operator.py 100% <100%> (+5%) ⬆️
.../contrib/operators/sagemaker_transform_operator.py 100% <100%> (+8.1%) ⬆️
airflow/providers/amazon/aws/hooks/glue_catalog.py 100% <100%> (ø)
airflow/contrib/sensors/emr_job_flow_sensor.py 100% <100%> (+4.54%) ⬆️
...flow/contrib/sensors/sagemaker_transform_sensor.py 100% <100%> (ø) ⬆️
...ample_dags/example_emr_job_flow_automatic_steps.py 100% <100%> (ø) ⬆️
...roviders/amazon/aws/sensors/sagemaker_transform.py 100% <100%> (ø)
... and 108 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 50efda5...51410da. Read the comment docs.

@mik-laj mik-laj removed the provider:microsoft-azure Azure-related issues label Jan 15, 2020
@mik-laj mik-laj changed the title [AIRFLOW-6572][depends on AIRFLOW-6552] Move AWS classes to providers.amazon.aws package [AIRFLOW-6572] Move AWS classes to providers.amazon.aws package Jan 15, 2020
Kamil Breguła added 19 commits January 17, 2020 00:14
…contrib.operators.emr_create_job_flow_operator
…ow.contrib.operators.emr_terminate_job_flow_operator
…ntrib.operators.s3_delete_objects_operator
…rflow.contrib.operators.sagemaker_endpoint_config_operator
…ontrib.operators.sagemaker_endpoint_operator
…ontrib.operators.sagemaker_training_operator
…contrib.operators.sagemaker_transform_operator
…ow.contrib.sensors.aws_glue_catalog_partition_sensor
@mik-laj mik-laj merged commit c319e81 into apache:master Jan 17, 2020
galuszkak pushed a commit to FlyrInc/apache-airflow that referenced this pull request Mar 5, 2020
…he#7178)

* [AIP-21] Move contrib.hooks.aws_glue_catalog_hook airflow.contrib.hooks.aws_glue_catalog_hook

* [AIP-21] Move contrib.hooks.aws_logs_hook airflow.contrib.hooks.aws_logs_hook

* [AIP-21] Move contrib.hooks.emr_hook airflow.contrib.hooks.emr_hook

* [AIP-21] Move contrib.operators.ecs_operator airflow.contrib.operators.ecs_operator

* [AIP-21] Move contrib.operators.emr_add_steps_operator airflow.contrib.operators.emr_add_steps_operator

* [AIP-21] Move contrib.operators.emr_create_job_flow_operator airflow.contrib.operators.emr_create_job_flow_operator

* [AIP-21] Move contrib.operators.emr_terminate_job_flow_operator airflow.contrib.operators.emr_terminate_job_flow_operator

* [AIP-21] Move contrib.operators.s3_copy_object_operator airflow.contrib.operators.s3_copy_object_operator

* [AIP-21] Move contrib.operators.s3_delete_objects_operator airflow.contrib.operators.s3_delete_objects_operator

* [AIP-21] Move contrib.operators.s3_list_operator airflow.contrib.operators.s3_list_operator

* [AIP-21] Move contrib.operators.sagemaker_base_operator airflow.contrib.operators.sagemaker_base_operator

* [AIP-21] Move contrib.operators.sagemaker_endpoint_config_operator airflow.contrib.operators.sagemaker_endpoint_config_operator

* [AIP-21] Move contrib.operators.sagemaker_endpoint_operator airflow.contrib.operators.sagemaker_endpoint_operator

* [AIP-21] Move contrib.operators.sagemaker_model_operator airflow.contrib.operators.sagemaker_model_operator

* [AIP-21] Move contrib.operators.sagemaker_training_operator airflow.contrib.operators.sagemaker_training_operator

* [AIP-21] Move contrib.operators.sagemaker_transform_operator airflow.contrib.operators.sagemaker_transform_operator

* [AIP-21] Move contrib.operators.sagemaker_tuning_operator airflow.contrib.operators.sagemaker_tuning_operator

* [AIP-21] Move contrib.sensors.aws_glue_catalog_partition_sensor airflow.contrib.sensors.aws_glue_catalog_partition_sensor

* [AIP-21] Move contrib.sensors.emr_base_sensor airflow.contrib.sensors.emr_base_sensor

* [AIP-21] Move contrib.sensors.emr_job_flow_sensor airflow.contrib.sensors.emr_job_flow_sensor

* [AIP-21] Move contrib.sensors.emr_step_sensor airflow.contrib.sensors.emr_step_sensor

* [AIP-21] Move contrib.sensors.sagemaker_base_sensor airflow.contrib.sensors.sagemaker_base_sensor

* [AIP-21] Move contrib.sensors.sagemaker_endpoint_sensor airflow.contrib.sensors.sagemaker_endpoint_sensor

* [AIP-21] Move contrib.sensors.sagemaker_training_sensor airflow.contrib.sensors.sagemaker_training_sensor

* [AIP-21] Move contrib.sensors.sagemaker_transform_sensor airflow.contrib.sensors.sagemaker_transform_sensor

* [AIP-21] Move contrib.sensors.sagemaker_tuning_sensor airflow.contrib.sensors.sagemaker_tuning_sensor

* [AIP-21] Move operators.s3_file_transform_operator airflow.operators.s3_file_transform_operator

* [AIP-21] Move sensors.s3_key_sensor airflow.sensors.s3_key_sensor

* [AIP-21] Move sensors.s3_prefix_sensor airflow.sensors.s3_prefix_sensor

* [AIP-21] Move contrib.hooks.sagemaker_hook providers.amazon.aws.hooks.sagemaker
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
provider:amazon-aws AWS/Amazon - related issues
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants