ECS patch v2 #4
Open
ECS patch v2 #4
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
In particular, the previous version created and removed an Airflow Connection, dynamically, to use the PrestoHook class as as a client to the Presto cluster. This strategy was replaced by using the PyHive class (used by the PrestoHook class) which doesn't require a Airflow Connection.
… file is published to PiPy. * Updated airflow_presto/README.md to reflect updated parameter list in the settings.json file. * Updated setup.py file to fix typos. * Updated presto_ecs_operator.py file to accept dictionary of parameters rather than passing all as named parameters. * Added first unit-test to check link in README.md file. Also added requirments file with some parckage necessary to build package.
…e, qbizinc, where all airflow and future modules will be installed. I believe qbiz-data-raven should be moved here as well.
CLI commands in the shell scripts.
This function is now supported by Terraform scripts.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
I rewrote history to look cleaner and remove some mistakes.