New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[AIRFLOW-7075] Operators for storing information from GCS into GA #7743
Conversation
eb42173
to
66346d6
Compare
This PR will have some conflicts with #7748 |
66346d6
to
2bd8237
Compare
airflow/providers/google/marketing_platform/example_dags/example_analytics.py
Outdated
Show resolved
Hide resolved
airflow/providers/google/marketing_platform/example_dags/example_analytics.py
Show resolved
Hide resolved
self._conn = None | ||
|
||
def _paginate(self, resource: Resource, list_args: Optional[Dict[str, Any]] = None): | ||
list_args = list_args or {} | ||
result: List[Dict] = [] |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I like it. Much better then mine.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Great PR. :)
# the loop will be break | ||
if response["totalResults"] <= len(result): | ||
break | ||
result = self._paginate(accounts) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Wow... brilliant.
airflow/providers/google/marketing_platform/operators/analytics.py
Outdated
Show resolved
Hide resolved
WEB_PROPERTY_AD_WORDS_LINK_ID = "AAIIRRFFLLOOWW" | ||
WEB_PROPERTY_ID = "web_property_id" | ||
ACCOUNT_ID = "the_knight_who_says_ni!" | ||
DATA_SOURCE = "Monthy Python" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
😄
tests/providers/google/marketing_platform/operators/test_analytics_system.py
Show resolved
Hide resolved
209dfe6
to
ab9855b
Compare
… Google Analytics
ab9855b
to
d30b891
Compare
Operators for storing information from Google Cloud Storage into Google Analytics.
Issue link: AIRFLOW-7075
Make sure to mark the boxes below before creating PR: [x]
[AIRFLOW-NNNN]
. AIRFLOW-NNNN = JIRA ID** For document-only changes commit message can start with
[AIRFLOW-XXXX]
.In case of fundamental code change, Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in UPDATING.md.
Read the Pull Request Guidelines for more information.