-
Notifications
You must be signed in to change notification settings - Fork 3.8k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
🐛 Source Bing Ads: campaigns, accounts, search query report streams: update schemas + date-time convert rfc3339
#31995
Conversation
The latest updates on your projects. Learn more about Vercel for Git ↗︎
|
Before Merging a Connector Pull RequestWow! What a great pull request you have here! 🎉 To merge this PR, ensure the following has been done/considered for each connector added or updated:
If the checklist is complete, but the CI check is failing,
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The change looks good to me but I believe the CAT failure is related to an expected_records failure. Shall we udpate these expected records following the schema change?
@davydov-d told me that the file size 260506229 exceeds limit 134217728
we see in the CAT report is often related to expected records test failure.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
lgtm
…ads/validation-errors # Conflicts: # airbyte-integrations/connectors/source-bing-ads/integration_tests/expected_records.jsonl # airbyte-integrations/connectors/source-bing-ads/metadata.yaml # airbyte-integrations/connectors/source-bing-ads/source_bing_ads/reports.py # airbyte-integrations/connectors/source-bing-ads/source_bing_ads/source.py # airbyte-integrations/connectors/source-bing-ads/source_bing_ads/streams.py # airbyte-integrations/connectors/source-bing-ads/unit_tests/test_source.py # docs/integrations/sources/bing-ads.md
…ads/validation-errors # Conflicts: # docs/integrations/sources/bing-ads.md
What
Based on datadog dashboard:
validation_error:_.linkedagencies:_object_found_but_null_string_is_required
validation_error:_.biddingscheme.maxcpc.amount:_number_found_but_null_string_is_required
validation_error:_.costperconversion:_string_found_but_null_integer_is_required
Convert
date
anddate-time
fields to standardRFC3339
.save stream_state in "native" field format
How
Recommended reading order
schemas/*.json
streams.py
report_streams.py
utils.py
🚨 User Impact 🚨
This version update affects next streams:
Version 2.0.0 updates schemas for Accounts, Campaigns and Search Query Performance Report streams. LinkedAgencies was changed from string to object in Accounts stream.
BiddingScheme.MaxCpc.Amount was changed from string to number in Campaigns stream. And CostPerConversion was changed from integer to number.
All
date
anddate-time
fields will be converted to standardRFC3339
.For the changes to take effect, please refresh the source schema and reset affected streams after you have applied the upgrade.
RFC3339
)AppInstallAds
,AppInstallAdLabels
,Labels
,Campaign Labels
,Keyword Labels
,Ad Group Labels
,Keywords
Modified Time
04/27/2023 18:00:14.970
2023-04-27T16:00:14.970+00:00
Budget Summary Report
Date
6/10/2021
2021-06-10
* Report Hourly
TimePeriod
2023-11-04|11
2023-11-04T11:00:00+00:00