Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Source Salesforce: fix properties chunk length count #22896

Conversation

davydov-d
Copy link
Collaborator

@davydov-d davydov-d commented Feb 13, 2023

What

#20703
this is a followup for oncall https://github.com/airbytehq/oncall/issues/1403

How

When counting the length of the URL we should take into account that properties and the separator will be URL-encoded

@octavia-squidington-iii octavia-squidington-iii added area/connectors Connector related issues area/documentation Improvements or additions to documentation connectors/source/salesforce labels Feb 13, 2023
@davydov-d
Copy link
Collaborator Author

davydov-d commented Feb 13, 2023

/test connector=connectors/source-salesforce

🕑 connectors/source-salesforce https://github.com/airbytehq/airbyte/actions/runs/4163049630
✅ connectors/source-salesforce https://github.com/airbytehq/airbyte/actions/runs/4163049630
Python tests coverage:

Name                                 Stmts   Miss  Cover
--------------------------------------------------------
source_salesforce/utils.py               8      0   100%
source_salesforce/__init__.py            2      0   100%
source_salesforce/source.py             96      6    94%
source_salesforce/streams.py           380     33    91%
source_salesforce/api.py               155     14    91%
source_salesforce/exceptions.py          8      1    88%
source_salesforce/rate_limiting.py      22      3    86%
--------------------------------------------------------
TOTAL                                  671     57    92%
Name                                 Stmts   Miss  Cover
--------------------------------------------------------
source_salesforce/__init__.py            2      0   100%
source_salesforce/exceptions.py          8      1    88%
source_salesforce/api.py               155     21    86%
source_salesforce/streams.py           380     86    77%
source_salesforce/rate_limiting.py      22      6    73%
source_salesforce/source.py             96     33    66%
source_salesforce/utils.py               8      7    12%
--------------------------------------------------------
TOTAL                                  671    154    77%
	 Name                                                    Stmts   Miss  Cover   Missing
	 -------------------------------------------------------------------------------------
	 connector_acceptance_test/base.py                          12      4    67%   16-19
	 connector_acceptance_test/config.py                       141      5    96%   87, 93, 239, 243-244
	 connector_acceptance_test/conftest.py                     217    101    53%   37, 43-45, 50, 55, 78, 84, 90-92, 111, 116-118, 124-126, 132-133, 138-139, 144, 150, 159-168, 174-179, 194, 218, 249, 255, 263-271, 279-292, 300-313, 318-324, 331-342, 349-365
	 connector_acceptance_test/plugin.py                        69     25    64%   22-23, 31, 36, 120-140, 144-148
	 connector_acceptance_test/tests/test_core.py              476    117    75%   53, 58, 97-108, 113-120, 124-125, 129-130, 380, 400, 438, 476-493, 506-517, 521-526, 532, 565-570, 608-615, 658-660, 663, 728-736, 748-751, 756, 812-813, 819, 822, 858-868, 881-906
	 connector_acceptance_test/tests/test_incremental.py       162     14    91%   58-65, 70-83, 252
	 connector_acceptance_test/utils/asserts.py                 39      2    95%   62-63
	 connector_acceptance_test/utils/common.py                  94     10    89%   16-17, 32-38, 72, 75
	 connector_acceptance_test/utils/compare.py                 62     23    63%   21-51, 68, 97-99
	 connector_acceptance_test/utils/connector_runner.py       133     33    75%   24-27, 46-47, 50-54, 57-58, 73-75, 78-80, 83-85, 88-90, 93-95, 124-125, 159-161, 208
	 connector_acceptance_test/utils/json_schema_helper.py     114     13    89%   31-32, 39, 42, 66-69, 97, 121, 203-205
	 -------------------------------------------------------------------------------------
	 TOTAL                                                    1711    347    80%

Build Passed

Test summary info:

=========================== short test summary info ============================
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:98: The previous and actual specifications are identical.
SKIPPED [1] ../usr/local/lib/python3.9/site-packages/connector_acceptance_test/tests/test_core.py:507: The previous and actual discovered catalogs are identical.
================== 36 passed, 2 skipped in 581.56s (0:09:41) ===================

@davydov-d
Copy link
Collaborator Author

davydov-d commented Feb 14, 2023

/publish connector=connectors/source-salesforce

🕑 Publishing the following connectors:
connectors/source-salesforce
https://github.com/airbytehq/airbyte/actions/runs/4171498353


Connector Did it publish? Were definitions generated?
connectors/source-salesforce

if you have connectors that successfully published but failed definition generation, follow step 4 here ▶️

@davydov-d
Copy link
Collaborator Author

temporary unable to publish changes because of exceeding the rate limit
image

@davydov-d davydov-d temporarily deployed to more-secrets February 15, 2023 09:55 — with GitHub Actions Inactive
@davydov-d davydov-d temporarily deployed to more-secrets February 15, 2023 09:55 — with GitHub Actions Inactive
@github-actions
Copy link
Contributor

Airbyte Code Coverage

There is no coverage information present for the Files changed

Total Project Coverage 24.66%

@davydov-d davydov-d temporarily deployed to more-secrets February 15, 2023 10:56 — with GitHub Actions Inactive
@davydov-d davydov-d temporarily deployed to more-secrets February 15, 2023 10:56 — with GitHub Actions Inactive
Copy link
Collaborator

@lazebnyi lazebnyi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

CI tests looks good. We can move next to fix issue related to on-call issue. LGTM!

@davydov-d
Copy link
Collaborator Author

/publish connector=connectors/source-salesforce

2 similar comments
@davydov-d
Copy link
Collaborator Author

/publish connector=connectors/source-salesforce

@davydov-d
Copy link
Collaborator Author

/publish connector=connectors/source-salesforce

@davydov-d
Copy link
Collaborator Author

davydov-d commented Feb 15, 2023

/publish connector=connectors/source-salesforce

🕑 Publishing the following connectors:
connectors/source-salesforce
https://github.com/airbytehq/airbyte/actions/runs/4183783777


Connector Did it publish? Were definitions generated?
connectors/source-salesforce

if you have connectors that successfully published but failed definition generation, follow step 4 here ▶️

@airbyteio airbyteio temporarily deployed to more-secrets February 15, 2023 12:55 — with GitHub Actions Inactive
@airbyteio airbyteio temporarily deployed to more-secrets February 15, 2023 12:55 — with GitHub Actions Inactive
@davydov-d davydov-d temporarily deployed to more-secrets February 15, 2023 13:43 — with GitHub Actions Inactive
@davydov-d davydov-d temporarily deployed to more-secrets February 15, 2023 13:43 — with GitHub Actions Inactive
@davydov-d
Copy link
Collaborator Author

/approve-and-merge reason="A followup for oncall #1403"

@octavia-approvington
Copy link
Contributor

This code is at peace with itself
imagine karate kid approving

@octavia-approvington octavia-approvington merged commit 53a5bd8 into master Feb 15, 2023
@octavia-approvington octavia-approvington deleted the ddavydov/#20703-source-salesforce-fix-props-chunk-length branch February 15, 2023 14:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/connectors Connector related issues area/documentation Improvements or additions to documentation connectors/source/salesforce team/connectors-python
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

6 participants