Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Metadata: Check that normalized files exist #26133

Merged
merged 7 commits into from
May 19, 2023

Conversation

bnchrch
Copy link
Contributor

@bnchrch bnchrch commented May 16, 2023

What

Checks that the normalization images exist on metadata file upload

and adds tests to ensure were doing this check

closes #25538

@bnchrch bnchrch force-pushed the bnchrch/metadata/check-normalization branch from efc679c to b938ede Compare May 18, 2023 23:34
@bnchrch bnchrch requested review from a team and alafanechere May 18, 2023 23:34
Copy link
Contributor

@alafanechere alafanechere left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice additional check! Just minor pytest related suggestions.

return "exists" in image_name and "exists" in version


def setup_upload_mocks(mocker, version_blob_md5_hash, latest_blob_md5_hash, local_file_md5_hash):
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: in pytest the setup teardown pattern is usually declared through the use of fixtures.

@bnchrch bnchrch force-pushed the bnchrch/metadata/check-normalization branch from 1173ed6 to 5627a63 Compare May 19, 2023 19:39
@bnchrch bnchrch merged commit 1c853a7 into master May 19, 2023
19 checks passed
@bnchrch bnchrch deleted the bnchrch/metadata/check-normalization branch May 19, 2023 19:48
nguyenaiden pushed a commit that referenced this pull request May 25, 2023
* Check that normalized files exist

* refactor fixtures

* Mocks

* Update tests

* Format

* Apply suggestions from code review

Co-authored-by: Augustin <augustin@airbyte.io>

* Revert path

---------

Co-authored-by: Augustin <augustin@airbyte.io>
marcosmarxm pushed a commit to natalia-miinto/airbyte that referenced this pull request Jun 8, 2023
* Check that normalized files exist

* refactor fixtures

* Mocks

* Update tests

* Format

* Apply suggestions from code review

Co-authored-by: Augustin <augustin@airbyte.io>

* Revert path

---------

Co-authored-by: Augustin <augustin@airbyte.io>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add a metadata check that normalizationRepository and normalizationTag exists
2 participants