Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUGFIX] - Prevent duplicate Expectations in Validation Results when Exceptions are triggered #9456

Conversation

josectobar
Copy link
Member

@josectobar josectobar commented Feb 15, 2024

Fix bug where duplicate Expectation in a Expectation Validation Result were getting added when error exceptions were captured. This was being caused when the aborted_exception_info was getting duplicated on retry (3x for each retry).
Changes:

  • Only one error is capture on every retry, overwriting the previous one.

  • A dictionary with the metric id as string key and an exception is added into an Expectation Validation Result instead of adding an EVR for each exception.

  • Description of PR changes above includes a link to an existing GitHub issue

  • PR title is prefixed with one of: [BUGFIX], [FEATURE], [DOCS], [MAINTENANCE], [CONTRIB]

  • Code is linted - run invoke lint (uses black + ruff)

  • Appropriate tests and docs have been updated

For more information about contributing, see Contribute.

After you submit your PR, keep the page open and monitor the statuses of the various checks made by our continuous integration process at the bottom of the page. Please fix any issues that come up and reach out on Slack if you need help. Thanks for contributing!

@ghost
Copy link

ghost commented Feb 15, 2024

👇 Click on the image for a new way to code review

Review these changes using an interactive CodeSee Map

Legend

CodeSee Map legend

@josectobar josectobar changed the base branch from 0.18.x to develop February 17, 2024 01:03
@josectobar josectobar force-pushed the f/PP-918-running-a-validation-with-one-expectation-can-fail-silently-and-produce-multiple-validation-resultstable-name-custom-renderer-comments branch from 70ee096 to bafd09c Compare February 17, 2024 01:09
Copy link

netlify bot commented Feb 17, 2024

Deploy Preview for niobium-lead-7998 canceled.

Name Link
🔨 Latest commit 5d1d3cd
🔍 Latest deploy log https://app.netlify.com/sites/niobium-lead-7998/deploys/65d8f1585a85b3000893a517

@josectobar josectobar force-pushed the f/PP-918-running-a-validation-with-one-expectation-can-fail-silently-and-produce-multiple-validation-resultstable-name-custom-renderer-comments branch from bafd09c to ac7fed1 Compare February 17, 2024 01:38
pre-commit-ci bot and others added 6 commits February 17, 2024 01:39
…th-one-expectation-can-fail-silently-and-produce-multiple-validation-resultstable-name-custom-renderer-comments' into f/PP-918-running-a-validation-with-one-expectation-can-fail-silently-and-produce-multiple-validation-resultstable-name-custom-renderer-comments
@josectobar josectobar marked this pull request as ready for review February 17, 2024 02:04
Copy link
Contributor

@NathanFarmer NathanFarmer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good so far. I will wait for tests to pass, because there are a lot more to run.

josectobar and others added 9 commits February 20, 2024 20:19
…th-one-expectation-can-fail-silently-and-produce-multiple-validation-resultstable-name-custom-renderer-comments' into f/PP-918-running-a-validation-with-one-expectation-can-fail-silently-and-produce-multiple-validation-resultstable-name-custom-renderer-comments
…tions into f/PP-918-running-a-validation-with-one-expectation-can-fail-silently-and-produce-multiple-validation-resultstable-name-custom-renderer-comments
Copy link
Contributor

@NathanFarmer NathanFarmer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good! It should be pretty trivial to update the mysql tests.

tests/validator/test_validator.py Outdated Show resolved Hide resolved
josectobar and others added 16 commits February 21, 2024 20:35
…pectation-can-fail-silently-and-produce-multiple-validation-resultstable-name-custom-renderer-comments
…th-one-expectation-can-fail-silently-and-produce-multiple-validation-resultstable-name-custom-renderer-comments' into f/PP-918-running-a-validation-with-one-expectation-can-fail-silently-and-produce-multiple-validation-resultstable-name-custom-renderer-comments
…tions into f/PP-918-running-a-validation-with-one-expectation-can-fail-silently-and-produce-multiple-validation-resultstable-name-custom-renderer-comments
@josectobar josectobar added this pull request to the merge queue Feb 23, 2024
Merged via the queue into develop with commit 2bb6081 Feb 23, 2024
67 checks passed
@josectobar josectobar deleted the f/PP-918-running-a-validation-with-one-expectation-can-fail-silently-and-produce-multiple-validation-resultstable-name-custom-renderer-comments branch February 23, 2024 21:17
josectobar added a commit that referenced this pull request Feb 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants