Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix #3217 - Test case props should be unique #3220

Merged
merged 6 commits into from Mar 7, 2022

Conversation

pmbrull
Copy link
Collaborator

@pmbrull pmbrull commented Mar 7, 2022

Describe your changes :

This PR fixes #3217

When parsing JSONs into pydantic classes we need the config dict to be unique, otherwise pydantic messes up and does not pick the proper class. In this PR I am updating some names of properties to offer the unicity to the parser, but we will need to maybe rethink a bit the defs.

We will still need to fix the columnValuesToBeUnique vs. columnValuesToBeNotNull. As config is empty in these cases, we cannot guarantee that the proper class gets parsed. cc @harshach I'll open a new issue for them.

cc @Sachin-chaurasiya @ShaileshParmar11, please review the updated JSONs in case we need to make some naming changes in the UI.

Thanks,

Type of change :

  • Bug fix
  • Improvement
  • New feature
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • Documentation

Frontend Preview (Screenshots) :

For frontend related change, please link screenshots of your changes preview! Optional for backend related changes.

Checklist:

  • I have read the CONTRIBUTING document.
  • I have performed a self-review of my own.
  • I have tagged my reviewers below.
  • I have commented on my code, particularly in hard-to-understand areas.
  • My changes generate no new warnings.
  • I have added tests that prove my fix is effective or that my feature works.
  • All new and existing tests passed.

Reviewers

@github-actions
Copy link

github-actions bot commented Mar 7, 2022

Schema Change Detected. Needs ingestion-core version bump

Please run make core_bump_version_dev in the project's root and commit the changes to _version.py in this PR. Please ignore if this has been handled already.

test_case = ColumnTestCase.parse_obj(obj)

# TODO: we should parse this properly
# assert isinstance(test_case.config, ColumnValuesToBeNotNull)
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

to be fixed

@sonarcloud
Copy link

sonarcloud bot commented Mar 7, 2022

[open-metadata-ingestion] Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 0 Code Smells

0.0% 0.0% Coverage
0.0% 0.0% Duplication

@sonarcloud
Copy link

sonarcloud bot commented Mar 7, 2022

[catalog] Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 0 Code Smells

No Coverage information No Coverage information
0.0% 0.0% Duplication

@pmbrull
Copy link
Collaborator Author

pmbrull commented Mar 7, 2022

I'll merge this in to continue with the testing. Let me know if there's anything we'd need to change here

@pmbrull pmbrull merged commit 954908e into open-metadata:main Mar 7, 2022
"value": {
"description": "Expected number of columns to equal to a {value}",
"columnCount": {
"description": "Expected number of columns to equal to a {value}",
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
"description": "Expected number of columns to equal to a {value}",
"description": "Expected number of columns to equal to a {columnCount}",

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Data Quality - Test case props should be unique
2 participants