Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Info Version from conformed columns #1898

Closed
AdrianOlosutean opened this issue Aug 31, 2021 · 2 comments · Fixed by #1933
Closed

Info Version from conformed columns #1898

AdrianOlosutean opened this issue Aug 31, 2021 · 2 comments · Fixed by #1933
Assignees
@AdrianOlosutean
Labels
Conformance Conformance Job affected feature New feature priority: medium Important but not urgent Streaming Conformance on streaming data sources

Comments

@AdrianOlosutean
Copy link
Contributor

AdrianOlosutean commented Aug 31, 2021 •
edited

Background

Currently the Info Version can only be taken from columns prior to conformance, which is a bit restrictive

Feature

Add the ability to specify conformed columns as columns for enceladus_info_version
@AdrianOlosutean AdrianOlosutean added feature New feature Conformance Conformance Job affected priority: undecided Undecided priority to be assigned after discussion Streaming Conformance on streaming data sources labels Aug 31, 2021
@benedeki benedeki added priority: medium Important but not urgent and removed priority: undecided Undecided priority to be assigned after discussion labels Aug 31, 2021
@benedeki
Copy link
Collaborator

benedeki commented Sep 1, 2021

Useful subtask of this would be to generate the expected schema after conformance phase.

@AdrianOlosutean AdrianOlosutean mentioned this issue Sep 24, 2021
Merged
@AdrianOlosutean AdrianOlosutean changed the title Info Version and Info Date from conformed columns Info Version from conformed columns Sep 24, 2021
@AdrianOlosutean
Copy link
Contributor Author

Release notes
enceladus_info_version can now be taken from a conformed column in HyperConformance

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@AdrianOlosutean AdrianOlosutean

Labels
Conformance Conformance Job affected feature New feature priority: medium Important but not urgent Streaming Conformance on streaming data sources
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

1898 Conformed columns for enceladus_info_version AbsaOSS/enceladus
2 participants
@AdrianOlosutean @benedeki