Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Data Quality Code Lists #53

Merged
merged 8 commits into from
Feb 2, 2024
Merged

Data Quality Code Lists #53

merged 8 commits into from
Feb 2, 2024

Conversation

jwaspin
Copy link
Contributor

@jwaspin jwaspin commented Jan 22, 2024

Closes #37
Closes #38
Closes #40
Closes #52
Closes #55

Changes

Testing

http://23.23.4.125:8051/

Rename iso_dataQualityElement.yml to adiwg_dataQualityElement.yml.
Fix codelistName, source, and sourceName.
@jwaspin jwaspin linked an issue Jan 22, 2024 that may be closed by this pull request
@jwaspin jwaspin marked this pull request as draft January 22, 2024 19:38
@hmaier-fws hmaier-fws self-assigned this Jan 24, 2024
@jwaspin jwaspin marked this pull request as ready for review January 24, 2024 17:02
@jwaspin
Copy link
Contributor Author

jwaspin commented Jan 25, 2024

@hmaier-fws Just deployed the test container and updated the comment with the link

@jwaspin
Copy link
Contributor Author

jwaspin commented Jan 25, 2024

@dwalt I'm responding here since the other PR was closed, but the changes can be viewed in the test instance. I will update 8050 again once this one is merged.

Copy link
Contributor

@hmaier-fws hmaier-fws left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't think this closes #39, I believe that codelist is intended to populate a mdEditor pick as opposed to defining the actual ISO data quality class names. I've flagged that issue for discussion.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

List matches definitions as described in https://standards.iso.org/iso/19157/-2/dqm/1.0/codelists.xml

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code names and descriptions match those described by https://standards.iso.org/iso/19157/-2/mdq/1.0/codelists.xml. Spelling of "data set" differs from ISO, which uses "dataset'.

The above codelist, and https://standards.iso.org/iso/19157/resources/Codelists/cat/codelists.xml, both provide a list definition of "description of the evaluation method and procedure applied". Our list description seems to be based on https://standards.iso.org/iso/19157/resources/Codelists/gml/DQ_EvaluationMethodTypeCode.xml which uses "type of method for evaluating an identified data quality measure".

I'll merge this file and have created #56 to address the outstanding issues.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Seems to be missing something. I'll merge this file and have created #58 to discuss/address any outstanding issues.

DQ_IndirectEvaluation type is not listed. See:

The codeName: data evaluation method does not seem to be listed by ESIP or ISO. See:

Is this supposed to correspond with "DQ_DataInspection"?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Most codes match definitions provided by:

but there seem to be several discrepancies. I'll merge this file and have created #57 to address the outstanding issues.

@hmaier-fws hmaier-fws merged commit 009382d into dev Feb 2, 2024
hmaier-fws added a commit that referenced this pull request Feb 2, 2024
* Remove "geographic" from description (#54)

* Remove "geographic" from description

* Update iso_scope.yml

Update definition from "a dataset" to "the dataset" to match the definition as defined in https://standards.iso.org/iso/19115/-3/mcc/1.0/codelists.xml.

---------

Co-authored-by: Hilmar Maier <hilmar_maier@fws.gov>

* Data Quality Code Lists (#53)

* Fix Data Quality Element

Rename iso_dataQualityElement.yml to adiwg_dataQualityElement.yml.
Fix codelistName, source, and sourceName.

* Add iso_valueStructure.yml

* Add iso_evaluationMethodTypeCode

* Add adiwg_evaluationMethod

* Add iso_uom

* Rename iso_uom to adiwg_unitsOfMeasure

Also add more units.

* Remove Comment

* Update .gitignore

---------

Co-authored-by: Johnathan <jwaspin@users.noreply.github.com>
@jwaspin jwaspin deleted the feature/data-quality branch February 5, 2024 22:01
@hmaier-fws hmaier-fws linked an issue May 24, 2024 that may be closed by this pull request
2 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
2 participants