Skip to content

Closes #747 (data normalization inconsistencies)#748

Merged
galtay merged 13 commits intobigscience-workshop:mainfrom
davidkartchner:fix_data_inconsistencies
Nov 19, 2022
Merged

Closes #747 (data normalization inconsistencies)#748
galtay merged 13 commits intobigscience-workshop:mainfrom
davidkartchner:fix_data_inconsistencies

Conversation

@davidkartchner
Copy link
Contributor

This dataset closes Issue #747, which identifies multiple inconsistencies in the normalization entities across datasets. Specifically, it does the following:

  • Puts multiple normalizations for ncbi_disease into a list rather than concatenating them into a single normalization string
  • Correctsnlm_gene and gnormplus to have the same name for the linked ontology (NCBIGene) rather than different names for this ontology
  • Corrects ncbi_disease and bc5cdr to use same casing for MESH ontology
  • Ensures that db_id values in medmentions_st21pv normalizations are a UMLS CUI with no prepended UMLS:

Justification for this PR were further discussed with @galtay and @phlobo on slack.

Copy link
Collaborator

@galtay galtay left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nice work!

@galtay galtay merged commit c1f1d08 into bigscience-workshop:main Nov 19, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants