Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature/map datacite metadata to metax metadata #387

Conversation

genie9
Copy link
Contributor

@genie9 genie9 commented Mar 30, 2022

Description

This PR will add a mapping between Datacite metadata and Metax metadata

Related issues

closes #327

Type of change

  • New feature (non-breaking change which adds functionality)
  • This change requires a documentation update (this needs a follow up PR)

Changes Made

  • Adds dedicated folder for Metax reference data with json file on classification on identifiers type
  • Adds mapper class
  • Adds some debug mappings to better follow Metax calls

Testing

  • Integration Tests

Mentions

@genie9 genie9 marked this pull request as draft March 30, 2022 11:39
@genie9 genie9 force-pushed the feature/map-datacite-metadata-to-metax-metadata branch from fd4cf7f to dcb4359 Compare March 30, 2022 17:06
Copy link
Contributor

@blankdots blankdots left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

these are required for prod container to start

metadata_backend/conf/conf.py Outdated Show resolved Hide resolved
setup.py Outdated Show resolved Hide resolved
@genie9 genie9 force-pushed the feature/map-datacite-metadata-to-metax-metadata branch from ea3f585 to 48450ed Compare March 31, 2022 11:19
@blankdots blankdots self-requested a review March 31, 2022 11:54
@blankdots blankdots added this to In progress in SD Submit via automation Apr 4, 2022
Copy link
Contributor

@blankdots blankdots left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Required change:

  • keywords might need to be adjusted to changes from keywords as list instead of array #390
  • (if possible) metax.json as test file for integration tests so we don't have a big object in the tests

It seems we introduced a log of .info logs, some might be required some not. Please consider that in prod we will have the log level .info so unless it is really required, it might be advisable to default to .debug log.

metadata_backend/api/handlers/object.py Outdated Show resolved Hide resolved
metadata_backend/api/handlers/object.py Outdated Show resolved Hide resolved
tests/integration/run_tests.py Outdated Show resolved Hide resolved
metadata_backend/helpers/metax_mapper.py Outdated Show resolved Hide resolved
SD Submit automation moved this from In progress to Review in progress Apr 4, 2022
@genie9 genie9 force-pushed the feature/metax-integration branch from 9498188 to edb7992 Compare April 4, 2022 13:07
@genie9 genie9 force-pushed the feature/map-datacite-metadata-to-metax-metadata branch from 48450ed to 05ab87c Compare April 5, 2022 12:26
@genie9 genie9 marked this pull request as ready for review April 5, 2022 13:05
@genie9 genie9 requested a review from blankdots April 5, 2022 13:05
Copy link
Contributor

@blankdots blankdots left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

2 minor comments, other than that looks good.

metadata_backend/helpers/metax_mapper.py Outdated Show resolved Hide resolved
metadata_backend/helpers/metax_mapper.py Show resolved Hide resolved
SD Submit automation moved this from Review in progress to Reviewer approved Apr 6, 2022
@genie9 genie9 force-pushed the feature/map-datacite-metadata-to-metax-metadata branch from 69c45b7 to 92bf5f4 Compare April 6, 2022 09:22
@genie9 genie9 merged commit 4e5b528 into feature/metax-integration Apr 6, 2022
SD Submit automation moved this from Reviewer approved to Done Apr 6, 2022
@genie9 genie9 deleted the feature/map-datacite-metadata-to-metax-metadata branch April 6, 2022 09:44
@blankdots blankdots mentioned this pull request Apr 7, 2022
6 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
SD Submit
  
Done
Development

Successfully merging this pull request may close these issues.

Map schemas between Metax Dataset schema and SD Submit schemas Datacite, Study and Dataset
2 participants