Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

50 xml parsers for data reading #59

Merged
merged 24 commits into from
Jul 16, 2024
Merged

Conversation

javihern98
Copy link
Contributor

Added data parsers for SDMX-ML 2.1 files.

This PR adds a dummy class DataSet that will be modified afterwards, once agreed on the functionality that this class will provide, but currently it is necessary to ensure the basic elements are correctly implemented.

@javihern98 javihern98 linked an issue Jul 1, 2024 that may be closed by this pull request
javihern98 and others added 9 commits July 1, 2024 11:25
…l-parsers-for-data-reading

# Conflicts:
#	poetry.lock
#	pyproject.toml
#	src/pysdmx/io/xml/sdmx21/reader/__init__.py
…ed data_read for better readability.

Signed-off-by: javier.hernandez <javier.hernandez@meaningfuldata.eu>
…ed data_read for better readability. Added tests.

Signed-off-by: javier.hernandez <javier.hernandez@meaningfuldata.eu>
…ads a big file.

Modified __extract_structure function from data_read
Signed-off-by: javier.hernandez <javier.hernandez@meaningfuldata.eu>
…data. Coverage stills indicating that there are three lines of code with no use.

Created a new load big file test with new bis_der_50500.xml file.
… into 50-xml-parsers-for-data-reading

# Conflicts:
#	tests/io/xml/sdmx21/reader/test_reader.py
…data. Coverage stills indicating that there is one line of code with no use.

Create a new load big file test with new bis_der_50500.xml file.
…ributes from dedicated test.

Signed-off-by: javier.hernandez <javier.hernandez@meaningfuldata.eu>
@javihern98 javihern98 requested a review from sosna July 8, 2024 10:24
…l-parsers-for-data-reading

# Conflicts:
#	poetry.lock
Signed-off-by: javier.hernandez <javier.hernandez@meaningfuldata.eu>
Signed-off-by: javier.hernandez <javier.hernandez@meaningfuldata.eu>
@javihern98
Copy link
Contributor Author

javihern98 commented Jul 8, 2024

@sosna This PR includes a temporary dataset class to be replaced once CSV parsers are also included and discussions have been made, just to ensure all functionality is consistent to what we have in SDMXthon

src/pysdmx/util/handlers.py Outdated Show resolved Hide resolved
src/pysdmx/util/handlers.py Outdated Show resolved Hide resolved
src/pysdmx/util/handlers.py Outdated Show resolved Hide resolved
src/pysdmx/io/xml/sdmx21/reader/data_read.py Show resolved Hide resolved
…nique_id and used parse_urn. Removed handlers file (redundant). Removed commented code.

Signed-off-by: javier.hernandez <javier.hernandez@meaningfuldata.eu>
Signed-off-by: javier.hernandez <javier.hernandez@meaningfuldata.eu>
@javihern98 javihern98 requested a review from sosna July 9, 2024 13:38
Copy link
Collaborator

@sosna sosna left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great, thanks a lot, @javihern98

…l-parsers-for-data-reading

# Conflicts:
#	poetry.lock
Signed-off-by: javier.hernandez <javier.hernandez@meaningfuldata.eu>
@javihern98 javihern98 merged commit 206c299 into develop Jul 16, 2024
13 checks passed
@javihern98 javihern98 deleted the 50-xml-parsers-for-data-reading branch July 16, 2024 08:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

XML parsers for data reading
2 participants