Schema updates for current and upcoming asdf changes

[braingram]

Changes

asdf is working on making the current development version of the ASDF standard (1.6.0) stable (see asdf-format/asdf#1744 for details). As the 1.6.0 version contains new versions of a few core schemas (including ndarray). This PR updates the weldx schemas for these upcoming changes (and applies a few other related fixes).

• update schema examples that use ndarray-1.0.0 adding a asdf-standard requirement to force these examples to use ASDF standard 1.5.0 (where ndarray-1.0.0 exists)
• update schema "id"s to match "uri"s used to register the schemas with asdf
• update manifest generation script to use the uri prefix used to register the manifests (see below)

For the manifests, the id in the files follow the form .../weldx/manifests/...

weldx/weldx/manifests/weldx-0.1.2.yaml

Line 3 in 2bceb68

id: asdf://weldx.bam.de/weldx/manifests/weldx-0.1.2

However these files are registered:

weldx/weldx/asdf/extension.py

Lines 27 to 33 in 2bceb68

	mapping = DirectoryResourceMapping(
	MANIFEST_PATH,
	WELDX_EXTENSION_URI_BASE,
	recursive=True,
	filename_pattern="*.yaml",
	stem_filename=True,
	)

using the WELDX_EXTENSION_URI_BASE uri prefix:

weldx/weldx/asdf/constants.py

Line 9 in 2bceb68

WELDX_EXTENSION_URI_BASE = "asdf://weldx.bam.de/weldx/extensions/"

which uses .../weldx/extensions. This means that these manifest resources are available (via the asdf resource_manager) using ../weldx/extensions/... uris yet have ids with .../weldx/manifests/

>> import asdf
>> manifest = asdf.schema.load_schema("asdf://weldx.bam.de/weldx/extensions/weldx-0.1.2")
>> manifest['id']
asdf://weldx.bam.de/weldx/manifests/weldx-0.1.2

This PR changes the ids to match the uris.

This PR also updates SerializationContext imports to use asdf.extension for asdf version >= 3.0.0 to avoid DeprecationWarning messages form importing asdf.asdf and SerializationContext from asdf.asdf.

Related Issues

Fixes #900

Checks

• updated CHANGELOG.md
• updated tests/
• updated doc/
• update example/tutorial notebooks
• update manifest file

[github-actions]

Test Results

0 tests  ±0   0 ✅ ±0   0s ⏱️ ±0s
0 suites ±0   0 💤 ±0 
0 files   ±0   0 ❌ ±0 

Results for commit 1c85c27. ± Comparison against base commit d7be2b0.

♻️ This comment has been updated with latest results.

[codecov]

Codecov Report

Attention: Patch coverage is 75.00000% with 3 lines in your changes missing coverage. Please review.

Project coverage is 96.34%. Comparing base (5ad2929) to head (adf7b16).
Report is 20 commits behind head on master.

Files	Patch %	Lines
weldx/asdf/types.py	75.00%	1 Missing ⚠️
weldx/asdf/util.py	75.00%	1 Missing ⚠️
weldx/tags/base_types.py	75.00%	1 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##           master     #910      +/-   ##
==========================================
- Coverage   96.48%   96.34%   -0.15%     
==========================================
  Files          95       95              
  Lines        6293     6318      +25     
==========================================
+ Hits         6072     6087      +15     
- Misses        221      231      +10     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[CagtayFabry]

Hi @braingram,
thank you for the explanations.

I am planning a rework on some of the code for asdf>=3 (hopefully soon)
In that light would it make sense to include this as a transition and remove any asdf 2.x related code in the next major release of weldx?

[braingram]

Thanks for taking a look!

I am planning a rework on some of the code for asdf>=3 (hopefully soon) In that light would it make sense to include this as a transition and remove any asdf 2.x related code in the next major release of weldx?

That sounds great. Let me know if there's anything I can do to help (and feel free to ping me when the changes are ready for review or if you run into any issues). There are a few changes in 3.1.0 (changelog here) that might be useful including:

• starting the transition from copy_arrays to memmap (in preparation for making memmap=False as the default) See: add memmap option to asdf.open asdf-format/asdf#1667
• introduction of asdf.util.load_yaml for loading just the yaml portion of an asdf file (as python builtin types or asdf tagged objects): Introduce asdf.util.load_yaml asdf-format/asdf#1700

[CagtayFabry]

Thank you, I followed the 3.0/3.1 release notes and the changes will make for some big QOL improvements here!

[braingram]

FYI the asdf development branch will soon be transitioning to asdf 4.0 where ASDF standard 1.6.0 will be the default.