[Bug]: Remote read with/without consolidated metadata is not being tested

[oruebel]

What happened?

#184 adds a bug fix for reading files from S3 with consolidated metadata. However, we currently are not testing reading with consolidated metadata only for local files. Since consolidated metadata is particularly relevant for reading from S3, it would be useful to add tests to ensure this is working correctly with files on S3 as well.

Steps to Reproduce

I believe we currently do no have a test file with consolidated metadata on DANDI. It would be useful to add some small Zarr files with and without consolidated metadata to our test DANDI dataset so that we can test that the remote files are being opened correctly in the streaming tests. Currently we are using a dataset from the Allen Institute for the streaming tests but it would be useful to test the behavior for streaming access more thoroughly using our own files.

To test whether a file is indeed opened correctly with consolidated metadata we can use the following check in the unit tests :

hdmf-zarr/tests/unit/test_zarrio.py

Lines 160 to 166 in afaab5f

	with ZarrIO(self.store, mode='r') as read_io:
	read_io.open()
	self.assertIsInstance(read_io.file.store, zarr.storage.ConsolidatedMetadataStore)
	# Confirm that opening the file IN 'r-' mode indeed forces a regular open without consolidated metadata
	with ZarrIO(self.store, mode='r-') as read_io:
	read_io.open()
	self.assertIsInstance(read_io.file.store, zarr.storage.DirectoryStore)

Traceback

N/A

Operating System

macOS

Python Executable

Conda

Python Version

3.9

Package Versions

No response

Code of Conduct

• I agree to follow this project's Code of Conduct
• Have you checked the Contributing document?
• Have you ensured this bug was not already reported?