Refactor/public bucket access

[j279li]

Refactors the Polaris Hub client and storage modules to simplify authentication handling and allow for public access of artifacts. Key changes include removing authentication for reads, and updating dataset and benchmark retrieval methods to get data path from the API response.

Authentication and Session Management Updates:

• Removedauthentication checks for retrieval methods in PolarisHubClient and added explicit token validation where necessary, such as in upload_results and upload_model.
• Introduced a mode parameter in StorageSession to control authentication requirements, making it optional for read operations but mandatory for write operations.

Dataset and Benchmark Handling Improvements:

• Simplified dataset and benchmark retrieval methods by replacing _base_request_to_hub with request and using metadata fields (zarr_path, table_path) for loading resources.

Storage Refactor:

• Replaced custom S3 storage logic for public reads in StorageSession with fsspec for handling get file and store operations.

Codebase Simplification:

• Consolidated logic for handling Zarr archives and storage paths across dataset-related methods.

[j279li]

Tests right now are failing because the Hub hasn't been updated yet (as the client isn't sending authentication tokens anymore).

[Andrewq11]

Thanks, @j279li! A lot of good work here. I've left some comments related to suggestions and clarifications that we should cover.

Also, I've requested the wisdom of @jstlaurent on some storage action organization.

[jstlaurent]

Looks good! A few questions and suggestions. 😄

[Andrewq11]

Nice work! Left a few small comments. Looks good on my side after those.