Add MedImg for streaming

[lhallee]

Feature request

Host the MedImg dataset (similar to Imagenet but for biomedical images).

Motivation

There is a clear need for biomedical image foundation models and large scale biomedical datasets that are easily streamable. This would be an excellent tool for the biomedical community.

Your contribution

MedImg can be found here.

[lhallee]

@mariosasko, @lhoestq, @albertvillanova
Hello! Can anyone help? or can you guys suggest who can help with this?

[lhoestq]

Hi ! Feel free to download the dataset and create a Dataset object with it.

Then your'll be able to use push_to_hub() to upload the dataset to HF in Parquet format and make it streamable :)

[lhallee]

Hi ! Feel free to download the dataset and create a Dataset object with it.

Then your'll be able to use push_to_hub() to upload the dataset to HF in Parquet format and make it streamable :)

The dataset is several TB in total, which I do not have the resources to handle.