Update datasets 2.19.1 with hotfix to shorten long logs

[albertvillanova]

Update datasets 2.19.1 with hotfix to shorten long logs.

[lhoestq]

Thanks ! Feel free to merge when the merge conflicts are fixed

[albertvillanova]

There is an incompatibility after the merge of:

• Use huggingface-hub with paths-info fix #2781

When I try to lock the poetry files, I get:

Because huggingface-hub[hf-transfer] (0.20.0.dev0) @ git+https://github.com/huggingface/huggingface_hub.git@657a1bdcc0545309463e8651f62010154e9b3792 depends on huggingface-hub (0.20.0.dev0) @ git+https://github.com/huggingface/huggingface_hub.git@657a1bdcc0545309463e8651f62010154e9b3792
and datasets[audio,vision] (2.19.1) @ git+https://github.com/huggingface/datasets.git@3638183e2f7e0dce8924e46e7cc21bf6d5d7adfb depends on huggingface-hub (>=0.21.2), huggingface-hub[hf-transfer] (0.20.0.dev0) @ git+https://github.com/huggingface/huggingface_hub.git@657a1bdcc0545309463e8651f62010154e9b3792 is incompatible with datasets[audio,vision] (2.19.1) @ git+https://github.com/huggingface/datasets.git@3638183e2f7e0dce8924e46e7cc21bf6d5d7adfb.
And because libcommon (0.6.8) @ file:///home/albert/projects/forks/huggingface/datasets-server/libs/libcommon depends on datasets[audio,vision] (2.19.1) @ git+https://github.com/huggingface/datasets.git@3638183e2f7e0dce8924e46e7cc21bf6d5d7adfb, huggingface-hub[hf-transfer] (0.20.0.dev0) @ git+https://github.com/huggingface/huggingface_hub.git@657a1bdcc0545309463e8651f62010154e9b3792 is incompatible with libcommon (0.6.8) @ file:///home/albert/projects/forks/huggingface/datasets-server/libs/libcommon.
So, because cache-maintenance depends on libcommon (0.6.8) @ file:///home/albert/projects/forks/huggingface/datasets-server/libs/libcommon which depends on huggingface-hub[hf-transfer] (0.20.0.dev0) @ git+https://github.com/huggingface/huggingface_hub.git@657a1bdcc0545309463e8651f62010154e9b3792, version solving failed.

[albertvillanova]

I don't know why it sees 0.20.0.dev0 as the version of huggingface-hub...

[albertvillanova]

I get the same issue even on the main branch:

git checkout main
cd jobs/cache_maintenance
poetry@1.8.2 lock --no-update

Do you have the same issue?

[albertvillanova]

Apparently, it was an issue with my local Python environments.

I deleted my .venv directories and then I locked the poetry files with success.