From 3c5dc0ef60bc18b9bb3ec9238f69ccd8df7708c3 Mon Sep 17 00:00:00 2001 From: doomdagadiggiedahdah <77366355+doomdagadiggiedahdah@users.noreply.github.com> Date: Sun, 11 Aug 2024 23:36:14 -0700 Subject: [PATCH 1/2] Update datasets-adding.md updated broken links --- docs/hub/datasets-adding.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/docs/hub/datasets-adding.md b/docs/hub/datasets-adding.md index 50f18c725..e571f4c77 100644 --- a/docs/hub/datasets-adding.md +++ b/docs/hub/datasets-adding.md @@ -107,8 +107,8 @@ After uploading your dataset, make sure the Dataset Viewer correctly shows your ## Large scale datasets -The Hugging Face Hub supports large scale datasets, usually uploaded in Parquet (e.g. via `push_to_hub()` using [🤗 Datasets](../datasets/index)) or [WebDataset](https://github.com/webdataset/webdataset) format. +The Hugging Face Hub supports large scale datasets, usually uploaded in Parquet (e.g. via `push_to_hub()` using [🤗 Datasets](https://huggingface.co/docs/datasets/v2.20.0/en/package_reference/main_classes#datasets.Dataset.push_to_hub)) or [WebDataset](https://github.com/webdataset/webdataset) format. You can upload large scale datasets at high speed using the `huggingface-hub` library. -See [how to upload a folder by chunks](../huggingface_hub/guides/upload#upload-a-folder-by-chunks), the [tips and tricks for large uploads](../huggingface_hub/guides/upload#tips-and-tricks-for-large-uploads) and the [repository limitations and recommendations](./repositories-recommendations). +See [how to upload a folder by chunks](https://huggingface.co/docs/huggingface_hub/guides/upload#upload-a-folder-by-chunks), the [tips and tricks for large uploads](https://huggingface.co/docs/huggingface_hub/guides/upload#tips-and-tricks-for-large-uploads) and the [repository limitations and recommendations](./repositories-recommendations). From 9a7e5b17d03f73981908d43921acddbd44051d4e Mon Sep 17 00:00:00 2001 From: doomdagadiggiedahdah <77366355+doomdagadiggiedahdah@users.noreply.github.com> Date: Tue, 13 Aug 2024 02:11:41 -0700 Subject: [PATCH 2/2] Update docs/hub/datasets-adding.md Co-authored-by: Julien Chaumond --- docs/hub/datasets-adding.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/hub/datasets-adding.md b/docs/hub/datasets-adding.md index e571f4c77..b321880b4 100644 --- a/docs/hub/datasets-adding.md +++ b/docs/hub/datasets-adding.md @@ -107,7 +107,7 @@ After uploading your dataset, make sure the Dataset Viewer correctly shows your ## Large scale datasets -The Hugging Face Hub supports large scale datasets, usually uploaded in Parquet (e.g. via `push_to_hub()` using [🤗 Datasets](https://huggingface.co/docs/datasets/v2.20.0/en/package_reference/main_classes#datasets.Dataset.push_to_hub)) or [WebDataset](https://github.com/webdataset/webdataset) format. +The Hugging Face Hub supports large scale datasets, usually uploaded in Parquet (e.g. via `push_to_hub()` using [🤗 Datasets](https://huggingface.co/docs/datasets/main/en/package_reference/main_classes#datasets.Dataset.push_to_hub)) or [WebDataset](https://github.com/webdataset/webdataset) format. You can upload large scale datasets at high speed using the `huggingface-hub` library.