From 8e250b87ee0d4f31f2356504b6e902e649f25b0a Mon Sep 17 00:00:00 2001 From: Wauplin Date: Thu, 14 Sep 2023 11:02:33 +0200 Subject: [PATCH 1/2] Update Space to dataset storage docs --- docs/hub/spaces-sdks-docker.md | 2 +- docs/hub/spaces-storage.md | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/docs/hub/spaces-sdks-docker.md b/docs/hub/spaces-sdks-docker.md index f99c8a5ac..2aca67cec 100644 --- a/docs/hub/spaces-sdks-docker.md +++ b/docs/hub/spaces-sdks-docker.md @@ -133,7 +133,7 @@ COPY --chown=user checkpoint . The data written on disk is lost whenever your Docker Space restarts, unless you opt-in for a [persistent storage](./spaces-storage) upgrade. -You can also use our Datasets Hub for specific cases, where you can store state and data in a git LFS repository. You can find an example of persistence [here](https://huggingface.co/spaces/julien-c/persistent-data), which uses the [`huggingface_hub` library](https://huggingface.co/docs/huggingface_hub/index) for programmatically uploading files to a dataset repository. +You can also use our Datasets Hub for specific cases, where you can store state and data in a git LFS repository. You can find an example of persistence [here](https://huggingface.co/spaces/Wauplin/space_to_dataset_saver), which uses the [`huggingface_hub` library](https://huggingface.co/docs/huggingface_hub/index) for programmatically uploading files to a dataset repository. This Space example along with [this guide](https://huggingface.co/docs/huggingface_hub/main/en/guides/upload#scheduled-uploads) will help you define which solution fits best depending on your data type. Finally, in some cases, you might want to use an external storage solution from your Space's code like an external hosted DB, S3, etc. diff --git a/docs/hub/spaces-storage.md b/docs/hub/spaces-storage.md index d7db1d7f3..57a8da9f5 100644 --- a/docs/hub/spaces-storage.md +++ b/docs/hub/spaces-storage.md @@ -53,7 +53,7 @@ Additional information about billing can be found in the [dedicated Hub-wide sec If you need to persist data that lives longer than your Space, you could use a [dataset repo](./datasets). -You can find an example of persistence [here](https://huggingface.co/spaces/julien-c/persistent-data), which uses the [`huggingface_hub` library](https://huggingface.co/docs/huggingface_hub/index) for programmatically uploading files to a dataset repository. +You can find an example of persistence [here](https://huggingface.co/spaces/Wauplin/space_to_dataset_saver), which uses the [`huggingface_hub` library](https://huggingface.co/docs/huggingface_hub/index) for programmatically uploading files to a dataset repository. This Space example along with [this guide](https://huggingface.co/docs/huggingface_hub/main/en/guides/upload#scheduled-uploads) will help you define which solution fits best your data type. Visit the [`datasets` library](https://huggingface.co/docs/datasets/index) documentation and the [`huggingface_hub` client library](https://huggingface.co/docs/huggingface_hub/index) documentation for more information on how to programmatically interact with dataset repos. From fc532d2f9d30e516d3967171bc84b9890939025d Mon Sep 17 00:00:00 2001 From: Wauplin Date: Thu, 14 Sep 2023 11:06:56 +0200 Subject: [PATCH 2/2] foo --- docs/hub/spaces-sdks-docker.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/hub/spaces-sdks-docker.md b/docs/hub/spaces-sdks-docker.md index 2aca67cec..8a47ba744 100644 --- a/docs/hub/spaces-sdks-docker.md +++ b/docs/hub/spaces-sdks-docker.md @@ -133,7 +133,7 @@ COPY --chown=user checkpoint . The data written on disk is lost whenever your Docker Space restarts, unless you opt-in for a [persistent storage](./spaces-storage) upgrade. -You can also use our Datasets Hub for specific cases, where you can store state and data in a git LFS repository. You can find an example of persistence [here](https://huggingface.co/spaces/Wauplin/space_to_dataset_saver), which uses the [`huggingface_hub` library](https://huggingface.co/docs/huggingface_hub/index) for programmatically uploading files to a dataset repository. This Space example along with [this guide](https://huggingface.co/docs/huggingface_hub/main/en/guides/upload#scheduled-uploads) will help you define which solution fits best depending on your data type. +You can also use our Datasets Hub for specific cases, where you can store state and data in a git LFS repository. You can find an example of persistence [here](https://huggingface.co/spaces/Wauplin/space_to_dataset_saver), which uses the [`huggingface_hub` library](https://huggingface.co/docs/huggingface_hub/index) for programmatically uploading files to a dataset repository. This Space example along with [this guide](https://huggingface.co/docs/huggingface_hub/main/en/guides/upload#scheduled-uploads) will help you define which solution fits best your data type. Finally, in some cases, you might want to use an external storage solution from your Space's code like an external hosted DB, S3, etc.