From 033d5c7a7167aa74bac95821d6dc1b0acfa56356 Mon Sep 17 00:00:00 2001 From: SamyOubouaziz Date: Fri, 13 Sep 2024 14:20:19 +0200 Subject: [PATCH 1/5] docs(s3): update lifecycle rule & MPU documentation MTA-5049 --- .../object/how-to/manage-lifecycle-rules.mdx | 49 +++++++------------ 1 file changed, 17 insertions(+), 32 deletions(-) diff --git a/storage/object/how-to/manage-lifecycle-rules.mdx b/storage/object/how-to/manage-lifecycle-rules.mdx index 1bb342398b..a3aa613de0 100644 --- a/storage/object/how-to/manage-lifecycle-rules.mdx +++ b/storage/object/how-to/manage-lifecycle-rules.mdx @@ -28,44 +28,29 @@ With the Scaleway console, you can use lifecycle rules to [manually](/storage/ob 3. Click **Lifecycle rules**. 4. Click **+ Create Lifecycle rule** to add a rule. 5. Enter a name for the rule. -6. Filter the objects you want the rule to be applied to by one or both of the following criteria: - - [**Prefix**](/storage/object/concepts/#prefix): based on the object name and path. The defined rule will be applied to all objects with the same name [prefix](/storage/object/concepts/#prefix). - - [**Tags**](/storage/object/concepts/#tags): comprised of a **key** and an associated **value**. These tags should be defined before rule creation, for either a bucket or an object. You can add one or more tags to your filter. +6. Select the scope of the lifecycle rule: + - Apply the rule to all the objects contained in the bucket. + - Filter the objects you want the rule to be applied to by one or both of the following criteria: + - [**Prefix**](/storage/object/concepts/#prefix): based on the object name and path. The defined rule will be applied to all objects with the same name [prefix](/storage/object/concepts/#prefix). + - [**Tags**](/storage/object/concepts/#tags): comprised of a **key** and an associated **value**. These tags should be defined before rule creation, for either a bucket or an object. You can add one or more tags to your filter. +7. Configure the behavior of the lifecycle rule: + - Automatically transition the current version of your objects to another storage class after a specified number of days. + - Automatically delete the current version of your objects after a specified number of days. + - Automatically cancel [incomplete multipart uploads](/storage/object/api-cli/multipart-uploads/#aborting-a-multipart-upload) after a specified number of days. - +8. Click **Next Step** to proceed. - - Lifecycle rules are limited to 500,000 jobs per day. Beyond this limit, you can [transition](/storage/object/how-to/edit-storage-class/) or [delete](/storage/object/how-to/delete-an-object/) your objects manually. - - -## How to configure transition rules - -If you wish to change the [storage class](/storage/object/concepts/#storage-class) of two or more objects at a time, you can set up a transition rule that will automate the process. - -1. Click **Change object class** to transfer the current version of the objects to a different storage class. -2. Select the new storage class. -3. Enter the desired number of days before transition. -4. Click **Next step** to proceed. -5. Make sure all the information is correct, then click **Create Lifecycle rule** to confirm. +9. Review the summary of your lifecycle rule, then click **Create lifecycle rule** to confirm. - Lifecycle rules only allow the following transitions: - - Standard -> Onezone IA - - Standard -> Glacier - - Onezone IA -> Glacier + - Lifecycle rules are limited to 500,000 jobs per day. Beyond this limit, you can [transition](/storage/object/how-to/edit-storage-class/) or [delete](/storage/object/how-to/delete-an-object/) your objects manually. - Refer to the documentation on [how to manually change the storage class of your objects](/storage/object/how-to/edit-storage-class/) for more information. + - Lifecycle rules only allow the following transitions: + - Standard -> Onezone IA + - Standard -> Glacier + - Onezone IA -> Glacier -## How to configure expiration rules - -If you wish to delete an object after a set number of days, you can set up an expiration rule that will automate the process. - -1. Click **Delete after expiration** to define when the current version of your objects will be deleted. -2. Enter the desired number of days before deletion. -3. Click **Next step** to proceed. -4. Check that all settings are correct and click **Create Lifecycle rule** to confirm. - ## How to disable a lifecycle rule 1. Click **Object Storage** in the **Storage** section of the side menu. A list of your buckets displays. @@ -76,7 +61,7 @@ If you wish to delete an object after a set number of days, you can set up an ex 6. Click **Disable lifecycle rule** to confirm. -Once disabled, the lifecycle rule remains listed and can be enabled again. Click > **Activate** to do so. +Once disabled, the lifecycle rule remains listed and can be enabled again. Click , then select **Activate** to do so. To permanently delete a rule, click , then click **Delete**. \ No newline at end of file From f030770238550ede5ab423f691296f05f8c34b2d Mon Sep 17 00:00:00 2001 From: SamyOubouaziz Date: Fri, 13 Sep 2024 15:37:36 +0200 Subject: [PATCH 2/5] docs(s3): update --- .../object/how-to/abort-incomplete-mpu.mdx | 56 +++++++++++++++++++ .../object/how-to/manage-lifecycle-rules.mdx | 4 +- 2 files changed, 59 insertions(+), 1 deletion(-) create mode 100644 storage/object/how-to/abort-incomplete-mpu.mdx diff --git a/storage/object/how-to/abort-incomplete-mpu.mdx b/storage/object/how-to/abort-incomplete-mpu.mdx new file mode 100644 index 0000000000..34b6c11f0e --- /dev/null +++ b/storage/object/how-to/abort-incomplete-mpu.mdx @@ -0,0 +1,56 @@ +--- +meta: + title: How to view and abort incomplete multipart uploads from the console + description: Steps to view and abort incomplete multipart uploads from the Scaleway console. +content: + h1: How to view and abort incomplete multipart uploads from the console + paragraph: Steps to view and abort incomplete multipart uploads from the Scaleway console. +tags: object storage object-storage mpu multipart upload abort +dates: + validation: 2024-09-13 + posted: 2024-09-13 +categories: + - storage + - object-storage +--- + +The [Scaleway console](https://console.scaleway.com/) lists your Object Storage incomplete multipart uploads to allow you to consult and manually delete them to clear storage space and optimize your storage costs. + +You can automate the process of aborting incomplete multipart uploads using [lifecycle rules](/storage/object/manage-lifecycle-rules). + + + +- A Scaleway account logged into the [console](https://console.scaleway.com) +- [Owner](/identity-and-access-management/iam/concepts/#owner) status or [IAM permissions](/identity-and-access-management/iam/concepts/#permission) allowing you to perform actions in the intended Organization +- An [Object Storage bucket](/storage/object/how-to/create-a-bucket/) +- At least one incomplete [multipart upload](/storage/object/api-cli/multipart-uploads/) + +## How to view the information of an incomplete multipart upload + +1. Click **Object Storage** in the **Storage** section of the side menu. The list of your buckets displays. +2. Click the name of your bucket. The list of your objects displays. +3. Click the **Incomplete MPU** tab. A list of your incomplete multipart uploads displays. +4. Click next to the Object you want to consult. +5. Click **More info**. The information page of the incomplete multipart upload displays. + +From this page, you can consult the following elements of an incomplete multipart upload: +- Name +- Upload ID +- Creation date +- Storage class +- List of parts uploaded so far + +Refer to the [dedicated documentation](/storage/object/api-cli/multipart-uploads/) for more information on how to create and manage multipart uploads. + +## How to delete an incomplete multipart upload + +1. Click **Object Storage** in the **Storage** section of the side menu. The list of your buckets displays. +2. Click the name of your bucket. The list of your objects displays. +3. Click the **Incomplete MPU** tab. A list of your incomplete multipart uploads displays. +4. Click next to the Object you want to delete. +5. Click **Abort**. A confirmation pop-up displays. +6. Type **ABORT** then click **Abort multipart upload** to confirm your action. + + +This action will permanently delete the upload, and all the parts uploaded so far. You can also abort an incomplete multipart upload from its information page. + diff --git a/storage/object/how-to/manage-lifecycle-rules.mdx b/storage/object/how-to/manage-lifecycle-rules.mdx index a3aa613de0..e454de8e86 100644 --- a/storage/object/how-to/manage-lifecycle-rules.mdx +++ b/storage/object/how-to/manage-lifecycle-rules.mdx @@ -7,7 +7,7 @@ content: paragraph: Set and manage lifecycle rules for Object Storage. tags: object storage object-storage lifecycle lifecycle-rule dates: - validation: 2024-06-14 + validation: 2024-09-13 posted: 2021-05-27 categories: - storage @@ -16,6 +16,8 @@ categories: With the Scaleway console, you can use lifecycle rules to [manually](/storage/object/how-to/edit-storage-class/) or automatically change the storage class of your objects. These rules also allow users to set expiration dates for objects and their versions. +Lifecycle rules also allow you to automatically abort incomplete [multipart uploads](/storage/object/api-cli/multipart-uploads/). + - A Scaleway account logged into the [console](https://console.scaleway.com) From 2af0188eaf0f3318ede7a58f240a18ee418237c0 Mon Sep 17 00:00:00 2001 From: SamyOubouaziz Date: Fri, 13 Sep 2024 15:59:02 +0200 Subject: [PATCH 3/5] docs(s3): update --- menu/navigation.json | 4 ++++ storage/object/how-to/abort-incomplete-mpu.mdx | 4 ++-- 2 files changed, 6 insertions(+), 2 deletions(-) diff --git a/menu/navigation.json b/menu/navigation.json index 4d81810709..9e75e9d50d 100644 --- a/menu/navigation.json +++ b/menu/navigation.json @@ -4082,6 +4082,10 @@ "label": "Manage lifecycle rules", "slug": "manage-lifecycle-rules" }, + { + "label": "View and abort incomplete multipart uploads", + "slug": "abort-incomplete-mpu" + }, { "label": "Monitor your consumption", "slug": "monitor-consumption" diff --git a/storage/object/how-to/abort-incomplete-mpu.mdx b/storage/object/how-to/abort-incomplete-mpu.mdx index 34b6c11f0e..d4e0e2a943 100644 --- a/storage/object/how-to/abort-incomplete-mpu.mdx +++ b/storage/object/how-to/abort-incomplete-mpu.mdx @@ -16,7 +16,7 @@ categories: The [Scaleway console](https://console.scaleway.com/) lists your Object Storage incomplete multipart uploads to allow you to consult and manually delete them to clear storage space and optimize your storage costs. -You can automate the process of aborting incomplete multipart uploads using [lifecycle rules](/storage/object/manage-lifecycle-rules). +You can automate the process of aborting incomplete multipart uploads using [lifecycle rules](/storage/object/how-to/manage-lifecycle-rules). @@ -52,5 +52,5 @@ Refer to the [dedicated documentation](/storage/object/api-cli/multipart-uploads 6. Type **ABORT** then click **Abort multipart upload** to confirm your action. -This action will permanently delete the upload, and all the parts uploaded so far. You can also abort an incomplete multipart upload from its information page. +This action will permanently delete the upload, and all the parts uploaded so far. You can also abort an incomplete multipart upload from its [information page](#how-to-view-the-information-of-an-incomplete-multipart-upload). From 8bb27482d2f863a04b838bae309af348172b0255 Mon Sep 17 00:00:00 2001 From: SamyOubouaziz Date: Fri, 13 Sep 2024 16:15:24 +0200 Subject: [PATCH 4/5] Apply suggestions from code review Co-authored-by: nerda-codes <87707325+nerda-codes@users.noreply.github.com> --- storage/object/how-to/abort-incomplete-mpu.mdx | 4 ++-- storage/object/how-to/manage-lifecycle-rules.mdx | 2 +- 2 files changed, 3 insertions(+), 3 deletions(-) diff --git a/storage/object/how-to/abort-incomplete-mpu.mdx b/storage/object/how-to/abort-incomplete-mpu.mdx index d4e0e2a943..90ba8e5b92 100644 --- a/storage/object/how-to/abort-incomplete-mpu.mdx +++ b/storage/object/how-to/abort-incomplete-mpu.mdx @@ -30,7 +30,7 @@ You can automate the process of aborting incomplete multipart uploads using [lif 1. Click **Object Storage** in the **Storage** section of the side menu. The list of your buckets displays. 2. Click the name of your bucket. The list of your objects displays. 3. Click the **Incomplete MPU** tab. A list of your incomplete multipart uploads displays. -4. Click next to the Object you want to consult. +4. Click next to the object you want to consult. 5. Click **More info**. The information page of the incomplete multipart upload displays. From this page, you can consult the following elements of an incomplete multipart upload: @@ -47,7 +47,7 @@ Refer to the [dedicated documentation](/storage/object/api-cli/multipart-uploads 1. Click **Object Storage** in the **Storage** section of the side menu. The list of your buckets displays. 2. Click the name of your bucket. The list of your objects displays. 3. Click the **Incomplete MPU** tab. A list of your incomplete multipart uploads displays. -4. Click next to the Object you want to delete. +4. Click next to the object you want to delete. 5. Click **Abort**. A confirmation pop-up displays. 6. Type **ABORT** then click **Abort multipart upload** to confirm your action. diff --git a/storage/object/how-to/manage-lifecycle-rules.mdx b/storage/object/how-to/manage-lifecycle-rules.mdx index e454de8e86..9ff30e5a48 100644 --- a/storage/object/how-to/manage-lifecycle-rules.mdx +++ b/storage/object/how-to/manage-lifecycle-rules.mdx @@ -63,7 +63,7 @@ Lifecycle rules also allow you to automatically abort incomplete [multipart uplo 6. Click **Disable lifecycle rule** to confirm. -Once disabled, the lifecycle rule remains listed and can be enabled again. Click , then select **Activate** to do so. +Once disabled, the lifecycle rule remains listed and can be enabled again. Click , then select **Activate** to re-enable it. To permanently delete a rule, click , then click **Delete**. \ No newline at end of file From cf507c08915ab8467d2fd326fd347fabd3bd9b0d Mon Sep 17 00:00:00 2001 From: SamyOubouaziz Date: Mon, 16 Sep 2024 11:09:12 +0200 Subject: [PATCH 5/5] docs(s3): update --- storage/object/api-cli/multipart-uploads.mdx | 4 ++++ storage/object/how-to/abort-incomplete-mpu.mdx | 10 +++++++--- storage/object/how-to/manage-lifecycle-rules.mdx | 4 ++-- 3 files changed, 13 insertions(+), 5 deletions(-) diff --git a/storage/object/api-cli/multipart-uploads.mdx b/storage/object/api-cli/multipart-uploads.mdx index e54ac65d85..98c8039c85 100644 --- a/storage/object/api-cli/multipart-uploads.mdx +++ b/storage/object/api-cli/multipart-uploads.mdx @@ -274,6 +274,10 @@ If the multipart upload is not completed, the parts will not be assembled and no In case these parts are no longer needed, it is possible to clear them by aborting the multipart upload session. + +You can also abort incomplete multipart uploads manually using the [Scaleway console](https://console.scaleway.com/), or automatically using [lifecycle rules](/storage/object/how-to/manage-lifecycle-rules). + + To abort an active multipart upload session, send a `DELETE` request to the platform, as follows: ``` diff --git a/storage/object/how-to/abort-incomplete-mpu.mdx b/storage/object/how-to/abort-incomplete-mpu.mdx index 90ba8e5b92..9daa184f68 100644 --- a/storage/object/how-to/abort-incomplete-mpu.mdx +++ b/storage/object/how-to/abort-incomplete-mpu.mdx @@ -14,7 +14,11 @@ categories: - object-storage --- -The [Scaleway console](https://console.scaleway.com/) lists your Object Storage incomplete multipart uploads to allow you to consult and manually delete them to clear storage space and optimize your storage costs. +The [Scaleway console](https://console.scaleway.com/) lists your Object Storage incomplete multipart uploads to allow you to consult them and manually abort them to clear storage space and optimize your storage costs. + + +Incomplete multipart uploads are charged even though they are not finished as they use storage space. + You can automate the process of aborting incomplete multipart uploads using [lifecycle rules](/storage/object/how-to/manage-lifecycle-rules). @@ -42,12 +46,12 @@ From this page, you can consult the following elements of an incomplete multipar Refer to the [dedicated documentation](/storage/object/api-cli/multipart-uploads/) for more information on how to create and manage multipart uploads. -## How to delete an incomplete multipart upload +## How to abort an incomplete multipart upload 1. Click **Object Storage** in the **Storage** section of the side menu. The list of your buckets displays. 2. Click the name of your bucket. The list of your objects displays. 3. Click the **Incomplete MPU** tab. A list of your incomplete multipart uploads displays. -4. Click next to the object you want to delete. +4. Click next to the object you want to abort. 5. Click **Abort**. A confirmation pop-up displays. 6. Type **ABORT** then click **Abort multipart upload** to confirm your action. diff --git a/storage/object/how-to/manage-lifecycle-rules.mdx b/storage/object/how-to/manage-lifecycle-rules.mdx index 9ff30e5a48..1599409a62 100644 --- a/storage/object/how-to/manage-lifecycle-rules.mdx +++ b/storage/object/how-to/manage-lifecycle-rules.mdx @@ -5,7 +5,7 @@ meta: content: h1: How to manage lifecycle rules from the console paragraph: Set and manage lifecycle rules for Object Storage. -tags: object storage object-storage lifecycle lifecycle-rule +tags: object storage object-storage lifecycle lifecycle-rule abort incompelte multipart upload expire version dates: validation: 2024-09-13 posted: 2021-05-27 @@ -38,7 +38,7 @@ Lifecycle rules also allow you to automatically abort incomplete [multipart uplo 7. Configure the behavior of the lifecycle rule: - Automatically transition the current version of your objects to another storage class after a specified number of days. - Automatically delete the current version of your objects after a specified number of days. - - Automatically cancel [incomplete multipart uploads](/storage/object/api-cli/multipart-uploads/#aborting-a-multipart-upload) after a specified number of days. + - Automatically abort [incomplete multipart uploads](/storage/object/api-cli/multipart-uploads/#aborting-a-multipart-upload) after a specified number of days. 8. Click **Next Step** to proceed.