From 648077c1ff8d075a8c0d985f2965aa6091031c86 Mon Sep 17 00:00:00 2001 From: gui machiavelli Date: Tue, 6 Sep 2022 14:25:17 +0200 Subject: [PATCH 1/5] storage: add information about soft deletion --- learn/advanced/storage.md | 8 ++++++++ 1 file changed, 8 insertions(+) diff --git a/learn/advanced/storage.md b/learn/advanced/storage.md index fb4c06793c..2687309e99 100644 --- a/learn/advanced/storage.md +++ b/learn/advanced/storage.md @@ -71,3 +71,11 @@ These metrics are highly dependent on the machine that is running Meilisearch. R It is important to note that **there is no reliable way to predict the final size of a database**. This is true for just about any search engine on the market—we're just the only ones saying it out loud. Database size is affected by a large number of criteria, including settings, relevancy rules, use of facets, the number of different languages present, and more. + +## Soft deletion + +Meilisearch renders deleted documents inaccessible to all users but does not immediately remove them from the database. This is a common optimization technique called "soft deletion". Soft deleted documents are permanently deleted at a later date—the precise time depends on index size and available disk space. + +When updating a document, Meilisearch deletes the current record and creates a new one containing the new data. This means soft deletion, as well as its associated performance increase, also affect document updates. + +If you are developing an application that handles sensitive data, it might be important to check how soft deletion interacts with relevant data retention legislation. From 16134510a3883683318592422b6d088bb34fd318 Mon Sep 17 00:00:00 2001 From: gui machiavelli Date: Mon, 19 Sep 2022 16:31:57 +0200 Subject: [PATCH 2/5] soft deletion: improve wording --- learn/advanced/storage.md | 4 +--- 1 file changed, 1 insertion(+), 3 deletions(-) diff --git a/learn/advanced/storage.md b/learn/advanced/storage.md index 2687309e99..242c0da801 100644 --- a/learn/advanced/storage.md +++ b/learn/advanced/storage.md @@ -74,8 +74,6 @@ Database size is affected by a large number of criteria, including settings, rel ## Soft deletion -Meilisearch renders deleted documents inaccessible to all users but does not immediately remove them from the database. This is a common optimization technique called "soft deletion". Soft deleted documents are permanently deleted at a later date—the precise time depends on index size and available disk space. +Meilisearch renders deleted documents inaccessible to all users but does not immediately remove them from the database. This is a common optimization technique called "soft deletion". Soft deleted documents are permanently deleted at a later date—the precise time depends on index size and available disk space. It might be important to check how soft deletion interacts with relevant data retention legislation. When updating a document, Meilisearch deletes the current record and creates a new one containing the new data. This means soft deletion, as well as its associated performance increase, also affect document updates. - -If you are developing an application that handles sensitive data, it might be important to check how soft deletion interacts with relevant data retention legislation. From c537f8026727f10b3e2e2cb64e13b61800e5dd31 Mon Sep 17 00:00:00 2001 From: gui machiavelli Date: Thu, 22 Sep 2022 17:13:33 +0200 Subject: [PATCH 3/5] soft deletion: clarify last sentence on storage.md --- learn/advanced/storage.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/learn/advanced/storage.md b/learn/advanced/storage.md index 242c0da801..51ffed1b54 100644 --- a/learn/advanced/storage.md +++ b/learn/advanced/storage.md @@ -76,4 +76,4 @@ Database size is affected by a large number of criteria, including settings, rel Meilisearch renders deleted documents inaccessible to all users but does not immediately remove them from the database. This is a common optimization technique called "soft deletion". Soft deleted documents are permanently deleted at a later date—the precise time depends on index size and available disk space. It might be important to check how soft deletion interacts with relevant data retention legislation. -When updating a document, Meilisearch deletes the current record and creates a new one containing the new data. This means soft deletion, as well as its associated performance increase, also affect document updates. +Soft deletion also affects document updates: when you update a document, Meilisearch removes the current record and creates a new document with updated data. From a9b3d4e362251499b549986a95980947b6b397ef Mon Sep 17 00:00:00 2001 From: gui machiavelli Date: Mon, 26 Sep 2022 14:27:43 +0200 Subject: [PATCH 4/5] Update learn/advanced/storage.md Co-authored-by: Tamo --- learn/advanced/storage.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/learn/advanced/storage.md b/learn/advanced/storage.md index 51ffed1b54..da7fb597e1 100644 --- a/learn/advanced/storage.md +++ b/learn/advanced/storage.md @@ -74,6 +74,6 @@ Database size is affected by a large number of criteria, including settings, rel ## Soft deletion -Meilisearch renders deleted documents inaccessible to all users but does not immediately remove them from the database. This is a common optimization technique called "soft deletion". Soft deleted documents are permanently deleted at a later date—the precise time depends on index size and available disk space. It might be important to check how soft deletion interacts with relevant data retention legislation. +Meilisearch renders deleted documents inaccessible to all users but does not immediately remove them from the database. This is a common optimization technique called "soft deletion". Soft deleted documents are permanently deleted during a later update, depending on your index size and the available disk space. It might be important to check how soft deletion interacts with data retention legislation relevant to your application. Soft deletion also affects document updates: when you update a document, Meilisearch removes the current record and creates a new document with updated data. From c944ae2a5a758e271484f1e4451be1aac2dce195 Mon Sep 17 00:00:00 2001 From: gui machiavelli Date: Tue, 27 Sep 2022 15:58:42 +0200 Subject: [PATCH 5/5] storage: styling tweak --- learn/advanced/storage.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/learn/advanced/storage.md b/learn/advanced/storage.md index da7fb597e1..8f190e0d27 100644 --- a/learn/advanced/storage.md +++ b/learn/advanced/storage.md @@ -74,6 +74,6 @@ Database size is affected by a large number of criteria, including settings, rel ## Soft deletion -Meilisearch renders deleted documents inaccessible to all users but does not immediately remove them from the database. This is a common optimization technique called "soft deletion". Soft deleted documents are permanently deleted during a later update, depending on your index size and the available disk space. It might be important to check how soft deletion interacts with data retention legislation relevant to your application. +Meilisearch renders deleted documents inaccessible to all users but does not immediately remove them from the database. This is a common optimization technique called soft deletion. Soft deleted documents are permanently deleted during a later update, depending on your index size and the available disk space. It might be important to check how soft deletion interacts with data retention legislation relevant to your application. Soft deletion also affects document updates: when you update a document, Meilisearch removes the current record and creates a new document with updated data.