v0.29: Soft deletion warning

[guimachiavelli]

With v0.29, Meilisearch will start soft deleting database records. In short, soft deletion means marking documents as deleted instead of deleting them outright. Meilisearch will wipe the data completely, sooner or later, based on DB size and remaining storage space. This is a common optimization technique that seems to giving us significant performance gains.

Soft-deleted documents are hidden from end-users and inaccessible by usual means (e.g. API endpoints), but they still remain in the database for some time. This needs to be communicated clearly so experienced developers are aware that unwanted data might linger around for some time—something particularly relevant for those serving users under GDPR and etc.

Tasks

• Create short new section in /learn/advanced/storage.md
• Check for other pages that might benefit from a link to storage.mds new section

References

• issue: Improve indexation speed: introduce the soft document deletion meilisearch#2583
• SME: @irevoire