Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Task for automatic garbage collection of unused documents and views #500

Merged
merged 52 commits into from
Aug 31, 2023
Merged

Task for automatic garbage collection of unused documents and views #500

merged 52 commits into from
Aug 31, 2023

Commits on Aug 31, 2023

  1. Return removed document view ids from prune_document_views

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    7f129e3 View commit details
    Browse the repository at this point in the history

  2. Introduce "prune" task

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    87b8dc7 View commit details
    Browse the repository at this point in the history

  3. Issue "prune" tasks from "reduce" tasks

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    4ce26c1 View commit details
    Browse the repository at this point in the history

  4. Only issue dependency tasks in test utils

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    0453852 View commit details
    Browse the repository at this point in the history

  5. Don't issue a dependency task when reduced document is deleted

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    323c9f1 View commit details
    Browse the repository at this point in the history

  6. Update all tests

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    b1c0b4a View commit details
    Browse the repository at this point in the history

  7. Clippy

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    7be0c9e View commit details
    Browse the repository at this point in the history

  8. More comments in prune task

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    8a3b802 View commit details
    Browse the repository at this point in the history

  9. Correctly process effected child relations of deleted views

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    6d4ac46 View commit details
    Browse the repository at this point in the history

  10. Improve comments in prune task

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    306ffba View commit details
    Browse the repository at this point in the history

  11. Correct item name

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    fb927cc View commit details
    Browse the repository at this point in the history

  12. Test helper method for updating documents

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    5f6b0f4 View commit details
    Browse the repository at this point in the history

  13. Pruning SQL gets a little more epic

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    fa4567e View commit details
    Browse the repository at this point in the history

  14. Test for recursive pruning

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    d1b597f View commit details
    Browse the repository at this point in the history

  15. fmt

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    378c9cd View commit details
    Browse the repository at this point in the history

  16. Tests for "prune" task

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    b0fcb4d View commit details
    Browse the repository at this point in the history

  17. Update CHANGELOG

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    e1e02cd View commit details
    Browse the repository at this point in the history

  18. Remove unused method

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    5051575 View commit details
    Browse the repository at this point in the history

  19. Improve doc string

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    1641ba1 View commit details
    Browse the repository at this point in the history

  20. Use transaction in prune method

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    9919ab3 View commit details
    Browse the repository at this point in the history

  21. SQL re-use and more comments

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    23fa50a View commit details
    Browse the repository at this point in the history

  22. Change comments again

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    f0c7739 View commit details
    Browse the repository at this point in the history

  23. Add cascading deletes to operation_fields_v1 and document_views

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    03c9b55 View commit details
    Browse the repository at this point in the history

  24. Add a trigger which purges a documents logs, entries and operations f… 

    …rom the database
    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    57968a2 View commit details
    Browse the repository at this point in the history

  25. Add purge method to document store w/ tests

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    7b87baf View commit details
    Browse the repository at this point in the history

  26. Re-use common sql strings

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    056fe3d View commit details
    Browse the repository at this point in the history

  27. Refactor prune_document_views() into separate methods

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    3060da3 View commit details
    Browse the repository at this point in the history

  28. Remove prune_documents_view() method from DocumentStore

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    294116e View commit details
    Browse the repository at this point in the history

  29. Implement pruning logic in task

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    1f71585 View commit details
    Browse the repository at this point in the history

  30. Rename "prune" task "garbage_collection"

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    0e2c841 View commit details
    Browse the repository at this point in the history

  31. Check if all views for a document have been removed in "garbage_colle… 

    …ction" task
    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    d2b0be0 View commit details
    Browse the repository at this point in the history

  32. fmt + clippy

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    109323e View commit details
    Browse the repository at this point in the history

  33. Add purge_blob method to BlobStore

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    9fe950f View commit details
    Browse the repository at this point in the history

  34. Use purge_blob in "garbage_collection" task

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    58398e2 View commit details
    Browse the repository at this point in the history

  35. Don't remove row from logs table on purge

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    d7a77ca View commit details
    Browse the repository at this point in the history

  36. Correct method naming

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    fbe7380 View commit details
    Browse the repository at this point in the history

  37. Some comment improvements

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    32a2e02 View commit details
    Browse the repository at this point in the history

  38. Remove unused import

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    3baf828 View commit details
    Browse the repository at this point in the history

  39. Move add_blob to test utils

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    9c32de7 View commit details
    Browse the repository at this point in the history

  40. Move assert_query method to test utils

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    f918205 View commit details
    Browse the repository at this point in the history

  41. Tests for "garbage_collection" task

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    4ae2125 View commit details
    Browse the repository at this point in the history

  42. Change task name to "garbage_collection"

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    964d04e View commit details
    Browse the repository at this point in the history

  43. Clippy

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    b43e112 View commit details
    Browse the repository at this point in the history

  44. Update CHANGELOG entry

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    aec23eb View commit details
    Browse the repository at this point in the history

  45. Move SQL trigger into purge_document method on the store

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    8ff07b0 View commit details
    Browse the repository at this point in the history

  46. Inline all SQL query constant strings

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    857d1fe View commit details
    Browse the repository at this point in the history

  47. Update CHANGELOG

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    ad43077 View commit details
    Browse the repository at this point in the history

  48. Add more comments in purge_blob method

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    2d9beba View commit details
    Browse the repository at this point in the history

  49. Add test for purging updated blob

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    4624008 View commit details
    Browse the repository at this point in the history

  50. Clippy

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    ec7f577 View commit details
    Browse the repository at this point in the history

  51. fmt

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    7419fc7 View commit details
    Browse the repository at this point in the history

  52. Improve comments in garbage_collection task

    @sandreae
    sandreae committed Aug 31, 2023
    Configuration menu
    Copy the full SHA
    2c35f30 View commit details
    Browse the repository at this point in the history