Skip to content

Conversation

@drmingdrmer
Copy link
Member

@drmingdrmer drmingdrmer commented Sep 18, 2025

I hereby agree to the terms of the CLA available at: https://docs.databend.com/dev/policies/cla/

Summary

refactor: compactor internal structure
  • Add DropCallback to call a callback when being dropped.

  • Remove CompactingData, use LeveledMap directly.

  • Refine WriterPermit and CompactorPermit logging.

  • When building snapshot, it should acquire both the writer and
    compactor permits, because it needs to modify both the writable and
    the immutable data.

Tests

  • Unit Test
  • Logic Test
  • Benchmark Test
  • No Test - Explain why

Type of change

  • Refactoring

Related Issues


This change is Reviewable

@github-actions github-actions bot added the pr-refactor this PR changes the code base without new features or bugfix label Sep 18, 2025
- Add DropCallback to call a callback when being dropped.

- Remove `CompactingData`, use `LeveledMap` directly.

- Refine `WriterPermit` and `CompactorPermit` logging.

- When building snapshot, it should acquire both the writer and
  compactor permits, because it needs to modify both the writable and
  the `immutable` data.
@drmingdrmer drmingdrmer force-pushed the 343-rm-compacting-data branch from 8103404 to 46c0591 Compare September 18, 2025 04:08
@drmingdrmer drmingdrmer marked this pull request as ready for review September 18, 2025 04:08
@drmingdrmer drmingdrmer merged commit e9262e8 into databendlabs:main Sep 18, 2025
171 of 173 checks passed
@drmingdrmer drmingdrmer deleted the 343-rm-compacting-data branch September 18, 2025 05:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

pr-refactor this PR changes the code base without new features or bugfix

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant