Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

refactor: refactor compaction process for remote compaction #1476

Merged
merged 12 commits into from
Feb 27, 2024

Conversation

Rachelint
Copy link
Contributor

@Rachelint Rachelint commented Jan 31, 2024

Rationale

The first step to support compaction offload #1480

Detailed Changes

  • Extract the common compaction logic to CompactionExecutor.
  • Define the CompactionRunner trait to support remote compaction after.
  • Define the Compactor to integration the new compaction logics, and insert them into main process.

Test Plan

Test manually.

@Rachelint Rachelint marked this pull request as ready for review February 2, 2024 05:59
@Rachelint Rachelint changed the title refactor compaction process for remote compaction refactor: refactor compaction process for remote compaction Feb 2, 2024
@jiacai2050 jiacai2050 self-requested a review February 4, 2024 02:41
src/benchmarks/src/merge_sst_bench.rs Outdated Show resolved Hide resolved
src/horaedb/src/setup.rs Outdated Show resolved Hide resolved
.gitignore Outdated Show resolved Hide resolved
@Rachelint Rachelint force-pushed the remote-compaction-pre-refactor branch from 046ac18 to d5cb217 Compare February 5, 2024 06:52
jiacai2050
jiacai2050 previously approved these changes Feb 5, 2024
Copy link
Contributor

@jiacai2050 jiacai2050 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@Rachelint Rachelint force-pushed the remote-compaction-pre-refactor branch from 2a08801 to 7ece79d Compare February 8, 2024 09:01
@Rachelint Rachelint merged commit 8d53620 into apache:main Feb 27, 2024
9 checks passed
zealchen pushed a commit to zealchen/incubator-horaedb that referenced this pull request Apr 9, 2024
)

## Rationale
The first step to support compaction offload apache#1480 

## Detailed Changes
- Extract the common compaction logic to `CompactionExecutor`.
- Define the `CompactionRunner` trait to support remote compaction
after.
- Define the `Compactor` to integration the new compaction logics, and
insert them into main process.

## Test Plan
Test manually.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants