Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: impl key partition rule #507

Merged
merged 5 commits into from
Dec 27, 2022

Conversation

Rachelint
Copy link
Contributor

Which issue does this PR close?

Closes #
Part of #492

Rationale for this change

Implement partition rule for key partition.

What changes are included in this PR?

See above.

Are there any user-facing changes?

None.

How does this change test

Test by ut.

@Rachelint Rachelint force-pushed the impl-key-partition-rule branch 2 times, most recently from 7f1635a to b0c21e2 Compare December 24, 2022 10:37
@Rachelint Rachelint marked this pull request as ready for review December 24, 2022 10:38
table_engine/src/partition/rule/key.rs Outdated Show resolved Hide resolved
table_engine/src/partition/rule/key.rs Outdated Show resolved Hide resolved
table_engine/src/partition/mod.rs Outdated Show resolved Hide resolved
table_engine/src/partition/rule/mock.rs Outdated Show resolved Hide resolved
table_engine/src/partition/rule/factory.rs Outdated Show resolved Hide resolved
table_engine/src/partition/rule/mod.rs Show resolved Hide resolved
table_engine/src/partition/rule/key.rs Outdated Show resolved Hide resolved
table_engine/src/partition/rule/key.rs Outdated Show resolved Hide resolved
table_engine/src/partition/rule/key.rs Outdated Show resolved Hide resolved
table_engine/src/partition/rule/key.rs Show resolved Hide resolved
table_engine/src/partition/rule/key.rs Show resolved Hide resolved
table_engine/src/partition/rule/key.rs Outdated Show resolved Hide resolved
@Rachelint Rachelint force-pushed the impl-key-partition-rule branch 2 times, most recently from 7f78909 to 45d6ac1 Compare December 27, 2022 05:28
Copy link
Contributor

@chunshao90 chunshao90 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@chunshao90 chunshao90 merged commit eb6af7a into apache:main Dec 27, 2022
pub trait FilterExtractor: Send + Sync + 'static {
fn extract(&self, filters: &[Expr], columns: &[String]) -> Vec<PartitionFilter>;
}
pub struct KeyExtractor;
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Add one more newline above.

ShiKaiWi added a commit that referenced this pull request Dec 27, 2022
* refactor: separate object store from parquet sst async reader (#503)

* refactor: separate object store from parquet sst async reader

* fix errors in unit tests

* use const FOOTER_LEN

* add GenericResult

* refactor: recovery in standalone mode (#414)

* refactor recovery in standalone mode.

* make getting table infos dynamically.

* define `LocalTablesRecoverer`.

* address CR.

* feat: support parse key partition (#506)

* add key partition parser

* refactor the codes

* add unit test

* fix show create table for partition table

* address CR issues

* supplement the error msg when fail to parse partition key

* fix unit tests

Co-authored-by: CooooolFrog <zuliangwanghust@gmail.com>

* chore: define remote_engine grpc service (#505)

Co-authored-by: kamille <34352236+Rachelint@users.noreply.github.com>

* feat: impl key partition rule (#507)

* impl key partition rule(draft).

* refactor to more extensible and testable version.

* add tests for key partition.

* add df adapter and partition rule's building.

* address CR.

Co-authored-by: WEI Xikai <ShiKaiWi@users.noreply.github.com>
Co-authored-by: kamille <34352236+Rachelint@users.noreply.github.com>
Co-authored-by: CooooolFrog <zuliangwanghust@gmail.com>
Co-authored-by: chunshao.rcs <chunshao.rcs@antgroup.com>
chunshao90 pushed a commit to chunshao90/ceresdb that referenced this pull request May 15, 2023
* impl key partition rule(draft).

* refactor to more extensible and testable version.

* add tests for key partition.

* add df adapter and partition rule's building.

* address CR.
@Rachelint Rachelint deleted the impl-key-partition-rule branch May 27, 2023 12:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants