Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: support ignore bloomfilter when compaction #491

Conversation

ShiKaiWi
Copy link
Member

Which issue does this PR close?

Part #489

Rationale for this change

After #488, bloom filter has been optional, but the compaction procedure has no way to tell the SST reader to skip loading bloom filter. This PR will implement it.

What changes are included in this PR?

  • Add just_once field to SST reader to decide whether to skip updating cache;
  • SST reader will skip loading bloom filter if just_once is set and predicates are not provided;
  • Remove sync sst reader;

Are there any user-facing changes?

None.

How does this change test

Existing tests.

@ShiKaiWi ShiKaiWi changed the title Feat support ignore bloomfilter when compaction feat: support ignore bloomfilter when compaction Dec 19, 2022
@ShiKaiWi ShiKaiWi force-pushed the feat-support-ignore-bloomfilter-when-compaction branch from 74738eb to e0d6e98 Compare December 19, 2022 08:25
Copy link
Contributor

@jiacai2050 jiacai2050 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@jiacai2050 jiacai2050 merged commit 9ada765 into apache:main Dec 19, 2022
@ShiKaiWi ShiKaiWi deleted the feat-support-ignore-bloomfilter-when-compaction branch January 18, 2023 06:55
chunshao90 pushed a commit to chunshao90/ceresdb that referenced this pull request May 15, 2023
* feat: support async reader option `just_once`

* chore: remove sync parquet reader

* chore: refactor the signature of `read_sst_meta` method

* replace just_once with ReadFrequency
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants