Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SUPPORT] The parameter "hoodie.bloom.index.filter.type" does not take effect in deltaStreamer #2446

Closed
quitozang opened this issue Jan 14, 2021 · 8 comments
Assignees

Comments

@quitozang
Copy link

Why does this parameter "hoodie.bloom.index.filter.type" not take effect in deltaStreamer, the bloom filter type is always in SIMPLE.

@bvaradar
Copy link
Contributor

@quitozang : Which version of Hoodie are you using ? Are you passing the configuration like "--hoodie-conf hoodie.bloom.index.filter.type=ABC" ?

@nsivabalan : Can you follow-up with this ticket. Thanks

@quitozang
Copy link
Author

I modified part of the source code of DeltaStreamer like this
image

and the log information is as follows
image

@bvaradar
Copy link
Contributor

@nsivabalan : Can you check if bloom index filter types is not configurable through deltastreamer ?

@quitozang
Copy link
Author

@nsivabalan : Can you check if bloom index filter types is not configurable through deltastreamer ?

It does take an effect by writing data from HUDI dataSource API, Instead of deltastreamer

@bvaradar
Copy link
Contributor

@nsivabalan : Can you take a look into this ?

@nsivabalan
Copy link
Contributor

Sure. looking into it.

@nsivabalan
Copy link
Contributor

#2457

@nsivabalan
Copy link
Contributor

Please reopen if required.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants