Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Redundant quantize flag? #393

Open
elshize opened this issue May 24, 2020 · 2 comments
Open

Redundant quantize flag? #393

elshize opened this issue May 24, 2020 · 2 comments
Labels
bug Something isn't working

Comments

@elshize
Copy link
Member

elshize commented May 24, 2020

Somehow, we ended up with two quantization options for queries. First, we have --quantized, and then we have --scorer quantized. I think the easier way would be to remove --quantized because the other takes part in scorer resolution directly. The alternative is to have exactly one of the options required because saying --scorer bm25 --quantized makes no sense.

@elshize elshize added the bug Something isn't working label May 24, 2020
@amallia
Copy link
Member

amallia commented Jun 1, 2020

It is not exactly redundant. --quantized is used by https://github.com/pisa-engine/pisa/blob/master/include/pisa/wand_data_compressed.hpp

If --quantized is passed, when block upper bound scores are computed they do not need to be unquantized. Please note that in https://github.com/pisa-engine/pisa/blob/master/include/pisa/wand_data_compressed.hpp scores are stored quantized.

We could find a way to pass it only once to the CLI, but we will need to pass it down to wand_data_compressed anyway.

@elshize
Copy link
Member Author

elshize commented Jun 1, 2020

I understand, but we can easily use auto quantized = scorer_name == "quantized" and pass it along. The point is to have the command arguments that make sense. I've been trying to run quantized queries with --quantized and it just spit out some garbage results because I didn't also say -s quantized. This is not a nuclear weapon, we don't need two triggers.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants