New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Additional Aria Scan improvements using batch read operations(master issue) #15080

Open

yingsu00 opened this issue Aug 25, 2020 · 1 comment

Assignees

Contributor

yingsu00 commented Aug 25, 2020 •

edited

Optimize SelectiveDictionaryStreamReader for large dictionaries. (Done)
Optimize SelectiveStreamReaders for low filter rate (Batch Read) Optimize SelectiveStreamReaders for low filter rate #13989
Optimize MergingPageOutput Optimize MergingPageOutput #15052
Optimize string truncation for SliceXXXSelectiveStreamReader Optimize string truncation for SliceXXXSelectiveStreamReader #13990
Optimize readVarint (High on multiple profiles) No issue yet.
Optimize MapFlatSelectiveStreamReader Optimize MapFlatSelectiveStreamReader #15225
Investigate excessive memory allocation in DwrfMetadataReader.readRowIndexes Investigate if the allocation can be reduced in DwrfMetadataReader.readRowIndexes #15318
Optimize getUnsetBits in BooleanInputStream Optimize getUnsetBits in BooleanInputStream #14539

Less likely

OrcSelectiveRecordReader produces small pages when filter rate is high OrcSelectiveRecordReader produces small pages when filter rate is high #15079
Pushdown filter on dictionary to InputStream Pushdown filter on dictionary to InputStream #14555

yingsu00 self-assigned this

Contributor Author

yingsu00 commented Aug 25, 2020

cc @mbasmanova @oerling @biswapesh @baldeephira

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment