-
Notifications
You must be signed in to change notification settings - Fork 2.5k
Issue #12600: Streaming Positive LEAD #12685
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Implement streaming LEAD by maintaining a delay buffer. The included benchmark shows a 7x performance gain. fixes: duckdb#12600 fixes: duckdblabs/duckdb-internal#2342
Fix tidy issue with abs.
Fix another tidy issue with abs...
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks, this looks great! Could we add some tests where the LAG/LEAD are greater than STANDARD_VECTOR_SIZE? Other than that it's good to go from my side.
Add test for large delta.
|
Just tried this out, and it is indeed a great improvement! |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for the PR! Looks great, great results! Some comments:
Fix overrun error and make buffering independent of the standard vector size.
PR Feedback: * Make buffering independent of the standard vector size. * Don't allow resize during Append because it should already be the correct size.
PR Feedback: * Test with vector_size=2
PR Feedback: * Avoid copying fixes: duckdb#12600 fixes: duckdblabs/duckdb-internal#2342
|
Thanks! |
Merge pull request duckdb/duckdb#12685 from hawkfish/streaming-lead
Implement streaming LEAD by maintaining a delay buffer.
The included benchmark shows a 7x performance gain.
fixes: #12600
fixes: duckdblabs/duckdb-internal#2342