-
Notifications
You must be signed in to change notification settings - Fork 83
Feature: Interval joins #924
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
d70e033
to
db493c2
Compare
db493c2
to
0a92b41
Compare
gwaramadze
commented
Jun 12, 2025
1481cab
to
eb574e7
Compare
daniil-quix
reviewed
Jun 18, 2025
daniil-quix
reviewed
Jun 18, 2025
de8c91d
to
bc2de13
Compare
daniil-quix
reviewed
Jun 19, 2025
daniil-quix
reviewed
Jun 19, 2025
daniil-quix
reviewed
Jun 19, 2025
daniil-quix
reviewed
Jun 19, 2025
daniil-quix
reviewed
Jun 19, 2025
Co-authored-by: Daniil Gusev <daniil@quix.io>
c2df19b
to
f1e2d8b
Compare
daniil-quix
approved these changes
Jun 19, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Implement interval join
This PR introduces a new
join_interval()
method toStreamingDataFrame
for performing stream-to-stream interval joins.Interval Join
A new interval join feature has been added, allowing records from two streams to be joined based on a user-defined time interval around their timestamps.
Key Features:
backward_ms
andforward_ms
to define a flexible time window for matching records between streams.inner
andleft
joins.raise
,keep-left
,keep-right
) and allows custom functions for merging matched records.TimestampedStore
that can now store and query multiple values per key and timestamp, which is crucial for handling multiple matches within an interval.Example Usage:
State Store Enhancements
To support this feature,
TimestampedStore
has been updated with aget_interval()
method to retrieve all records within a given time range.