-
Notifications
You must be signed in to change notification settings - Fork 83
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Bug fixes for and extensions of new Java API #542
Conversation
TODO: Special exec strategy (runtime + optimizer) based on hash join required. Either no duplicates of filtering side in HT or filtered tuples removed from HT after first match.
} | ||
|
||
@Override | ||
protected BinaryNodeTranslation translateToDataFlow() { | ||
// TODO: Runtime support required. Each left tuple may be returned only once. | ||
// Special exec strategy (runtime + optimizer) based on hash join required. | ||
// Either no duplicates of right side in HT or left tuples removed from HT after first match. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can't you implement that using CoGroup?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think it is almost easier to do this with an extra runtime op. Those are
line 20 lines only as well...
Am 07.03.2014 20:58 schrieb "Robert Metzger" notifications@github.com:
In
stratosphere-java/src/main/java/eu/stratosphere/api/java/operators/JoinOperator.java:} @Override protected BinaryNodeTranslation translateToDataFlow() {
// TODO: Runtime support required. Each left tuple may be returned only once.
// Special exec strategy (runtime + optimizer) based on hash join required.
// Either no duplicates of right side in HT or left tuples removed from HT after first match.
Can't you implement that using CoGroup?
—
Reply to this email directly or view it on GitHubhttps://github.com//pull/542/files#r10397365
.
Fixes #543 |
Rebased to stratosphere:staging branch in #565 |
TupleComparator
(normalized key writing) @StephanEwen please verifyBasicTypeComparator
(inverted sort order) @StephanEwen please verifyTypeExtractor
andTupleTypeInfo
to work with subclasses of Tuple classes.