-
Notifications
You must be signed in to change notification settings - Fork 13.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[FLINK-1296] Add sorter support for very large records #249
Conversation
This failes with the java 6 compiler, because it has a generics bug. I'll try and work around it... |
bd96f90
to
ecb8bab
Compare
…large intermediate buffers early
… larger records into a single special merge stream
…rectly recognized as large record
ecb8bab
to
0971fe6
Compare
…empty spill files
I think that this one can go into the 0.9 master now. |
+1 |
+1 I will merge this in the next batch. |
OK I've rebased this PR on the current master. All tests are running locally (Travis is still flaky). @mxm is running some cluster tests. I'll push to master after his OK. :-) |
Cluster tests worked fine. If no one objects I'll merge this later today. |
This allows the sorter to handle records larger than the memory sort buffers.