New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-2054][SQL] Code Generation for Expression Evaluation #993
Closed
Closed
Changes from 31 commits
Commits
Show all changes
36 commits
Select commit
Hold shift + click to select a range
a2b5408
WIP: Code generation with scala reflection.
marmbrus 92e74a4
add overrides
marmbrus efad14f
Remove some half finished functions.
marmbrus f623ffd
Quiet logging from test suite.
marmbrus 0e889e8
Use typeOf instead tq
marmbrus d81f998
include schema for binding.
marmbrus 0093376
Comment / indenting cleanup.
marmbrus 675e679
Upgrade paradise.
marmbrus e742640
Remove unneeded changes and code.
marmbrus fc522d5
Hook generated aggregation in to the planner.
marmbrus 9d67d85
Fix hive planner
marmbrus ca6cc6b
WIP
marmbrus 4220f1e
Better config, docs, etc.
marmbrus 6cc97ca
Merge remote-tracking branch 'origin/master' into newCodeGen
marmbrus bc88ecd
Style
marmbrus be2cd6b
WIP: Remove old method for reference binding, more work on configurat…
marmbrus d2ad5c5
Refactor putting SQLContext into SparkPlan. Fix ordering, other test …
marmbrus d30fee2
Merge remote-tracking branch 'origin/master' into newCodeGen
marmbrus 4771fab
Docs, more test coverage.
marmbrus 033abc6
off by default
marmbrus 1ec2d6e
Address comments
marmbrus 0672e8a
Address comments.
marmbrus 1a61293
Address review comments.
marmbrus 9cce346
Merge remote-tracking branch 'origin/master' into newCodeGen
marmbrus 3587460
Drop unused string builder function.
marmbrus 64b2ee1
Implement copy
marmbrus 3cd773e
Allow codegen for Generate.
marmbrus 533fdfd
More logging of expression rewriting for GeneratedAggregate.
marmbrus ef8d42b
comments
marmbrus fed3634
Inspectors are not serializable.
marmbrus de22aac
Merge remote-tracking branch 'origin/master' into newCodeGen
marmbrus 41a40c9
Merge remote-tracking branch 'origin/master' into newCodeGen
marmbrus 4bdc42c
Merge remote-tracking branch 'origin/master' into newCodeGen
marmbrus 67b1c48
Use conf variable in SQLConf object
marmbrus f34122d
Merge remote-tracking branch 'apache/master' into newCodeGen
marmbrus 96ef82c
Merge remote-tracking branch 'apache/master' into newCodeGen
marmbrus File filter
Filter by extension
Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
this is for another time, but if you add an explicitly init to expressions, we can move all of these branches from the inner loop (once per row) directly to the outer loop (once per partition).