Update SQL doc to reflect changes in the APIs#397
Closed
akedin wants to merge 1 commit intoapache:asf-sitefrom
Closed
Update SQL doc to reflect changes in the APIs#397akedin wants to merge 1 commit intoapache:asf-sitefrom
akedin wants to merge 1 commit intoapache:asf-sitefrom
Conversation
Author
melap
reviewed
Mar 6, 2018
| ## 1. Overview {#overview} | ||
|
|
||
| SQL is a well-adopted standard to process data with concise syntax. With DSL APIs (currently available only in Java), now `PCollection`s can be queried with standard SQL statements, like a regular table. The DSL APIs leverage [Apache Calcite](http://calcite.apache.org/) to parse and optimize SQL queries, then translate into a composite Beam `PTransform`. In this way, both SQL and normal Beam `PTransform`s can be mixed in the same pipeline. | ||
| SQL is a well-adopted standard to process data with concise syntax. With DSL APIs (currently available only in Java), now `PCollections` can be queried with standard SQL statements, like a regular table. The DSL APIs leverage [Apache Calcite](http://calcite.apache.org/) to parse and optimize SQL queries, then translate into a composite Beam `PTransform`. In this way, both SQL and normal Beam `PTransforms` can be mixed in the same pipeline. |
There was a problem hiding this comment.
Drive by comment -- if you end up making another commit for this PR, could we axe the * TOC {:toc} lines at the top of the page? We didn't have the right nav at the time this was added. Due to the bolding of a couple of the deeply nested sections, it looks a bit strange also.
BeamSql.querySimple() and queryMulti() were combined into query(). BeamRecord was renamed to Row. Factory methods and builders were added to it.
akedin
force-pushed
the
sql-doc-api-update
branch
from
300229b to
50734de
Compare
kennknowles
approved these changes
Mar 8, 2018
Member
kennknowles
left a comment
kennknowles
left a comment
There was a problem hiding this comment.
This is hugely useful and important. I think we should merge it immediately and make any further refinements after.
Member
|
retest this please |
Member
|
One next step would be to use snippets capabilities to make sure these keep compiling. |
|
May need to be merged manually, as mergebot is having troubles right now. |
|
@asfgit merge |
|
Error: Custom preparation command failed. Check logs for more information. |
|
@asfgit merge |
robertwb
pushed a commit
to robertwb/incubator-beam
that referenced
this pull request
Jun 5, 2018
charlesccychen
pushed a commit
to cosmoskitten/beam
that referenced
this pull request
Jun 14, 2018
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
4 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
BeamSql.querySimple() and queryMulti() were combined into query().
BeamRecord was renamed to Row. Factory methods and builders were added to it.