GEOMESA-724,GEOMESA-729 Map/reduce and scalding input and output formats#511
Closed
elahrvivaz wants to merge 5 commits into
Closed
GEOMESA-724,GEOMESA-729 Map/reduce and scalding input and output formats#511elahrvivaz wants to merge 5 commits into
elahrvivaz wants to merge 5 commits into
Conversation
elahrvivaz
force-pushed
the
fcr_geomesa_input_output
branch
from
76b3355 to
e03df3e
Compare
elahrvivaz
changed the title
Contributor
There was a problem hiding this comment.
Does this break backward compatibility with version 0?
Contributor
Author
There was a problem hiding this comment.
Yeah, but it's already broken due to schema_changes, with no upgrade path available... Is that something we need to worry about?
Contributor
|
Looks great. Most of my comments are small/quick. I'd like to get another +1. |
jnh5y
force-pushed
the
accumulo1.5.x/1.x
branch
2 times, most recently
from
efa705f to
969513a
Compare
elahrvivaz
force-pushed
the
accumulo1.5.x/1.x
branch
from
ab0c25c to
f3192a8
Compare
elahrvivaz
force-pushed
the
fcr_geomesa_input_output
branch
from
61aa59f to
aaeff22
Compare
elahrvivaz
force-pushed
the
accumulo1.5.x/1.x
branch
from
98db3ba to
f4c0756
Compare
* Split query planning and query execution into two separate steps so that m/r can use query planning * Split feature writing into creating mutations and applying them so that m/r can use the mutations directly * Input - can specify CQL which will be translated into the appropriate ranges and iterators behind the scenes * Output - can write features directly to accumulo * Input and output delegate to AccumuloInput/OutputFormat * Supports 'old' and 'new' hadoop apis (mapred vs mapreduce packages) * Provides hadoop serialization for simple features * Split AccumuloSource options into input and output specific flavors * For interoperability, has Java implementations that call to the scala classes * Sample jobs are included - FeatureCountJob and FeatureWriterJob Signed-off-by: Emilio Lahr-Vivaz <elahrvivaz@ccri.com>
Signed-off-by: Emilio Lahr-Vivaz <elahrvivaz@ccri.com>
Signed-off-by: Emilio Lahr-Vivaz <elahrvivaz@ccri.com>
elahrvivaz
force-pushed
the
fcr_geomesa_input_output
branch
from
6f61ded to
22a57f5
Compare
Signed-off-by: Emilio Lahr-Vivaz <elahrvivaz@ccri.com>
elahrvivaz
force-pushed
the
fcr_geomesa_input_output
branch
from
ffe8822 to
a0401d4
Compare
Contributor
|
@anthonyccri @elahrvivaz This got merged a-ok, right? I'm just curious why it is still open. If no one gets to it first, I can sort it out in the morning. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Signed-off-by: Emilio Lahr-Vivaz elahrvivaz@ccri.com