Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Implement HoodieSQLStreamer to pull from source Hoodie Dataset, transform and upsert into a target Hoodie dataset #20

Closed
prazanna opened this issue Jan 4, 2017 · 1 comment
Closed

Implement HoodieSQLStreamer to pull from source Hoodie Dataset, transform and upsert into a target Hoodie dataset #20

prazanna opened this issue Jan 4, 2017 · 1 comment

Comments

@prazanna
Copy link
Contributor

prazanna commented Jan 4, 2017

When Joins need not be spilled on to disk - we can incrementally pull, transform and upsert in one DAG.
This utility will show case that.
@prazanna prazanna added this to the 0.2.5 milestone Jan 4, 2017
@prazanna prazanna self-assigned this Jan 4, 2017
@prazanna prazanna removed this from the 0.2.5 milestone Jan 11, 2017
@vinothchandar vinothchandar assigned bvaradar and unassigned prazanna Oct 23, 2018
@vinothchandar
Copy link
Member

DeltaStreamer now does this!! yaay!

zhangyue19921010 pushed a commit to zhangyue19921010/hudi that referenced this issue Aug 31, 2023
Add new payload:keep old record. (apache#20)
aaa576b 
* Add new payload:keep old record.
vinishjail97 pushed a commit to vinishjail97/hudi that referenced this issue Dec 15, 2023
@rmahindra123 @rmahindra
Run snapshot query for s3 incr source data rate estimation when no ch…
12c1980 
…eckpoint is present (apache#20)

* Add snapshot query

* Fix NPE

Co-authored-by: Rajesh Mahindra <rmahindra@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@vinothchandar @prazanna @bvaradar