Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Spark] Streaming Read #129

Merged
merged 28 commits into from
Jan 5, 2023
Merged

[Spark] Streaming Read #129

merged 28 commits into from
Jan 5, 2023

Conversation

lypnaruto
Copy link
Contributor

@lypnaruto lypnaruto commented Jan 4, 2023

1.add streaming read for LakeSoul
2.add test case about streaming read
3.add multi-partition test case about snapshot and incremental query

Close #130

@dmetasoul01 dmetasoul01 changed the title streaming read [Spark] Streaming Read Jan 4, 2023
@dmetasoul01 dmetasoul01 added enhancement New feature or request spark spark support into lakesoul labels Jan 4, 2023
lypnaruto and others added 3 commits January 4, 2023 22:02
# Conflicts:
#	lakesoul-spark/src/main/scala/org/apache/spark/sql/execution/datasources/v2/merge/MergeParquetScan.scala
#	lakesoul-spark/src/main/scala/org/apache/spark/sql/lakesoul/catalog/LakeSoulScanBuilder.scala
…alQuery

# Conflicts:
#	lakesoul-spark/src/test/scala/org/apache/spark/sql/lakesoul/ReadSuite.scala
@dmetasoul01 dmetasoul01 merged commit 3118719 into main Jan 5, 2023
@dmetasoul01 dmetasoul01 deleted the incrementalQuery branch January 5, 2023 02:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request spark spark support into lakesoul
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Spark]Support streaming read
2 participants