[default values] Spark catalog itest for ReadBridge initial-default overlay - #681
Open
cbb330 wants to merge 1 commit into
Open
[default values] Spark catalog itest for ReadBridge initial-default overlay#681cbb330 wants to merge 1 commit into
cbb330 wants to merge 1 commit into
Conversation
cbb330
force-pushed
the
chbush/read-bridge-apply
branch
2 times, most recently
from
August 13, 2026 05:52
4c6f354 to
a64ea0f
Compare
cbb330
force-pushed
the
chbush/read-bridge-spark-itest
branch
from
August 13, 2026 05:59
36e818e to
d799227
Compare
This was referenced Aug 13, 2026
cbb330
force-pushed
the
chbush/read-bridge-apply
branch
from
August 13, 2026 06:10
a64ea0f to
4be6d59
Compare
cbb330
force-pushed
the
chbush/read-bridge-spark-itest
branch
from
August 13, 2026 06:48
d799227 to
610d668
Compare
cbb330
force-pushed
the
chbush/read-bridge-apply
branch
from
August 13, 2026 22:27
4be6d59 to
08551a4
Compare
cbb330
force-pushed
the
chbush/read-bridge-spark-itest
branch
from
August 13, 2026 22:28
610d668 to
b1a506a
Compare
cbb330
force-pushed
the
chbush/read-bridge-apply
branch
from
August 13, 2026 22:36
08551a4 to
145297f
Compare
cbb330
force-pushed
the
chbush/read-bridge-spark-itest
branch
from
August 13, 2026 22:36
b1a506a to
8c170e5
Compare
cbb330
force-pushed
the
chbush/read-bridge-apply
branch
from
August 13, 2026 23:56
145297f to
17b3d21
Compare
cbb330
force-pushed
the
chbush/read-bridge-spark-itest
branch
from
August 13, 2026 23:56
8c170e5 to
d6dbba3
Compare
cbb330
force-pushed
the
chbush/read-bridge-apply
branch
from
August 14, 2026 04:43
17b3d21 to
d7edc72
Compare
cbb330
force-pushed
the
chbush/read-bridge-spark-itest
branch
from
August 14, 2026 04:44
d6dbba3 to
a301754
Compare
cbb330
force-pushed
the
chbush/read-bridge-apply
branch
from
August 14, 2026 20:41
d7edc72 to
950f3f4
Compare
cbb330
force-pushed
the
chbush/read-bridge-spark-itest
branch
from
August 14, 2026 20:41
a301754 to
2228148
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Stacked on #679. Spark catalog itest that runs create → insert →
ADD COLUMNthrough the OpenHouse catalog and asserts ReadBridge stampedinitial-defaulton Spark's Iceberg table.OSS has no deployment
ColumnDefaultsSource; the local-server fixture supplies one ford1_column_defaultso the client overlay is exercised. SQL fill/filter cases are present but@Disableduntil OpenHouse bumps Iceberg past 1.2.0.20 (linkedin/iceberg#267–269): that runtime's Spark parquet/ORC readers do not fillinitial-default.Changes
Adds
ColumnDefaultSparkITestand a local-serverColumnDefaultsSourcestub (SparkItestColumnDefaults) imported bySpringH2TestApplication.Testing Done
./gradlew :integrations:spark:spark-3.1:openhouse-spark-itest:catalogTest --tests com.linkedin.openhouse.spark.catalogtest.ColumnDefaultSparkITest(JDK 11). Overlay test passed; SQL fill test remains disabled.Additional Information
Stack
ReadBridge.applyDepends on #679. Enable
columnDefaultBackfillViaReadBridgeafter the Iceberg bump that includes reader fill.