feat(contrib): Native Delta Lake scan via delta-kernel-rs (Iceberg-style contrib)#4366

Draft

schenksj wants to merge 19 commits into

apache:mainfrom

schenksj:contrib-delta-direct

Commits on May 19, 2026

contrib(delta): scaffold typed-proto dispatch + skeleton crate

schenksj
and
claude
committed
contrib(delta): port native implementation from PR2 (minus SPI)

schenksj
and
claude
committed
contrib(delta): port reflection-only Scala files + dev scripts

schenksj
and
claude
committed
contrib(delta): port SPI-touching Scala files + Maven profile + reflection bridge

schenksj
and
claude
committed
fix(shuffle): get_string matches Spark's UTF8String no-validate semantics

schenksj
and
claude
committed
contrib(delta): wire CometExecRule serde dispatch

schenksj
and
claude
committed
contrib(delta): wire per-partition DeltaPlanDataInjector

schenksj
and
claude
committed
contrib(delta): scalastyle fixes for DeltaIntegration + operators

schenksj
and
claude
committed
fix(error): wrap native Parquet errors as FAILED_READ_FILE.NO_HINT with file path

schenksj
and
claude
committed
fix(contrib-delta) P7h: decline native scan for unsupported FS schemes

schenksj
and
claude
committed
fix(contrib-delta) P7i: cache DeltaEngine per (scheme,authority,config)

schenksj
and
claude
committed
fix(serde): decline CreateArray with mismatched child data types

schenksj
and
claude
committed
perf(contrib-delta) P7j: pre-parse session TZ and key injectors by op kind

schenksj
and
claude
committed
perf(contrib-delta) P7k: cache resolved Method handle in DeltaIntegration

schenksj
and
claude
committed
perf(contrib-delta) P7l: hoist CometScanTypeChecker out of per-scan loop

schenksj
and
claude
committed
perf(contrib-delta) P7m: O(1) partition-value lookup in build_delta_partitioned_files

schenksj
and
claude
committed
fix(error): thread file paths to FAILED_READ_FILE.NO_HINT wrapping

schenksj
and
claude
committed
fix(contrib-delta) P7n: review findings -- InputFileBlockHolder hook + safeguards

schenksj
and
claude
committed
chore: spotless:apply (no behavioral change)

schenksj
and
claude
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat(contrib): Native Delta Lake scan via delta-kernel-rs (Iceberg-style contrib)#4366

feat(contrib): Native Delta Lake scan via delta-kernel-rs (Iceberg-style contrib)#4366
schenksj wants to merge 19 commits into
apache:mainfrom
schenksj:contrib-delta-direct

Commits on May 19, 2026

contrib(delta): scaffold typed-proto dispatch + skeleton crate

contrib(delta): port native implementation from PR2 (minus SPI)

contrib(delta): port reflection-only Scala files + dev scripts

contrib(delta): port SPI-touching Scala files + Maven profile + reflection bridge

fix(shuffle): get_string matches Spark's UTF8String no-validate semantics

contrib(delta): wire CometExecRule serde dispatch

contrib(delta): wire per-partition DeltaPlanDataInjector

contrib(delta): scalastyle fixes for DeltaIntegration + operators

fix(error): wrap native Parquet errors as FAILED_READ_FILE.NO_HINT with file path

fix(contrib-delta) P7h: decline native scan for unsupported FS schemes

fix(contrib-delta) P7i: cache DeltaEngine per (scheme,authority,config)

fix(serde): decline CreateArray with mismatched child data types

perf(contrib-delta) P7j: pre-parse session TZ and key injectors by op kind

perf(contrib-delta) P7k: cache resolved Method handle in DeltaIntegration

perf(contrib-delta) P7l: hoist CometScanTypeChecker out of per-scan loop

perf(contrib-delta) P7m: O(1) partition-value lookup in build_delta_partitioned_files

fix(error): thread file paths to FAILED_READ_FILE.NO_HINT wrapping

fix(contrib-delta) P7n: review findings -- InputFileBlockHolder hook + safeguards

chore: spotless:apply (no behavioral change)