Skip to content

duckdb: forbid reading files with duplicate struct field names#8917

Merged
myrrc merged 1 commit into
developfrom
myrrc/duckdb-forbid-struct-duplicate-fields
Jul 23, 2026
Merged

duckdb: forbid reading files with duplicate struct field names#8917
myrrc merged 1 commit into
developfrom
myrrc/duckdb-forbid-struct-duplicate-fields

Conversation

@myrrc

@myrrc myrrc commented Jul 23, 2026

Copy link
Copy Markdown
Contributor

Resolves: #8710

@myrrc
myrrc requested a review from a10y July 23, 2026 14:10
@myrrc myrrc added changelog/fix A bug fix ext/duckdb Relates to the DuckDB integration labels Jul 23, 2026
@myrrc
myrrc requested review from 0ax1 and removed request for a10y July 23, 2026 14:11
@myrrc
myrrc enabled auto-merge (squash) July 23, 2026 14:11
@myrrc
myrrc force-pushed the myrrc/duckdb-forbid-struct-duplicate-fields branch from cde335c to b853c3b Compare July 23, 2026 14:12
.map(|field_dtype| LogicalType::try_from(&field_dtype))
.collect::<Result<_, _>>()?;

let mut name_set = HashSet::new();

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why not do the rename thing like Parquet?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Because it's easier and signals to user there's something wrong instead of silently returning first column results. I believe Parquet reader should reject these as well.

@myrrc
myrrc requested a review from 0ax1 July 23, 2026 14:15
@myrrc
myrrc merged commit 3a098b4 into develop Jul 23, 2026
88 checks passed
@myrrc
myrrc deleted the myrrc/duckdb-forbid-struct-duplicate-fields branch July 23, 2026 14:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/fix A bug fix ext/duckdb Relates to the DuckDB integration

Projects

None yet

Development

Successfully merging this pull request may close these issues.

vortex-duckdb allows DuckDB Struct types with duplicate field names

2 participants