You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Go's implementation of Schema panics if field names are duplicated within a schema. This is not guaranteed by the standard, so Go will not be able to handle valid record batches produced by other implementations which contain these.
Sebastien Binet / @sbinet:
I must say I fail to see the use case for a schema with multiple fields with the same name (and possibly with different data types).
and it seems more like an error that should be caught very early on.
Wes McKinney / @wesm:
The project has so far taken the position that downstream applications are responsible for the enforcement of these kinds of metadata constraints. From the perspective of the Arrow protocol "data is data". In my experience duplicate field names do arise in practice and it's a slippery slope if Arrow implementations start making arbitrary (or otherwise opinionated) decisions about what to do with such data (whether disallowing them or otherwise disambiguating them by modifying the field names). APIs that presume field name uniqueness can raise an exception, though
Sebastien Binet / @sbinet:
ok. I usually try to make defined behaviours very constrained (and then relaxing those if needed) as the opposite is a bit more convoluted to put in place.
Go's implementation of Schema panics if field names are duplicated within a schema. This is not guaranteed by the standard, so Go will not be able to handle valid record batches produced by other implementations which contain these.
https://github.com/apache/arrow/blob/084549a/go/arrow/schema.go#L117
Reporter: Ben Kietzman / @bkietz
Assignee: Sebastien Binet / @sbinet
PRs and other links:
Note: This issue was originally created as ARROW-8028. Please see the migration documentation for further details.
The text was updated successfully, but these errors were encountered: