Skip to content

Improve Avro Reader Types Support #18810

@EmilyMatt

Description

@EmilyMatt

Is your feature request related to a problem or challenge?

Support of the various byte types is rudimentary and only exists for the plain case.
Binary types cannot be read from Fixed types
both Binary and LargeBinary are creating BinaryArray, likewise for Utf8 and LargeUtf8, in case it doesn't crash, that will force a cast when the ArrayData needs to be converted into to correct type later.

On the performance side, all binary/utf8 types there do a full copy of the data to an owned form, for binary-intensive files this is an absolute performance killer, and can be rather easily resolved by using Cow types

Describe the solution you'd like

No response

Describe alternatives you've considered

No response

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions