Skip to content

HadoopInputFormatIO should support custom key/value coder #18403

@kennknowles

Description

@kennknowles

Right now HadoopInputFormatIO infers coders with getDefaultCoder but this doesn't work for cases like AvroCoder with GenericRecord, for example, when Avro is used with Parquet.

https://github.com/apache/beam/blob/master/sdks/java/io/hadoop/input-format/src/main/java/org/apache/beam/sdk/io/hadoop/inputformat/HadoopInputFormatIO.java#L288

Imported from Jira BEAM-2765. Original Jira may contain additional context.
Reported by: sinisa_lyh.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions