Skip to content

[0.17.0] Add avro dependency to parquet extension (#9124)#9127

Merged
jon-wei merged 1 commit into
apache:0.17.0from
suneet-s:backport/0.17.0/pr-9124
Jan 4, 2020
Merged

[0.17.0] Add avro dependency to parquet extension (#9124)#9127
jon-wei merged 1 commit into
apache:0.17.0from
suneet-s:backport/0.17.0/pr-9124

Conversation

@suneet-s
Copy link
Copy Markdown
Contributor

@suneet-s suneet-s commented Jan 4, 2020

Backports the following commits to 0.17.0:

* Add avro dependency to parquet extension

If the parquet extension is loaded and an ingestionSpec uses the older format
specifying a 'parser' instead of using an 'inputFormat' the job fails
with the following error

java.lang.TypeNotPresentException: Type org.apache.avro.generic.GenericRecord not present

This change removes the exclusion of the avro package so that the missing
class can be found.

* Address review comments and add dependency version
@jon-wei jon-wei merged commit eabbc31 into apache:0.17.0 Jan 4, 2020
@clintropolis clintropolis added this to the 0.17.0 milestone Jan 8, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants