Skip to content

[0.17.0-incubating] Add avro dependency to parquet extension (#9124)#9125

Closed
suneet-s wants to merge 1 commit into
apache:0.17.0-incubatingfrom
suneet-s:backport/0.17.0-incubating/pr-9124
Closed

[0.17.0-incubating] Add avro dependency to parquet extension (#9124)#9125
suneet-s wants to merge 1 commit into
apache:0.17.0-incubatingfrom
suneet-s:backport/0.17.0-incubating/pr-9124

Conversation

@suneet-s
Copy link
Copy Markdown
Contributor

@suneet-s suneet-s commented Jan 4, 2020

Backports the following commits to 0.17.0-incubating:

* Add avro dependency to parquet extension

If the parquet extension is loaded and an ingestionSpec uses the older format
specifying a 'parser' instead of using an 'inputFormat' the job fails
with the following error

java.lang.TypeNotPresentException: Type org.apache.avro.generic.GenericRecord not present

This change removes the exclusion of the avro package so that the missing
class can be found.

* Address review comments and add dependency version
@suneet-s suneet-s force-pushed the backport/0.17.0-incubating/pr-9124 branch from e2d6488 to 5af5303 Compare January 4, 2020 04:45
@suneet-s suneet-s closed this Jan 4, 2020
@jon-wei jon-wei added this to the 0.17.0 milestone Jan 9, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants