Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

SPARK-1851. Upgrade Avro dependency to 1.7.6 so Spark can read Avro file... #795

Closed
wants to merge 1 commit into from
Closed

SPARK-1851. Upgrade Avro dependency to 1.7.6 so Spark can read Avro file... #795

wants to merge 1 commit into from

Conversation

sryza
Copy link
Contributor

@sryza sryza commented May 15, 2014

...s

@AmplabJenkins
Copy link

Merged build triggered.

@AmplabJenkins
Copy link

Merged build started.

@pwendell
Copy link
Contributor

Could you explain a bit more exactly what the issue is here and what happens when you try to read avro files as-is?

AFAIK the avro format should binary compatible between 1.7.4 and 1.7.6, so just trying to figure out why one version can read files and another can't. Is the issue that some other dependency in our graph is linked against 1.7.6 and fails?

@pwendell
Copy link
Contributor

Ah - sorry I see there is information in the JIRA

@AmplabJenkins
Copy link

Merged build finished. All automated tests passed.

@AmplabJenkins
Copy link

All automated tests passed.
Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15031/

@pwendell
Copy link
Contributor

Hey @sryza - thanks a lot for this. We've had reports of issues with Avro for a while and this is finally a coherent explanation of what's not working. I'm tempted to cut a new RC for this fix, let's see what else comes in today.

asfgit pushed a commit that referenced this pull request May 15, 2014
@sryza @pwendell
SPARK-1851. Upgrade Avro dependency to 1.7.6 so Spark can read Avro f…
3587057 
…ile...

...s

Author: Sandy Ryza <sandy@cloudera.com>

Closes #795 from sryza/sandy-spark-1851 and squashes the following commits:

79c8227 [Sandy Ryza] SPARK-1851. Upgrade Avro dependency to 1.7.6 so Spark can read Avro files
(cherry picked from commit 08e7606)

Signed-off-by: Patrick Wendell <pwendell@gmail.com>
@asfgit asfgit closed this in 08e7606 May 15, 2014
pdeyhim pushed a commit to pdeyhim/spark-1 that referenced this pull request Jun 25, 2014
@sryza @pdeyhim
SPARK-1851. Upgrade Avro dependency to 1.7.6 so Spark can read Avro f…
3dc010b 
…ile...

...s

Author: Sandy Ryza <sandy@cloudera.com>

Closes apache#795 from sryza/sandy-spark-1851 and squashes the following commits:

79c8227 [Sandy Ryza] SPARK-1851. Upgrade Avro dependency to 1.7.6 so Spark can read Avro files
Agirish pushed a commit to HPEEzmeral/apache-spark that referenced this pull request May 5, 2022
@avenherak
MapR [SPARK-851] Spark SQL transient FS error handling when writing o…
f0c31b1 
…utput (apache#795)
udaynpusa pushed a commit to mapr/spark that referenced this pull request Jan 30, 2024
@avenherak @ekrivokonmapr
MapR [SPARK-851] Spark SQL transient FS error handling when writing o…
a98d9da 
…utput (apache#795)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
3 participants
@sryza @AmplabJenkins @pwendell