Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix empty struct write error. #1272

Merged
merged 2 commits into from Jan 20, 2017
Merged

Fix empty struct write error. #1272

merged 2 commits into from Jan 20, 2017

Conversation

cseed
Copy link
Collaborator

@cseed cseed commented Jan 19, 2017

Fixes #1260

case (v, f) => exportAnnotation(v, f.`type`)
})
if (fields.isEmpty)
false
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why is this false?

Allow va to be nullable in VDS parquet schema.
@cseed
Copy link
Collaborator Author

cseed commented Jan 19, 2017

I changed it to null and now allow annotations to be nullable in the VDS parquet schema. This is the bug-fix part of #1194.

Spark can't write empty structs so we export empty structs as Boolean and write out a placeholder value.

@jbloom22 jbloom22 merged commit ce1cb34 into hail-is:master Jan 20, 2017
@cseed
Copy link
Collaborator Author

cseed commented Jan 20, 2017

@jigold rightly pointed out I didn't add a regression test for this. @jigold next time request changes! @jbloom22 next time request tests! @cseed write tests for failures!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants