Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-15642][SQL] Bug report: metadata gets lost when selecting a field of a StructType #13467

Closed
wants to merge 4 commits into from

Conversation

zommerfelds
Copy link

@zommerfelds zommerfelds commented Jun 2, 2016

This PR only shows how to reproduce the bug.
https://issues.apache.org/jira/browse/SPARK-15642

I am not sure if this is expected behaviour or not, please comment.

EDIT: removed WIP from title

@zommerfelds zommerfelds changed the title [SPARK-15642][SQL][WIP] Added test case [SPARK-15642][SQL][WIP] Metadata gets lost when selecting a field of a StructType Jun 2, 2016
@AmplabJenkins
Copy link

Can one of the admins verify this patch?

@HyukjinKwon
Copy link
Member

Hi @zommerfelds, do you mind if I ask whether you still working on this? It seems inactive for more than a half year. Maybe, it'd be better closed for now if you are currently not able to work on this further.

@zommerfelds
Copy link
Author

Hi @HyukjinKwon, I never worked on the fix, because I never got confirmation if this is actually a bug or not. This PR demonstrates the bug I posted on Jira.
If you want I can try to find out if this is still present in the most recent version of Spark.

@HyukjinKwon
Copy link
Member

HyukjinKwon commented Feb 11, 2017

Aha, then to be strict, it is not WIP but just waiting for the feedback. How about closing this and pinging related guys who touched this code path lately in the JIRA?

@zommerfelds
Copy link
Author

zommerfelds commented Feb 11, 2017 via email

@HyukjinKwon
Copy link
Member

Yes, exactly. That's usually I do.

@zommerfelds zommerfelds changed the title [SPARK-15642][SQL][WIP] Metadata gets lost when selecting a field of a StructType [SPARK-15642][SQL] Bug report: metadata gets lost when selecting a field of a StructType Feb 11, 2017
@zommerfelds
Copy link
Author

The bug is still present. To be honest I don't think I have time to work on this right now, so we can close this PR if you want. I tried to find the code that was related to this functionality but didn't get there yet, so not sure who to contact. Someone might be able to tell really fast if this is a bug or not, and what has to be done to fix it.

srowen added a commit to srowen/spark that referenced this pull request Mar 22, 2017
@srowen srowen mentioned this pull request Mar 22, 2017
@asfgit asfgit closed this in b70c03a Mar 23, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
3 participants