Join GitHub today
GitHub is home to over 28 million developers working together to host and review code, manage projects, and build software together.Sign up
Does the nested record Flattener drop Maps/Arrays? #1244
I saw this when doing a cleanup pass over
This is somewhat problematic as some of our nested schemas (specifically, Genotype) use Array fields, and many use Maps.
CC @tomwhite. Do you know if this code is still in use? If not, it might make more sense to drop the code instead of patching the code. I think we were using it in Eggo to flatten schemas for Hive/Impala/Spark SQL before those tools supported nested schemas, but I think those tools all support nested schemas now.