-
Notifications
You must be signed in to change notification settings - Fork 232
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Parsing a column containing invalid json into StructureType with schema throws an Exception. #10891
Comments
@Feng-Jiang28 Thanks for submitting this. I put in some fixes into CUDF, but it still requires a small change to the plugin to help address it. I thought I had put up a PR for it. But I guess I forgot to. If you want to give it a try you just need to change spark-rapids/sql-plugin/src/main/scala/org/apache/spark/sql/rapids/GpuJsonToStructs.scala Line 179 in c5da29d
So it passes |
No problem Bobby, I will I would put a PR for it |
Parsing a column containing invalid json into StructureType with schema throws an Exception.
Repro:
GPU:
CPU:
The text was updated successfully, but these errors were encountered: