-
Notifications
You must be signed in to change notification settings - Fork 72
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Generated hive udf for working with struct values fails #120
Comments
I tried to fix this by making the following change in the hive implementation of
But after the above fix, I ran into more class cast issues because I'll leave it to the experts of this codebase to fix this issue /guide me. |
Mohit, please share the minimum code and steps to reproduce the error locally. You can raise a PR in transport and add the steps in the PR description. |
Hello, I posted all the details here already. To repro this issue, you can creat a new UDF in The previous comment was my attempt to fix it but I believe it was not complete. |
from the error trace, im not sure which line number is throwing the error. For ex: it would help to know what is Can you refer the struct fields using names and not index? Ex: |
Created a PR to repro the issue: |
I created a simple UDF and a unit test for it in the
transport-udfs-examples
module. The UDF increments the first integer field of a struct by 1. This is the UDF and the unit test:A unit test for it:
The generated spark_2.11 and spark_2.12 UDFs run correctly. But the generated hive artifact fails with the below exception (I am running the gradle task
./gradlew hiveTask
for testing).I don't have any local changes. Am I doing something wrong or is this something to fix?
The text was updated successfully, but these errors were encountered: