Error 134 on SQL regular expressions with Comet 0.12.0 (Spark 3.5.4, Scala 2.13) #4895
ilia-susanoo
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hello,
We are testing Comet (version 0.12.0) with Spark 3.5.4 and Scala 2.13 on Debian Buster. We've encountered a JVM crash (exit code 134 / SIGABRT) while running TPC-H benchmarks,from datafusion-benchmarks repo specifically on ./tpch/queries/q13.sql and q16.sql.
After some investigation, we narrowed down the issue to the LIKE '%express%requests%' filter pattern. It seems that the native execution fails when processing this specific string pattern.
Our build command:
make release PROFILES="-PLinux-amd64 -Pspark-3.5 -Pscala-2.13 -Pjdk17"
Environment:
OS: Debian Buster (glibc 2.28)
openJDK: 17
Spark: 3.5.4
Scala: 2.13.8
Observation:
If we disable native execution for this specific query or use a simpler filter, the crash does not occur. We suspect it might be related to the string kernels in DataFusion or the JNI transition for complex LIKE patterns.
Do you have any suggestions on how to fix this or debug it further?
Beta Was this translation helpful? Give feedback.
All reactions