register not equal function to gluten for data type integer (gluten-flink/planner/src/main/java/org/apache/gluten/rexnode/functions/RexCallConverterFactory.java), but it is not supported by velox.
Map.entry(
"<>",
Arrays.asList(
() -> new BasicArithmeticOperatorRexCallConverter("notequalto"),
() -> new StringCompareRexCallConverter("notequalto"),
() -> new StringNumberCompareRexCallConverter("notequalto"))),
Backend
VL (Velox)
Bug description
Function 'runAndCheck' in gluten-flink/ut/src/test/java/org/apache/gluten/table/runtime/stream/common/GlutenStreamingTestBase.java waits for the result in file 'taskmanager.out'. If some failures happend in velox, the file keeps empty, the function waits for the result always the time.
How to reproduce:
register not equal function to gluten for data type integer (gluten-flink/planner/src/main/java/org/apache/gluten/rexnode/functions/RexCallConverterFactory.java), but it is not supported by velox.
run an unit test like the following:
@test
void testNEqual() {
List rows =
Arrays.asList(Row.of(1, 1L, "2", "1"), Row.of(2, 2L, "2", "2"), Row.of(3, 3L, "2", "1"));
createSimpleBoundedValuesTable("tblLess", "a int, b bigint, c string, d string", rows);
String query = "select a <> 2 as x from tblLess where a > 0";
runAndCheck(query, Arrays.asList("+I[true]", "+I[false]", "+I[true]"));
}
the unit test gets stuck.
Gluten version
No response
Spark version
None
Spark configurations
No response
System information
No response
Relevant logs