Skip to content

fix(cudf): Use Spark equalto in multi-branch SWITCH test - #110

Merged
sperlingxx merged 1 commit into
HighPerfDataAccelerator:devfrom
sperlingxx:fix/cudf-spark-filter-equalto
Sep 1, 2026
Merged

fix(cudf): Use Spark equalto in multi-branch SWITCH test#110
sperlingxx merged 1 commit into
HighPerfDataAccelerator:devfrom
sperlingxx:fix/cudf-spark-filter-equalto

Conversation

@sperlingxx

Copy link
Copy Markdown
Collaborator

Summary

  • Rewrite CudfFilterProjectTest.multiBranchSwitchWithRegexpExtract WHEN predicates from SQL = to Spark equalto(...).
  • DuckParser maps = to Presto eq, which the Spark fixture does not register, so the test died in resolveScalarFunctionType before SWITCH ran.
  • The invalid Spark CASE WHEN text was introduced in fix(cudf): Restore Spark workload coverage #54 (382e95fdd). This is a test-dialect fix, not a production SWITCH/regexp_extract change.

Test plan

  • Reproduce on HPDA dev 28798f623 (CUDA SM 86): Scalar function doesn't exist: eq.
  • After this change, CudfFilterProjectTest.multiBranchSwitchWithRegexpExtract passed.
  • Full velox_cudf_spark_filter_project_test: 57/57 passed (1 disabled hashWithSeedMultiColumns).

Fixes #109
Part of #100

Prepared with assistance from Cursor.

DuckParser maps SQL `=` to Presto `eq`, which the Spark fixture does
not register. The CASE WHEN predicates added in #54 therefore failed
with `Scalar function doesn't exist: eq` before SWITCH ran.

Fixes rapidsai#109
@sperlingxx

Copy link
Copy Markdown
Collaborator Author

build

@sperlingxx
sperlingxx merged commit bd4b186 into HighPerfDataAccelerator:dev Sep 1, 2026
5 of 6 checks passed
@sperlingxx
sperlingxx deleted the fix/cudf-spark-filter-equalto branch September 1, 2026 12:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[bug] Spark multi-branch SWITCH test uses Presto eq instead of equalto

2 participants