Skip to content

When there are more than one filter conditions, triggering bloomFilter will cause the task to fail #1492

@lk246

Description

@lk246

Describe the bug

When there are more than one filter conditions, triggering bloomFilter will cause the task to fail.

To Reproduce

  1. enabled reuseSubquery
    set spark.sql.execution.reuseSubquery=true;
  2. there are more than one filter conditions, triggering bloomFilter

Expected behavior

Screenshots

UI:
Image
executor:
Image
driver:
Image

Additional context

After reusing the subquery, there is a bug in the conversion between Arrow and Spark due to the presence of two filtering conditions, which leads to issues with the schema information in the subquery.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions