-
Notifications
You must be signed in to change notification settings - Fork 79
Open
Labels
enhancementNew feature or requestNew feature or request
Description
With the Spark catalog, SQL queries go through Spark's query engine, causing two issues:
- Limited function support - ClickHouse-specific functions that aren't registered in Spark will fail
- Performance degradation - Incomplete query pushdown forces parts of the query to execute in Spark instead of ClickHouse
I propose add a query option to the TableProvider that executes raw SQL directly in ClickHouse and efficiently retrieves results to Spark. This bypasses Spark's query planner, preserving full ClickHouse functionality and performance.
BentsiLeviav
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request