Description
Hello,
The current project is using Calcite version 1.28.0, which was released over 4 years ago. This version is outdated and lacks support for several important features, particularly for BigQuery and other SQL dialects.
There is also an opportunity to improve consistency in the current approach: while ZetaSQL is being deprecated due to the lack of updates and new releases, Calcite has also not been updated for quite some time, despite its aging version.
Proposed Solution:
Upgrade the Calcite dependency to the latest stable version to take advantage of the following:
-
Enhanced support for BigQuery and other SQL dialects.
-
Access to a broader range of SQL functions and operators.
-
Improved performance, bug fixes, and compatibility with modern technologies.
Impact:
Updating Calcite will improve the project's compatibility with BigQuery and provide access to more advanced SQL functionality. However, the upgrade may require testing to ensure that the changes do not introduce regressions or compatibility issues.
This issue is related to the ongoing work in apache/beam#35472
Thank you to the community for the great work so far—this suggestion aims to build on your solid foundation.
Issue Priority
Priority: 2 (default / most normal work should be filed as P2)
Issue Components
- Component: Python SDK
- Component: Java SDK
- Component: Go SDK
- Component: Typescript SDK
- Component: IO connector
- Component: Beam YAML
- Component: Beam examples
- Component: Beam playground
- Component: Beam katas
- Component: Website
- Component: Infrastructure
- Component: Spark Runner
- Component: Flink Runner
- Component: Samza Runner
- Component: Twister2 Runner
- Component: Hazelcast Jet Runner
- Component: Google Cloud Dataflow Runner