What is the problem the feature request solves?
Currently except for executing entire query plan by calling collect, show etc., we don't have a way to collect the result of any Comet operators in the middle of a query. In many cases, we need this feature so we can evaluate a child operator inside another Comet operator. This is also useful for debugging an arbitrary Comet operator.
Describe the potential solution
Add an new API executeColumnarCollectIterator to CometExec to collect Comet operator result.
Additional context
No response
What is the problem the feature request solves?
Currently except for executing entire query plan by calling
collect,showetc., we don't have a way to collect the result of any Comet operators in the middle of a query. In many cases, we need this feature so we can evaluate a child operator inside another Comet operator. This is also useful for debugging an arbitrary Comet operator.Describe the potential solution
Add an new API
executeColumnarCollectIteratortoCometExecto collectCometoperator result.Additional context
No response