[Enhancement]: optimize reduce perf

[MrPresent-Han]

Is there an existing issue for this?

• I have searched the existing issues

What would you like to be added?

optimize the perf of stream reduce

Why is this needed?

1. existing implementation involves too many comparisons which can be replaced with min-heap rather than max-heap
2. existing search procedure drives search operations towards segments one by one, which may incur N times IO stress in the worst case, this can be optimized by group searched segments

Anything else?

No response

[MrPresent-Han]

/assign MrPresent-Han

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
Rotten issues close after 30d of inactivity. Reopen the issue with /reopen.

[MrPresent-Han]

In the process of reduce, we need to filter out some results with INVALID_TAG, this is due to the fact than knowhere will complement query results that are insufficient for topk. This problem waste some memory and cpu cycles in the process of reduce

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
Rotten issues close after 30d of inactivity. Reopen the issue with /reopen.