[Bug]: Search did not return enough result after segment compaction

[MrPresent-Han]

Is there an existing issue for this?

• I have searched the existing issues

Environment

- Milvus version:master
- Deployment mode(standalone or cluster):
- MQ type(rocksmq, pulsar or kafka):    
- SDK version(e.g. pymilvus v2.0.0rc2):
- OS(Ubuntu or CentOS): 
- CPU/Memory: 
- GPU: 
- Others:

Current Behavior

topK=10, but only get 9 entities after searching for e2e test:
testcases/test_compaction.py::TestCompactionOperation::test_compact_during_insert

Expected Behavior

get correct number

Steps To Reproduce

testcases/test_compaction.py::TestCompactionOperation::test_compact_during_insert

Milvus Log

No response

Anything else?

No response

[MrPresent-Han]

[2024/05/21 07:13:51.227 +00:00] [DEBUG] [delegator/delegator.go:210] ["search segments..."] [traceID=b05f6489734a7a42d63ecd8de59ebf3c] [collectionID=449910774687176412] [channel=by-dev-rootcoord-dml_2_449910774687176412v0] [replicaID=449910802170512138] [sealedNum=1] [growingNum=0]

only searched single one segment and proxy only got result from one shard:

[2024/05/21 07:13:51.237 +00:00] [DEBUG] [proxy/search_reduce_util.go:280] [subSearchResultData] [traceID=b05f6489734a7a42d63ecd8de59ebf3c] ["result No."=0] [nq=1] [topk=10] ["length of pks"=9] ["length of FieldsData"=0]

So there's only one possibility that the result from that segment was already 9 entities

[xiaofan-luan]

this could happen with duplicated pk

[yanliang567]

@MrPresent-Han is this the same to #33297
/assign @MrPresent-Han
/unassign

[congqixia]

Shall be fixed by #33359