[Bug]: PartitionNotFound if the partition was new created and never be flushed

[sunmingqiaa]

Is there an existing issue for this?

• I have searched the existing issues

Environment

- Milvus version:2.2.12
- Deployment mode(standalone or cluster):cluster
- MQ type(rocksmq, pulsar or kafka):    pulsar 
- SDK version(e.g. pymilvus v2.0.0rc2):pymilvus v2.0.0
- OS(Ubuntu or CentOS): CentOS
- CPU/Memory: 
- GPU: 
- Others:

Current Behavior

Reproduction Process:

Create a table named "test" with two partitions, labeled as 1 and 2.
Insert a record into each partition, one in partition 1 and another in partition 2.
Perform searches on both partitions 1 and 2, which should return the respective records successfully.
Next, create a new partition labeled as 3 and insert a record into it. When attempting to search specifically in partition 3, the result shows "reason=stream operation failed: PartitionNotFound(partitionID=443277368143647844)".
After performing a flush operation, searches on partition 3 return the record normally.
After conducting multiple tests, it was observed that when creating one or two partitions initially and following steps 1, 2, and 3, searches work correctly. However, when executing step 4, an exception is encountered.

Expected Behavior

it should normal return result

Steps To Reproduce

Reproduction Process:

Create a table named "test" with two partitions, labeled as 1 and 2.
Insert a record into each partition, one in partition 1 and another in partition 2.
Perform searches on both partitions 1 and 2, which should return the respective records successfully.
Next, create a new partition labeled as 3 and insert a record into it. When attempting to search specifically in partition 3, the result shows "reason=stream operation failed: PartitionNotFound(partitionID=443277368143647844)".
After performing a flush operation, searches on partition 3 return the record normally.
After conducting multiple tests, it was observed that when creating one or two partitions initially and following steps 1, 2, and 3, searches work correctly. However, when executing step 4, an exception is encountered.

Milvus Log

Failed to search vectors in Milvus: <MilvusException: (code=1, message=fail to search on all shard leaders, err=All attempts results:\nattempt #1:code: UnexpectedError, error: fail to Search, QueryNode ID=6, reason=stream operation failed: PartitionNotFound(partitionID=443277368143647844)\nattempt #2:context canceled\n)

Anything else?

No response

[yanliang567]

@jiaoew1991 sound like a corner issue that milvus did not sync the meta at once as partition created.
/assign @jiaoew1991
/unassign

[yanliang567]

/assign @NicoYuan1986
can we add a new test for this

[xiaofan-luan]

we are not support create partition while collection is loaded.
this is as expected in 2.2.12, we only load partitions list on the load

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
Rotten issues close after 30d of inactivity. Reopen the issue with /reopen.