很奇怪的查询不到数据的情况

[ruixiu]

There are about 100000 vector data. According to the statistics, more than 18000 vector data exist in the following situations:

1. The vector of vector data can be queried in milvus normally

2. No other vector can be queried in milvus

3. Re insert the vector data in question, and it will be normal

It took me a week to figure out why. seek help!!!!!

[yhmo]

不太理解你说的意思，第一条说能够正常查询，第二条说其他的向量无法查询？你用的milvus版本是哪个版本？调用的API是search()还是query()?

[yhmo]

还有一个情况，不知道是啥原因引起的：2.1.4版本单机版运行一段时间（没固定规律）后会报rpc不可用，重启一下就正常了。后来换成2.1.4集群版，稳定运行了两天，今天又出来了类似的问题。

这种问题一般要到 https://github.com/milvus-io/milvus/issues 里报issue，然后提供当时不可用时的日志。从截图上看rootcoord挂了，但具体原因未知。

[yhmo]

@ruixiu
我们发现#20703是由于search时设置了expr="id > 0"，所以第一条不会被搜到，这是符合预期的。
确认一下，你说的“向量库里有一条向量数据，使用这条数据的特征向量可以查询到，换另外的特征向量就查询不到了”这个问题，调用search时用到了expr这个参数么？

[ruixiu]

1.用了expr，在attu工具查询的时候直接返回empty
2.不用expr，自己代码查询，top值设为最大，检查返回的结果里也没有

[ruixiu]

使用attu查询的效果：
使用其他图片的向量查不到

使用库里记录对应的向量可以查到

collection结构：

[ruixiu]

attu查询，querynode的日志：
[2022/11/23 02:33:10.834 +00:00] [DEBUG] [querynode/validate.go:131] ["validateOnStreamReplica getSegmentIDsByVChannel"] [traceID=5049206b8f3b480a] [collectionID=437519009796387257] [vChannel=by-dev-rootcoord-dml_51_437519009796387257v1] [partitionIDs="[437519009796387258]"] [segmentIDs="[437519009815026562]"] []
[2022/11/23 02:33:10.834 +00:00] [DEBUG] [querynode/validate.go:131] ["validateOnStreamReplica getSegmentIDsByVChannel"] [traceID=5049206b8f3b480a] [collectionID=437519009796387257] [vChannel=by-dev-rootcoord-dml_50_437519009796387257v0] [partitionIDs="[437519009796387258]"] [segmentIDs="[437519009815026765]"] []
[2022/11/23 02:33:10.834 +00:00] [DEBUG] [querynode/segment.go:358] ["start do search on segment"] [msgID=437563107645325317] [segmentID=437519009815026562] [segmentType=2] [loadIndex=false]
[2022/11/23 02:33:10.834 +00:00] [DEBUG] [querynode/segment.go:358] ["start do search on segment"] [msgID=437563107645325317] [segmentID=437519009815026765] [segmentType=2] [loadIndex=false]
[2022/11/23 02:33:10.834 +00:00] [DEBUG] [querynode/segment.go:375] ["do search on segment done"] [msgID=437563107645325317] [segmentID=437519009815026562] [segmentType=2] [loadIndex=false]
[2022/11/23 02:33:10.834 +00:00] [DEBUG] [querynode/segment.go:375] ["do search on segment done"] [msgID=437563107645325317] [segmentID=437519009815026765] [segmentType=2] [loadIndex=false]
[2022/11/23 02:33:10.835 +00:00] [DEBUG] [querynode/task_read.go:171] ["query msg can do"] [collectionID=437519009796387257] [sm.GuaranteeTimestamp=2022/11/23 02:33:10.273 +00:00] [serviceTime=2022/11/23 02:33:10.622 +00:00] ["delta milliseconds"=-349] [channel=by-dev-rootcoord-delta_51_437519009796387257v1] [msgID=437563107645325317]
[2022/11/23 02:33:10.835 +00:00] [DEBUG] [timerecord/time_recorder.go:91] ["searchTask: enqueueEnd (544ms)"]
[2022/11/23 02:33:10.836 +00:00] [DEBUG] [querynode/validate.go:50] ["read target partitions"] [traceID=5049206b8f3b480a] [collectionID=437519009796387257] [partitionIDs="[437519009796387258]"]
[2022/11/23 02:33:10.836 +00:00] [DEBUG] [querynode/segment.go:358] ["start do search on segment"] [msgID=437563107645325317] [segmentID=437519009796387331] [segmentType=3] [loadIndex=true]
[2022/11/23 02:33:10.836 +00:00] [DEBUG] [querynode/task_read.go:171] ["query msg can do"] [collectionID=437519009796387257] [sm.GuaranteeTimestamp=2022/11/23 02:33:10.273 +00:00] [serviceTime=2022/11/23 02:33:10.622 +00:00] ["delta milliseconds"=-349] [channel=by-dev-rootcoord-delta_50_437519009796387257v0] [msgID=437563107645325317]
[2022/11/23 02:33:10.836 +00:00] [DEBUG] [querynode/segment.go:358] ["start do search on segment"] [msgID=437563107645325317] [segmentID=437519009808243497] [segmentType=3] [loadIndex=true]
[2022/11/23 02:33:10.836 +00:00] [DEBUG] [timerecord/time_recorder.go:91] ["searchTask: enqueueEnd (545ms)"]
[2022/11/23 02:33:10.836 +00:00] [DEBUG] [querynode/segment.go:358] ["start do search on segment"] [msgID=437563107645325317] [segmentID=437519009813969708] [segmentType=3] [loadIndex=true]
[2022/11/23 02:33:10.836 +00:00] [DEBUG] [querynode/validate.go:50] ["read target partitions"] [traceID=5049206b8f3b480a] [collectionID=437519009796387257] [partitionIDs="[437519009796387258]"]
[2022/11/23 02:33:10.836 +00:00] [DEBUG] [querynode/segment.go:358] ["start do search on segment"] [msgID=437563107645325317] [segmentID=437519009802312575] [segmentType=3] [loadIndex=true]
[2022/11/23 02:33:10.836 +00:00] [DEBUG] [querynode/segment.go:375] ["do search on segment done"] [msgID=437563107645325317] [segmentID=437519009796387331] [segmentType=3] [loadIndex=true]
[2022/11/23 02:33:10.836 +00:00] [DEBUG] [querynode/segment.go:375] ["do search on segment done"] [msgID=437563107645325317] [segmentID=437519009813969708] [segmentType=3] [loadIndex=true]
[2022/11/23 02:33:10.836 +00:00] [DEBUG] [querynode/segment.go:375] ["do search on segment done"] [msgID=437563107645325317] [segmentID=437519009808243497] [segmentType=3] [loadIndex=true]
[2022/11/23 02:33:10.836 +00:00] [DEBUG] [querynode/segment.go:358] ["start do search on segment"] [msgID=437563107645325317] [segmentID=437519009802316734] [segmentType=3] [loadIndex=true]
[2022/11/23 02:33:10.836 +00:00] [DEBUG] [querynode/segment.go:358] ["start do search on segment"] [msgID=437563107645325317] [segmentID=437519009796387330] [segmentType=3] [loadIndex=true]
[2022/11/23 02:33:10.836 +00:00] [DEBUG] [querynode/segment.go:358] ["start do search on segment"] [msgID=437563107645325317] [segmentID=437519009813969390] [segmentType=3] [loadIndex=true]
[2022/11/23 02:33:10.836 +00:00] [DEBUG] [querynode/segment.go:358] ["start do search on segment"] [msgID=437563107645325317] [segmentID=437519009808240371] [segmentType=3] [loadIndex=true]
[2022/11/23 02:33:10.836 +00:00] [DEBUG] [querynode/segment.go:375] ["do search on segment done"] [msgID=437563107645325317] [segmentID=437519009802312575] [segmentType=3] [loadIndex=true]
[2022/11/23 02:33:10.836 +00:00] [DEBUG] [querynode/segment.go:375] ["do search on segment done"] [msgID=437563107645325317] [segmentID=437519009813969390] [segmentType=3] [loadIndex=true]
[2022/11/23 02:33:10.836 +00:00] [DEBUG] [querynode/segment.go:375] ["do search on segment done"] [msgID=437563107645325317] [segmentID=437519009802316734] [segmentType=3] [loadIndex=true]
[2022/11/23 02:33:10.836 +00:00] [DEBUG] [querynode/segment.go:375] ["do search on segment done"] [msgID=437563107645325317] [segmentID=437519009808240371] [segmentType=3] [loadIndex=true]
[2022/11/23 02:33:10.836 +00:00] [DEBUG] [timerecord/time_recorder.go:91] ["do search done, msgID = 437563107645325317, fromSharedLeader = true, vChannel = by-dev-rootcoord-dml_51_437519009796387257v1, segmentIDs = [437519009813969708 437519009808243497 437519009802316734 437519009796387331] (545ms)"] [traceID=5049206b8f3b480a]
[2022/11/23 02:33:10.836 +00:00] [DEBUG] [querynode/result.go:86] ["shard leader get valid search results"] [traceID=5049206b8f3b480a] [numbers=1]
[2022/11/23 02:33:10.836 +00:00] [DEBUG] [querynode/result.go:89] [reduceSearchResultData] [traceID=5049206b8f3b480a] ["result No."=0] [nq=1] [topk=100]
[2022/11/23 02:33:10.836 +00:00] [DEBUG] [querynode/result.go:181] ["skip duplicated search result"] [traceID=5049206b8f3b480a] [count=0]
[2022/11/23 02:33:10.836 +00:00] [DEBUG] [timerecord/time_recorder.go:91] ["start reduce search result, msgID = 437563107645325317, fromSharedLeader = false, vChannel = by-dev-rootcoord-dml_51_437519009796387257v1, segmentIDs = [] (545ms)"] [traceID=5049206b8f3b480a]
[2022/11/23 02:33:10.836 +00:00] [DEBUG] [querynode/result.go:86] ["shard leader get valid search results"] [traceID=5049206b8f3b480a] [numbers=1]
[2022/11/23 02:33:10.836 +00:00] [DEBUG] [querynode/result.go:89] [reduceSearchResultData] [traceID=5049206b8f3b480a] ["result No."=0] [nq=1] [topk=100]
[2022/11/23 02:33:10.836 +00:00] [DEBUG] [querynode/result.go:181] ["skip duplicated search result"] [traceID=5049206b8f3b480a] [count=0]
[2022/11/23 02:33:10.836 +00:00] [DEBUG] [timerecord/time_recorder.go:91] ["do search done, msgID = 437563107645325317, fromSharedLeader = false, vChannel = by-dev-rootcoord-dml_51_437519009796387257v1, segmentIDs = [] (545ms)"] [traceID=5049206b8f3b480a]
[2022/11/23 02:33:10.837 +00:00] [DEBUG] [querynode/segment.go:375] ["do search on segment done"] [msgID=437563107645325317] [segmentID=437519009796387330] [segmentType=3] [loadIndex=true]
[2022/11/23 02:33:10.837 +00:00] [DEBUG] [timerecord/time_recorder.go:91] ["do search done, msgID = 437563107645325317, fromSharedLeader = true, vChannel = by-dev-rootcoord-dml_50_437519009796387257v0, segmentIDs = [437519009808240371 437519009813969390 437519009796387330 437519009802312575] (546ms)"] [traceID=5049206b8f3b480a]
[2022/11/23 02:33:10.837 +00:00] [DEBUG] [querynode/result.go:86] ["shard leader get valid search results"] [traceID=5049206b8f3b480a] [numbers=1]
[2022/11/23 02:33:10.837 +00:00] [DEBUG] [querynode/result.go:89] [reduceSearchResultData] [traceID=5049206b8f3b480a] ["result No."=0] [nq=1] [topk=100]
[2022/11/23 02:33:10.837 +00:00] [DEBUG] [querynode/result.go:181] ["skip duplicated search result"] [traceID=5049206b8f3b480a] [count=0]
[2022/11/23 02:33:10.837 +00:00] [DEBUG] [timerecord/time_recorder.go:91] ["start reduce search result, msgID = 437563107645325317, fromSharedLeader = false, vChannel = by-dev-rootcoord-dml_50_437519009796387257v0, segmentIDs = [] (546ms)"] [traceID=5049206b8f3b480a]
[2022/11/23 02:33:10.837 +00:00] [DEBUG] [querynode/result.go:86] ["shard leader get valid search results"] [traceID=5049206b8f3b480a] [numbers=1]
[2022/11/23 02:33:10.837 +00:00] [DEBUG] [querynode/result.go:89] [reduceSearchResultData] [traceID=5049206b8f3b480a] ["result No."=0] [nq=1] [topk=100]
[2022/11/23 02:33:10.837 +00:00] [DEBUG] [querynode/result.go:181] ["skip duplicated search result"] [traceID=5049206b8f3b480a] [count=0]