Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: create index failed during rolling update from v2.4.1 to master-20240527-59a7a469-amd64 #33432

Closed
1 task done
zhuwenxing opened this issue May 28, 2024 · 9 comments
Closed
1 task done
Assignees
Labels
kind/bug Issues or changes related a bug priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now. severity/critical Critical, lead to crash, data missing, wrong result, function totally doesn't work. triage/accepted Indicates an issue or PR is ready to be actively worked on.
Milestone

Comments

@zhuwenxing
Copy link
Contributor

Is there an existing issue for this?

  • I have searched the existing issues

Environment

- Milvus version:v2.4.1 to master-20240527-59a7a469-amd64
- Deployment mode(standalone or cluster):
- MQ type(rocksmq, pulsar or kafka):    
- SDK version(e.g. pymilvus v2.0.0rc2):
- OS(Ubuntu or CentOS): 
- CPU/Memory: 
- GPU: 
- Others:

Current Behavior

[2024-05-27T17:39:27.490Z] [2024-05-27 17:39:09 - DEBUG - ci_test]: (api_request)  : [Collection.create_index] args: ['float_vector', {'index_type': 'HNSW', 'metric_type': 'L2', 'params': {'M': 48, 'efConstruction': 500}}], kwargs: {'timeout': 120, 'index_name': 'index__tMdNNws6'} (api_request.py:62)

[2024-05-27T17:39:27.491Z] [2024-05-27 17:39:09 - DEBUG - ci_test]: (api_request)  : [Collection.query] args: ['int64 in [2438, 2828, 1378, 1777, 2149]', None, None, 10], kwargs: {} (api_request.py:62)

[2024-05-27T17:39:27.491Z] [2024-05-27 17:39:09 - DEBUG - ci_test]: (api_request)  : [Collection.search] args: [[[0.011187511884171409, 0.12360798610392186, 0.1379405507627647, 0.1444159791051795, 0.10542451719537912, 0.0991570112596999, 0.11631667071011938, 0.04268881658156636, 0.0947983914349732, 0.06556588548956754, 0.03990394681195287, 0.007723955846719748, 0.1331858681071183, 0.05258877310283925, 0.0524......, kwargs: {} (api_request.py:62)

[2024-05-27T17:39:27.491Z] [2024-05-27 17:39:09 - DEBUG - ci_test]: (api_request)  : [Collection.delete] args: ['int64 in [1064]', None, 120], kwargs: {} (api_request.py:62)

[2024-05-27T17:39:27.491Z] [2024-05-27 17:39:09 - DEBUG - ci_test]: (api_response) : (insert count: 0, delete count: 1, upsert count: 0, timestamp: 0, success count: 0, err count: 0)  (api_request.py:37)

[2024-05-27T17:39:27.491Z] [2024-05-27 17:39:09 - DEBUG - ci_test]: insert request record cost 3.209337592124939e-06s (checker.py:236)

[2024-05-27T17:39:27.491Z] [2024-05-27 17:39:09 - DEBUG - ci_test]: [test][start time:2024-05-27 17:39:09.761719][time cost:0.00684969s][operation_name:delete][collection name:DeleteChecker__4F5lqP6d] -> True (checker.py:239)

[2024-05-27T17:39:27.491Z] [2024-05-27 17:39:10 - ERROR - pymilvus.decorators]: RPC error: [create_index], <MilvusException: (code=1, message=450056524265175109: The specified key does not exist.: key not found[key=files/insert_log/450056524265175090/450056524265175091/450056524265175109/0/450056524264974993];)>, <Time:{'RPC start': '2024-05-27 17:39:09.314790', 'RPC error': '2024-05-27 17:39:10.024067'}> (decorators.py:126)

[2024-05-27T17:39:27.491Z] [2024-05-27 17:39:10 - DEBUG - ci_test]: (api_request)  : [FieldSchema] args: ['int64', <DataType.INT64: 5>, ''], kwargs: {'is_primary': False} (api_request.py:62)

Expected Behavior

no down time

Steps To Reproduce

No response

Milvus Log

failed job: https://qa-jenkins.milvus.io/blue/organizations/jenkins/rolling_update_for_operator_test_simple/detail/rolling_update_for_operator_test_simple/3521/pipeline

log:
artifacts-kafka-mixcoord-3521-server-logs.tar.gz

cluster: 4am
ns: chaos-testing
pod:

[2024-05-27T17:39:29.616Z] + kubectl get pods -o wide

[2024-05-27T17:39:29.617Z] + grep kafka-mixcoord-3521

[2024-05-27T17:39:29.872Z] kafka-mixcoord-3521-etcd-0                                       1/1     Running            0                 37m     10.104.27.107   4am-node31   <none>           <none>

[2024-05-27T17:39:29.872Z] kafka-mixcoord-3521-etcd-1                                       1/1     Running            0                 37m     10.104.23.50    4am-node27   <none>           <none>

[2024-05-27T17:39:29.872Z] kafka-mixcoord-3521-etcd-2                                       1/1     Running            0                 37m     10.104.25.170   4am-node30   <none>           <none>

[2024-05-27T17:39:29.872Z] kafka-mixcoord-3521-kafka-0                                      2/2     Running            0                 37m     10.104.26.110   4am-node32   <none>           <none>

[2024-05-27T17:39:29.872Z] kafka-mixcoord-3521-kafka-1                                      2/2     Running            0                 37m     10.104.23.52    4am-node27   <none>           <none>

[2024-05-27T17:39:29.872Z] kafka-mixcoord-3521-kafka-2                                      2/2     Running            0                 37m     10.104.33.222   4am-node36   <none>           <none>

[2024-05-27T17:39:29.872Z] kafka-mixcoord-3521-kafka-exporter-5fcdf4b8b-vrz8p               1/1     Running            3 (37m ago)       37m     10.104.9.15     4am-node14   <none>           <none>

[2024-05-27T17:39:29.873Z] kafka-mixcoord-3521-kafka-zookeeper-0                            1/1     Running            0                 37m     10.104.33.221   4am-node36   <none>           <none>

[2024-05-27T17:39:29.873Z] kafka-mixcoord-3521-kafka-zookeeper-1                            1/1     Running            0                 37m     10.104.26.111   4am-node32   <none>           <none>

[2024-05-27T17:39:29.873Z] kafka-mixcoord-3521-kafka-zookeeper-2                            1/1     Running            0                 37m     10.104.30.222   4am-node38   <none>           <none>

[2024-05-27T17:39:29.873Z] kafka-mixcoord-3521-milvus-datanode-7d8b6685fc-c8c5j             1/1     Running            0                 23m     10.104.20.166   4am-node22   <none>           <none>

[2024-05-27T17:39:29.873Z] kafka-mixcoord-3521-milvus-datanode-7d8b6685fc-rrdlh             1/1     Running            0                 22m     10.104.1.85     4am-node10   <none>           <none>

[2024-05-27T17:39:29.873Z] kafka-mixcoord-3521-milvus-datanode-7d8b6685fc-xmgq5             1/1     Running            0                 21m     10.104.15.215   4am-node20   <none>           <none>

[2024-05-27T17:39:29.873Z] kafka-mixcoord-3521-milvus-indexnode-b6447749f-6t52b             1/1     Running            0                 29m     10.104.15.212   4am-node20   <none>           <none>

[2024-05-27T17:39:29.873Z] kafka-mixcoord-3521-milvus-indexnode-b6447749f-hjn2s             1/1     Running            0                 28m     10.104.1.80     4am-node10   <none>           <none>

[2024-05-27T17:39:29.873Z] kafka-mixcoord-3521-milvus-indexnode-b6447749f-vs8p9             1/1     Running            0                 29m     10.104.21.82    4am-node24   <none>           <none>

[2024-05-27T17:39:29.873Z] kafka-mixcoord-3521-milvus-mixcoord-6b989f45cf-jtjdc             1/1     Running            0                 26m     10.104.20.157   4am-node22   <none>           <none>

[2024-05-27T17:39:29.873Z] kafka-mixcoord-3521-milvus-proxy-6d674bd597-k6xhh                1/1     Running            0                 21m     10.104.20.167   4am-node22   <none>           <none>

[2024-05-27T17:39:29.873Z] kafka-mixcoord-3521-milvus-querynode-1-66894f74f7-gxcj8          1/1     Running            0                 22m     10.104.1.86     4am-node10   <none>           <none>

[2024-05-27T17:39:29.873Z] kafka-mixcoord-3521-milvus-querynode-1-66894f74f7-mvxvp          1/1     Running            0                 24m     10.104.15.214   4am-node20   <none>           <none>

[2024-05-27T17:39:29.873Z] kafka-mixcoord-3521-milvus-querynode-1-66894f74f7-s8mgr          1/1     Running            0                 23m     10.104.20.162   4am-node22   <none>           <none>

[2024-05-27T17:39:29.873Z] kafka-mixcoord-3521-minio-0                                      1/1     Running            0                 37m     10.104.27.106   4am-node31   <none>           <none>

[2024-05-27T17:39:29.873Z] kafka-mixcoord-3521-minio-1                                      1/1     Running            0                 37m     10.104.26.109   4am-node32   <none>           <none>

[2024-05-27T17:39:29.873Z] kafka-mixcoord-3521-minio-2                                      1/1     Running            0                 37m     10.104.33.219   4am-node36   <none>           <none>

[2024-05-27T17:39:29.873Z] kafka-mixcoord-3521-minio-3                                      1/1     Running            0                 37m     10.104.30.220   4am-node38   <none>           <none>

Anything else?

No response

@zhuwenxing zhuwenxing added kind/bug Issues or changes related a bug needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one. labels May 28, 2024
@zhuwenxing
Copy link
Contributor Author

/assign @xiaocai2333
PTAL

@zhuwenxing zhuwenxing added priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now. severity/critical Critical, lead to crash, data missing, wrong result, function totally doesn't work. labels May 28, 2024
@zhuwenxing zhuwenxing added this to the 2.5.0 milestone May 28, 2024
@zhuwenxing
Copy link
Contributor Author

a stable reproduced issue

@xiaocai2333
Copy link
Contributor

according to the log:

[2024-05-27T17:39:27.491Z] [2024-05-27 17:39:10 - ERROR - pymilvus.decorators]: RPC error: [create_index], <MilvusException: (code=1, message=450056524265175109: The specified key does not exist.: key not found[key=files/insert_log/450056524265175090/450056524265175091/450056524265175109/0/450056524264974993];)>, <Time:{'RPC start': '2024-05-27 17:39:09.314790', 'RPC error': '2024-05-27 17:39:10.024067'}> (decorators.py:126)

the fieldID is 0, it caused by #33184. I will fix it.

@yanliang567 yanliang567 added triage/accepted Indicates an issue or PR is ready to be actively worked on. and removed needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one. labels May 30, 2024
@yanliang567 yanliang567 removed their assignment May 30, 2024
sre-ci-robot pushed a commit that referenced this issue Jun 5, 2024
issue: #33432 , #33183

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
@xiaocai2333
Copy link
Contributor

this has been fixed, please verify.
/assign @zhuwenxing

@zhuwenxing
Copy link
Contributor Author

from v2.4.1 to master-20240612-9d4535ce-amd64
there will be no such error message during index.
however, the index will be timeout

[2024-06-12T17:58:08.682Z] ------------- generated html file: file:///tmp/ci_logs/report.html -------------

[2024-06-12T17:58:08.682Z] =========================== short test summary info ============================

[2024-06-12T17:58:08.682Z] FAILED testcases/test_single_request_operation_for_rolling_update.py::TestOperations::test_operations - pytest_assume.plugin.FailedAssumption: 

[2024-06-12T17:58:08.682Z] 1 Failed Assumptions:

[2024-06-12T17:58:08.682Z] 

[2024-06-12T17:58:08.682Z] testcases/test_single_request_operation_for_rolling_update.py:152: AssumptionFailure

[2024-06-12T17:58:08.682Z] >>	pytest.assume(rto <= 0,  f"{k} rto expect 0s but get {rto}s")  # rto should be less than 0s

[2024-06-12T17:58:08.682Z] AssertionError: Op.index rto expect 0s but get 121.25310587882996s

[2024-06-12T17:58:08.683Z] assert False

[2024-06-12T17:58:08.683Z] ================== 1 failed, 1 warning in 2042.74s (0:34:02) ===================

script returned exit code 1

image

[2024-06-12T17:16:31.528Z] [2024-06-12 17:16:26 - WARNING - pymilvus.decorators]: �[93mRetry timeout: 120s�[0m (decorators.py:94)
[2024-06-12T17:16:31.529Z] [2024-06-12 17:16:26 - ERROR - pymilvus.decorators]: RPC error: [wait_for_creating_index], <MilvusException: (code=1, message=Retry timeout: 120s, message=collection IndexChecker__sbEXWaY0 create index index__pmXwBX6n timeout in 120s)>, <Time:{'RPC start': '2024-06-12 17:14:26.408496', 'RPC error': '2024-06-12 17:16:26.850788'}> (decorators.py:126)
[2024-06-12T17:16:31.529Z] [2024-06-12 17:16:26 - WARNING - pymilvus.decorators]: �[93mRetry timeout: 120s�[0m (decorators.py:94)
[2024-06-12T17:16:31.529Z] [2024-06-12 17:16:26 - ERROR - pymilvus.decorators]: RPC error: [create_index], <MilvusException: (code=1, message=Retry timeout: 120s, message=Retry timeout: 120s, message=collection IndexChecker__sbEXWaY0 create index index__pmXwBX6n timeout in 120s)>, <Time:{'RPC start': '2024-06-12 17:14:26.385037', 'RPC error': '2024-06-12 17:16:26.850951'}> (decorators.py:126)
[2024-06-12T17:18:22.904Z] [2024-06-12 17:18:21 - INFO - ci_test]: CreateChecker, succ_rate: 1.00, total: 499, average_time: 0.0564, max_time: 0.4410, min_time: 0.0251 (checker.py:339)

failed job:
https://qa-jenkins.milvus.io/blue/organizations/jenkins/rolling_update_for_operator_test_simple/detail/rolling_update_for_operator_test_simple/3715/pipeline

log:
artifacts-kafka-mixcoord-3715-server-logs.tar.gz

cluster: 4am
namespace: chaos-testing
pod info


[2024-06-12T17:58:20.158Z] + kubectl get pods -o wide

[2024-06-12T17:58:20.159Z] + grep kafka-mixcoord-3715

[2024-06-12T17:58:20.416Z] kafka-mixcoord-3715-etcd-0                                       1/1     Running            0                  38m     10.104.18.251   4am-node25   <none>           <none>

[2024-06-12T17:58:20.416Z] kafka-mixcoord-3715-etcd-1                                       1/1     Running            0                  38m     10.104.24.236   4am-node29   <none>           <none>

[2024-06-12T17:58:20.416Z] kafka-mixcoord-3715-etcd-2                                       1/1     Running            0                  38m     10.104.21.131   4am-node24   <none>           <none>

[2024-06-12T17:58:20.416Z] kafka-mixcoord-3715-kafka-0                                      2/2     Running            0                  38m     10.104.19.199   4am-node28   <none>           <none>

[2024-06-12T17:58:20.416Z] kafka-mixcoord-3715-kafka-1                                      2/2     Running            0                  38m     10.104.24.238   4am-node29   <none>           <none>

[2024-06-12T17:58:20.416Z] kafka-mixcoord-3715-kafka-2                                      2/2     Running            0                  38m     10.104.32.231   4am-node39   <none>           <none>

[2024-06-12T17:58:20.416Z] kafka-mixcoord-3715-kafka-exporter-6b669f54fb-fcgqr              1/1     Running            4 (38m ago)        38m     10.104.5.176    4am-node12   <none>           <none>

[2024-06-12T17:58:20.416Z] kafka-mixcoord-3715-kafka-zookeeper-0                            1/1     Running            0                  38m     10.104.24.237   4am-node29   <none>           <none>

[2024-06-12T17:58:20.416Z] kafka-mixcoord-3715-kafka-zookeeper-1                            1/1     Running            0                  38m     10.104.32.230   4am-node39   <none>           <none>

[2024-06-12T17:58:20.416Z] kafka-mixcoord-3715-kafka-zookeeper-2                            1/1     Running            0                  38m     10.104.20.136   4am-node22   <none>           <none>

[2024-06-12T17:58:20.416Z] kafka-mixcoord-3715-milvus-datanode-6b69967465-gr6b2             1/1     Running            0                  22m     10.104.19.250   4am-node28   <none>           <none>

[2024-06-12T17:58:20.416Z] kafka-mixcoord-3715-milvus-datanode-6b69967465-sjg95             1/1     Running            0                  22m     10.104.27.44    4am-node31   <none>           <none>

[2024-06-12T17:58:20.416Z] kafka-mixcoord-3715-milvus-datanode-6b69967465-xnddg             1/1     Running            0                  21m     10.104.17.108   4am-node23   <none>           <none>

[2024-06-12T17:58:20.416Z] kafka-mixcoord-3715-milvus-indexnode-67ffb58c57-825vp            1/1     Running            0                  28m     10.104.13.140   4am-node16   <none>           <none>

[2024-06-12T17:58:20.416Z] kafka-mixcoord-3715-milvus-indexnode-67ffb58c57-86bsr            1/1     Running            0                  30m     10.104.26.217   4am-node32   <none>           <none>

[2024-06-12T17:58:20.416Z] kafka-mixcoord-3715-milvus-indexnode-67ffb58c57-vqpzg            1/1     Running            0                  29m     10.104.21.139   4am-node24   <none>           <none>

[2024-06-12T17:58:20.416Z] kafka-mixcoord-3715-milvus-mixcoord-8787599f-56q4m               1/1     Running            0                  25m     10.104.33.90    4am-node36   <none>           <none>

[2024-06-12T17:58:20.416Z] kafka-mixcoord-3715-milvus-proxy-7bd54b877c-7t8vf                1/1     Running            0                  21m     10.104.17.107   4am-node23   <none>           <none>

[2024-06-12T17:58:20.416Z] kafka-mixcoord-3715-milvus-querynode-1-6bbffbd5d9-l5qnz          1/1     Running            0                  23m     10.104.27.43    4am-node31   <none>           <none>

[2024-06-12T17:58:20.416Z] kafka-mixcoord-3715-milvus-querynode-1-6bbffbd5d9-qd9gj          1/1     Running            0                  21m     10.104.13.151   4am-node16   <none>           <none>

[2024-06-12T17:58:20.416Z] kafka-mixcoord-3715-milvus-querynode-1-6bbffbd5d9-vdjlc          1/1     Running            0                  24m     10.104.1.252    4am-node10   <none>           <none>

[2024-06-12T17:58:20.416Z] kafka-mixcoord-3715-minio-0                                      1/1     Running            0                  38m     10.104.23.251   4am-node27   <none>           <none>

[2024-06-12T17:58:20.416Z] kafka-mixcoord-3715-minio-1                                      1/1     Running            0                  38m     10.104.32.227   4am-node39   <none>           <none>

[2024-06-12T17:58:20.416Z] kafka-mixcoord-3715-minio-2                                      1/1     Running            0                  38m     10.104.26.200   4am-node32   <none>           <none>

[2024-06-12T17:58:20.416Z] kafka-mixcoord-3715-minio-3                                      1/1     Running            0                  38m     10.104.21.132

@xiaocai2333
Copy link
Contributor

[indexnode/task_index.go:482] ["failed to build index"] [clusterID=kafka-mixcoord-3715] [buildID=450419191604010228] [collection=450419191603804434] [segmentID=450419191603804486] [currentIndexVersion=3] [error="failed to create index, C Runtime Exception: invalid type is invalid data type: 0\n: segcore error[segcoreCode=2007]"] [errorVerbose="failed to create index, C Runtime Exception: invalid type is invalid data type: 0: segcore error[segcoreCode=2007]\n(1) attached stack trace\n  -- stack trace:\n  | github.com/milvus-io/milvus/pkg/util/merr.WrapErrSegcore\n  | \t/go/src/github.com/milvus-io/milvus/pkg/util/merr/utils.go:940\n  | github.com/milvus-io/milvus/internal/util/indexcgowrapper.HandleCStatus\n  | \t/go/src/github.com/milvus-io/milvus/internal/util/indexcgowrapper/helper.go:78\n  | github.com/milvus-io/milvus/internal/util/indexcgowrapper.CreateIndex\n  | \t/go/src/github.com/milvus-io/milvus/internal/util/indexcgowrapper/index.go:109\n  | github.com/milvus-io/milvus/internal/indexnode.(*indexBuildTask).Execute\n  | \t/go/src/github.com/milvus-io/milvus/internal/indexnode/task_index.go:477\n  | github.com/milvus-io/milvus/internal/indexnode.(*TaskScheduler).processTask.func1\n  | \t/go/src/github.com/milvus-io/milvus/internal/indexnode/task_scheduler.go:222\n  | github.com/milvus-io/milvus/internal/indexnode.(*TaskScheduler).processTask\n  | \t/go/src/github.com/milvus-io/milvus/internal/indexnode/task_scheduler.go:235\n  | github.com/milvus-io/milvus/internal/indexnode.(*TaskScheduler).indexBuildLoop.func1\n  | \t/go/src/github.com/milvus-io/milvus/internal/indexnode/task_scheduler.go:262\n  | runtime.goexit\n  | \t/usr/local/go/src/runtime/asm_amd64.s:1650\nWraps: (2) failed to create index, C Runtime Exception: invalid type is invalid data type: 0\nWraps: (3) segcore error[segcoreCode=2007]\nError types: (1) *withstack.withStack (2) *errutil.withPrefix (3) merr.milvusError"]

@xiaocai2333
Copy link
Contributor

fallback field type failed.

@xiaocai2333
Copy link
Contributor

[2024-06-12T17:32:49.386Z] [2024-06-12 17:32:36 - WARNING - pymilvus.decorators]: �[93mRetry timeout: 120s�[0m (decorators.py:94)
[2024-06-12T17:32:49.388Z] [2024-06-12 17:32:36 - ERROR - pymilvus.decorators]: RPC error: [wait_for_creating_index], <MilvusException: (code=1, message=Retry timeout: 120s, message=collection IndexChecker__SK9gT7W3 create index index__jouGo29H timeout in 120s)>, <Time:{'RPC start': '2024-06-12 17:30:36.009675', 'RPC error': '2024-06-12 17:32:36.239436'}> (decorators.py:126)
[2024-06-12T17:32:49.388Z] [2024-06-12 17:32:36 - WARNING - pymilvus.decorators]: �[93mRetry timeout: 120s�[0m (decorators.py:94)
[2024-06-12T17:32:49.388Z] [2024-06-12 17:32:36 - ERROR - pymilvus.decorators]: RPC error: [create_index], <MilvusException: (code=1, message=Retry timeout: 120s, message=Retry timeout: 120s, message=collection IndexChecker__SK9gT7W3 create index index__jouGo29H timeout in 120s)>, <Time:{'RPC start': '2024-06-12 17:30:35.988672', 'RPC error': '2024-06-12 17:32:36.239757'}> (decorators.py:126)
[2024-06-12T17:33:45.736Z] [2024-06-12 17:33:43 - INFO - ci_test]: CreateChecker, succ_rate: 1.00, total: 487, average_time: 0.0834, max_time: 0.6019, min_time: 0.0183 (checker.py:339)

and the error message pasted was wrong.

sre-ci-robot pushed a commit that referenced this issue Jun 14, 2024
issue: #33432

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
@xiaocai2333
Copy link
Contributor

fixed, please verify again. @zhuwenxing
/assign @zhuwenxing

xiaocai2333 added a commit to xiaocai2333/milvus that referenced this issue Jun 25, 2024
issue: milvus-io#33432

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
sre-ci-robot pushed a commit that referenced this issue Jun 25, 2024
…4133)

issue: #33432
pr: #33832

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
xiaocai2333 added a commit to xiaocai2333/milvus that referenced this issue Jul 1, 2024
xiaocai2333 added a commit to xiaocai2333/milvus that referenced this issue Jul 1, 2024
issue: milvus-io#33432

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
xiaocai2333 added a commit to xiaocai2333/milvus that referenced this issue Jul 1, 2024
xiaocai2333 added a commit to xiaocai2333/milvus that referenced this issue Jul 1, 2024
issue: milvus-io#33432

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
yellow-shine pushed a commit to yellow-shine/milvus that referenced this issue Jul 2, 2024
yellow-shine pushed a commit to yellow-shine/milvus that referenced this issue Jul 2, 2024
issue: milvus-io#33432

Signed-off-by: Cai Zhang <cai.zhang@zilliz.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/bug Issues or changes related a bug priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now. severity/critical Critical, lead to crash, data missing, wrong result, function totally doesn't work. triage/accepted Indicates an issue or PR is ready to be actively worked on.
Projects
None yet
Development

No branches or pull requests

3 participants