You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Please state your issue using the following template and, most importantly, in English.
Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. E.g. I wish I could use Milvus to do [...]
Describe the solution you'd like
Support query vector field
The text was updated successfully, but these errors were encountered:
Anyway we can hidden IO by an interface?
for instance, we need a block cache, manage a chunk of of data, and do auto load when data is not in memory.
User can limit memory consumption by specify max memory watermark. And we run eviction based on query frequency.
Before we discuss start to implement read on Minio, few things may want to be documented and discussed.
How we can change data into chunk or block style? what's granularity of a block or chunk, any meta necessary to accelerate chunk query? (How we prune and index each block)
what API is necessary to query from Minio? We should not read the entire file from Minio/S3, but use the range tag to specify a range in this file, examples in Minio:
try (InputStream stream = minioClient.getObject(
GetObjectArgs.builder()
.bucket("my-bucketname")
.object("my-objectname")
.offset(1024L)
.length(4096L)
.build())) {
// Read data from stream
}
Further more, we need more discussion on how we boost the performance once we implement IO on object storage?
SSD Caching is one choice already in the plan.
Third thing is importing another another kv store, be sure our currently solution is compatible with the kv index. Kv store would be a optional part in milvus to boost delete/get performance and do primary key dedup
Please state your issue using the following template and, most importantly, in English.
Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. E.g. I wish I could use Milvus to do [...]
Describe the solution you'd like
Support query vector field
The text was updated successfully, but these errors were encountered: