Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support Milvus v2.4 #306

Merged
merged 41 commits into from
Apr 18, 2024
Merged

Support Milvus v2.4 #306

merged 41 commits into from
Apr 18, 2024

Commits on Jan 10, 2024

  1. init 2.4

    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    shanghaikid committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    7c9f443 View commit details
    Browse the repository at this point in the history
  2. sync 2.4 proto

    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    shanghaikid committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    020d5fa View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    327beca View commit details
    Browse the repository at this point in the history
  4. update CI

    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    shanghaikid committed Jan 10, 2024
    Configuration menu
    Copy the full SHA
    f2c866c View commit details
    Browse the repository at this point in the history

Commits on Jan 30, 2024

  1. add 2.4 index (#272)

    * add INVERTED index
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * add GPU_BRUTE_FORCE and GPU_CAGRA
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * fix index test
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    ---------
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    shanghaikid authored Jan 30, 2024
    Configuration menu
    Copy the full SHA
    26acea8 View commit details
    Browse the repository at this point in the history
  2. support search group by (#273)

    * support group by
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * remove  console
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    ---------
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    shanghaikid authored Jan 30, 2024
    Configuration menu
    Copy the full SHA
    34670d1 View commit details
    Browse the repository at this point in the history
  3. Merge branch 'main' into 2.4

    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    shanghaikid committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    ced8768 View commit details
    Browse the repository at this point in the history
  4. Configuration menu
    Copy the full SHA
    bb753b6 View commit details
    Browse the repository at this point in the history
  5. update 2.4 version

    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    shanghaikid committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    a3cd0ad View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    20c488d View commit details
    Browse the repository at this point in the history
  7. Merge branch 'main' into 2.4

    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    shanghaikid committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    fec7cba View commit details
    Browse the repository at this point in the history

Commits on Jan 31, 2024

  1. support mmap (#275)

    * support mmap
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * comment out test for now
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    ---------
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    shanghaikid authored Jan 31, 2024
    Configuration menu
    Copy the full SHA
    7223a1e View commit details
    Browse the repository at this point in the history
  2. update proto

    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    shanghaikid committed Jan 31, 2024
    Configuration menu
    Copy the full SHA
    ad82ec3 View commit details
    Browse the repository at this point in the history

Commits on Feb 20, 2024

  1. Configuration menu
    Copy the full SHA
    0e1c8ca View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    b5a11ab View commit details
    Browse the repository at this point in the history

Commits on Mar 6, 2024

  1. Configuration menu
    Copy the full SHA
    b41a323 View commit details
    Browse the repository at this point in the history

Commits on Mar 18, 2024

  1. support search with multiple vectors (#278)

    * update genCollectionParams to support multiple vectors field
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * add test for generateInsertData about multiple vectors
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * add compatible test for mutliple vectors
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * update proto
    
    Signed-off-by: ruiyi.jiang <ruiyi.jiang@zilliz.com>
    
    * optimize search()
    
    Signed-off-by: ruiyi.jiang <ruiyi.jiang@zilliz.com>
    
    * part
    
    Signed-off-by: ruiyi.jiang <ruiyi.jiang@zilliz.com>
    
    * move buildSearchParams and formatSearchResult to utils
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * refactor
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * fix test
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * refactor part2
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * improve code
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * refactor part3
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * update part5
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * prefinish multivsearch
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * add comments
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * update test
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * fix comments
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * fix test
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * fix build
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    ---------
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    Signed-off-by: ruiyi.jiang <ruiyi.jiang@zilliz.com>
    shanghaikid authored Mar 18, 2024
    Configuration menu
    Copy the full SHA
    aa826d0 View commit details
    Browse the repository at this point in the history
  2. sync 2.4 proto

    Signed-off-by: ruiyi.jiang <ruiyi.jiang@zilliz.com>
    shanghaikid committed Mar 18, 2024
    Configuration menu
    Copy the full SHA
    fa71d07 View commit details
    Browse the repository at this point in the history

Commits on Mar 19, 2024

  1. Add sparse vector support (#285)

    * add test data and const
    
    Signed-off-by: ruiyi.jiang <ruiyi.jiang@zilliz.com>
    
    * add sparse data generator
    
    Signed-off-by: ruiyi.jiang <ruiyi.jiang@zilliz.com>
    
    * fix create collection
    
    Signed-off-by: ruiyi.jiang <ruiyi.jiang@zilliz.com>
    
    * stash
    
    Signed-off-by: ruiyi.jiang <ruiyi.jiang@zilliz.com>
    
    * remove duplicate data sent to the sever
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * refactor data part1
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * finish insert
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * add query
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * finish sparse vector
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * fix alter collection should run before load
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * fix http
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * update test milvus verison
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * fix test
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * add http test
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    ---------
    
    Signed-off-by: ruiyi.jiang <ruiyi.jiang@zilliz.com>
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    shanghaikid authored Mar 19, 2024
    Configuration menu
    Copy the full SHA
    ced4d74 View commit details
    Browse the repository at this point in the history

Commits on Mar 27, 2024

  1. fix alterIndex

    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    shanghaikid committed Mar 27, 2024
    Configuration menu
    Copy the full SHA
    e3d11d5 View commit details
    Browse the repository at this point in the history
  2. Support f16 & bf16 (#287)

    * add f16 insert
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * fp16 part2
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * stash
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * f16 part3
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * finish query
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * finish f16
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * fix type errors
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * update parseFloat16VectorToBytes function
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * add bf16 support
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * update types
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * fix test
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * add test
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    ---------
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    shanghaikid authored Mar 27, 2024
    Configuration menu
    Copy the full SHA
    b717176 View commit details
    Browse the repository at this point in the history

Commits on Mar 29, 2024

  1. Configuration menu
    Copy the full SHA
    5034a82 View commit details
    Browse the repository at this point in the history
  2. Support more types of sparse vectors (#293)

    * generate different types of sparse vector
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * fix sparse array in js
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * add sparse array test
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * add csr sparse vector test
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * add coo support
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * remove unused import
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * refine comments
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * refine comment
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    ---------
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    shanghaikid authored Mar 29, 2024
    Configuration menu
    Copy the full SHA
    611a550 View commit details
    Browse the repository at this point in the history

Commits on Apr 10, 2024

  1. Sparse test update (#296)

    * update sparse test case
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * log level
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    ---------
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    shanghaikid authored Apr 10, 2024
    Configuration menu
    Copy the full SHA
    3e34a4d View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2024

  1. rename sparsevector test

    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    shanghaikid committed Apr 11, 2024
    Configuration menu
    Copy the full SHA
    82e1358 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    60523c5 View commit details
    Browse the repository at this point in the history
  3. Add nq > 1 tests for sparse vectors and upgrade protos (#297)

    * add more test
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * add nq > 1 tests for sparse vectors
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * update test version
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    ---------
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    shanghaikid authored Apr 11, 2024
    Configuration menu
    Copy the full SHA
    1183230 View commit details
    Browse the repository at this point in the history
  4. add nq>1 tests for hybridSearch (#298)

    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    shanghaikid authored Apr 11, 2024
    Configuration menu
    Copy the full SHA
    c77c5cf View commit details
    Browse the repository at this point in the history

Commits on Apr 12, 2024

  1. Fix single search failed on mutliple vectors collection if the anns f…

    …ield is specified. (#300)
    
    * add more tests
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * Fix multiple test
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    ---------
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    shanghaikid authored Apr 12, 2024
    Configuration menu
    Copy the full SHA
    88fad2f View commit details
    Browse the repository at this point in the history

Commits on Apr 15, 2024

  1. update README.md

    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    shanghaikid committed Apr 15, 2024
    Configuration menu
    Copy the full SHA
    ef19189 View commit details
    Browse the repository at this point in the history
  2. add more tests for client contstructor (#301)

    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    shanghaikid authored Apr 15, 2024
    Configuration menu
    Copy the full SHA
    6349b76 View commit details
    Browse the repository at this point in the history

Commits on Apr 16, 2024

  1. Add bfloat16 support (#302)

    * add test for bf16
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    * add bf16 support
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    ---------
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    shanghaikid authored Apr 16, 2024
    Configuration menu
    Copy the full SHA
    e9fcf68 View commit details
    Browse the repository at this point in the history

Commits on Apr 17, 2024

  1. add transformers (#303)

    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    shanghaikid authored Apr 17, 2024
    Configuration menu
    Copy the full SHA
    1941c77 View commit details
    Browse the repository at this point in the history
  2. rename types

    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    shanghaikid committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    645331a View commit details
    Browse the repository at this point in the history
  3. update readme (#304)

    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    shanghaikid authored Apr 17, 2024
    Configuration menu
    Copy the full SHA
    c93660a View commit details
    Browse the repository at this point in the history
  4. Fix search transformers

    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    shanghaikid committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    2a14e0e View commit details
    Browse the repository at this point in the history
  5. Revert "Fix search transformers"

    This reverts commit 2a14e0e.
    shanghaikid committed Apr 17, 2024
    Configuration menu
    Copy the full SHA
    c453140 View commit details
    Browse the repository at this point in the history

Commits on Apr 18, 2024

  1. make transformer optional (#305)

    * make transform optional
    
    Signed-off-by: shanghaikid <jiangruiyi@gmail.com>
    
    * update readme
    
    Signed-off-by: shanghaikid <jiangruiyi@gmail.com>
    
    * fix http test
    
    Signed-off-by: shanghaikid <jiangruiyi@gmail.com>
    
    * fix format test
    
    Signed-off-by: shanghaikid <jiangruiyi@gmail.com>
    
    * fix sparse array test
    
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    
    ---------
    
    Signed-off-by: shanghaikid <jiangruiyi@gmail.com>
    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    shanghaikid authored Apr 18, 2024
    Configuration menu
    Copy the full SHA
    6ed6eaa View commit details
    Browse the repository at this point in the history
  2. feat: milvus api v2 (#295)

    Signed-off-by: Shuyou <shuyou.zhan@zilliz.com>
    zhanshuyou authored Apr 18, 2024
    Configuration menu
    Copy the full SHA
    272681a View commit details
    Browse the repository at this point in the history
  3. bump version

    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    shanghaikid committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    d6f7088 View commit details
    Browse the repository at this point in the history
  4. fix build

    Signed-off-by: ryjiang <jiangruiyi@gmail.com>
    shanghaikid committed Apr 18, 2024
    Configuration menu
    Copy the full SHA
    42cd88a View commit details
    Browse the repository at this point in the history