Support f16 & bf16 #287
Merged
Support f16 & bf16 #287
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Signed-off-by: ryjiang <jiangruiyi@gmail.com>
Signed-off-by: ryjiang <jiangruiyi@gmail.com>
Signed-off-by: ryjiang <jiangruiyi@gmail.com>
Signed-off-by: ryjiang <jiangruiyi@gmail.com>
Signed-off-by: ryjiang <jiangruiyi@gmail.com>
Signed-off-by: ryjiang <jiangruiyi@gmail.com>
Signed-off-by: ryjiang <jiangruiyi@gmail.com>
Signed-off-by: ryjiang <jiangruiyi@gmail.com>
|
[APPROVALNOTIFIER] This PR is NOT APPROVED This pull-request has been approved by: shanghaikid The full list of commands accepted by this bot can be found here.
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## 2.4 #287 +/- ##
==========================================
+ Coverage 96.89% 96.99% +0.10%
==========================================
Files 36 36
Lines 2060 2099 +39
Branches 549 560 +11
==========================================
+ Hits 1996 2036 +40
+ Misses 56 54 -2
- Partials 8 9 +1 ☔ View full report in Codecov by Sentry. |
shanghaikid
added a commit
that referenced
this pull request
Apr 18, 2024
* init 2.4 Signed-off-by: ryjiang <jiangruiyi@gmail.com> * sync 2.4 proto Signed-off-by: ryjiang <jiangruiyi@gmail.com> * update CI Signed-off-by: ryjiang <jiangruiyi@gmail.com> * add 2.4 index (#272) * add INVERTED index Signed-off-by: ryjiang <jiangruiyi@gmail.com> * add GPU_BRUTE_FORCE and GPU_CAGRA Signed-off-by: ryjiang <jiangruiyi@gmail.com> * fix index test Signed-off-by: ryjiang <jiangruiyi@gmail.com> --------- Signed-off-by: ryjiang <jiangruiyi@gmail.com> * support search group by (#273) * support group by Signed-off-by: ryjiang <jiangruiyi@gmail.com> * remove console Signed-off-by: ryjiang <jiangruiyi@gmail.com> --------- Signed-off-by: ryjiang <jiangruiyi@gmail.com> * update 2.4 version Signed-off-by: ryjiang <jiangruiyi@gmail.com> * support mmap (#275) * support mmap Signed-off-by: ryjiang <jiangruiyi@gmail.com> * comment out test for now Signed-off-by: ryjiang <jiangruiyi@gmail.com> --------- Signed-off-by: ryjiang <jiangruiyi@gmail.com> * update proto Signed-off-by: ryjiang <jiangruiyi@gmail.com> * support search with multiple vectors (#278) * update genCollectionParams to support multiple vectors field Signed-off-by: ryjiang <jiangruiyi@gmail.com> * add test for generateInsertData about multiple vectors Signed-off-by: ryjiang <jiangruiyi@gmail.com> * add compatible test for mutliple vectors Signed-off-by: ryjiang <jiangruiyi@gmail.com> * update proto Signed-off-by: ruiyi.jiang <ruiyi.jiang@zilliz.com> * optimize search() Signed-off-by: ruiyi.jiang <ruiyi.jiang@zilliz.com> * part Signed-off-by: ruiyi.jiang <ruiyi.jiang@zilliz.com> * move buildSearchParams and formatSearchResult to utils Signed-off-by: ryjiang <jiangruiyi@gmail.com> * refactor Signed-off-by: ryjiang <jiangruiyi@gmail.com> * fix test Signed-off-by: ryjiang <jiangruiyi@gmail.com> * refactor part2 Signed-off-by: ryjiang <jiangruiyi@gmail.com> * improve code Signed-off-by: ryjiang <jiangruiyi@gmail.com> * refactor part3 Signed-off-by: ryjiang <jiangruiyi@gmail.com> * update part5 Signed-off-by: ryjiang <jiangruiyi@gmail.com> * prefinish multivsearch Signed-off-by: ryjiang <jiangruiyi@gmail.com> * add comments Signed-off-by: ryjiang <jiangruiyi@gmail.com> * update test Signed-off-by: ryjiang <jiangruiyi@gmail.com> * fix comments Signed-off-by: ryjiang <jiangruiyi@gmail.com> * fix test Signed-off-by: ryjiang <jiangruiyi@gmail.com> * fix build Signed-off-by: ryjiang <jiangruiyi@gmail.com> --------- Signed-off-by: ryjiang <jiangruiyi@gmail.com> Signed-off-by: ruiyi.jiang <ruiyi.jiang@zilliz.com> * sync 2.4 proto Signed-off-by: ruiyi.jiang <ruiyi.jiang@zilliz.com> * Add sparse vector support (#285) * add test data and const Signed-off-by: ruiyi.jiang <ruiyi.jiang@zilliz.com> * add sparse data generator Signed-off-by: ruiyi.jiang <ruiyi.jiang@zilliz.com> * fix create collection Signed-off-by: ruiyi.jiang <ruiyi.jiang@zilliz.com> * stash Signed-off-by: ruiyi.jiang <ruiyi.jiang@zilliz.com> * remove duplicate data sent to the sever Signed-off-by: ryjiang <jiangruiyi@gmail.com> * refactor data part1 Signed-off-by: ryjiang <jiangruiyi@gmail.com> * finish insert Signed-off-by: ryjiang <jiangruiyi@gmail.com> * add query Signed-off-by: ryjiang <jiangruiyi@gmail.com> * finish sparse vector Signed-off-by: ryjiang <jiangruiyi@gmail.com> * fix alter collection should run before load Signed-off-by: ryjiang <jiangruiyi@gmail.com> * fix http Signed-off-by: ryjiang <jiangruiyi@gmail.com> * update test milvus verison Signed-off-by: ryjiang <jiangruiyi@gmail.com> * fix test Signed-off-by: ryjiang <jiangruiyi@gmail.com> * add http test Signed-off-by: ryjiang <jiangruiyi@gmail.com> --------- Signed-off-by: ruiyi.jiang <ruiyi.jiang@zilliz.com> Signed-off-by: ryjiang <jiangruiyi@gmail.com> * fix alterIndex Signed-off-by: ryjiang <jiangruiyi@gmail.com> * Support f16 & bf16 (#287) * add f16 insert Signed-off-by: ryjiang <jiangruiyi@gmail.com> * fp16 part2 Signed-off-by: ryjiang <jiangruiyi@gmail.com> * stash Signed-off-by: ryjiang <jiangruiyi@gmail.com> * f16 part3 Signed-off-by: ryjiang <jiangruiyi@gmail.com> * finish query Signed-off-by: ryjiang <jiangruiyi@gmail.com> * finish f16 Signed-off-by: ryjiang <jiangruiyi@gmail.com> * fix type errors Signed-off-by: ryjiang <jiangruiyi@gmail.com> * update parseFloat16VectorToBytes function Signed-off-by: ryjiang <jiangruiyi@gmail.com> * add bf16 support Signed-off-by: ryjiang <jiangruiyi@gmail.com> * update types Signed-off-by: ryjiang <jiangruiyi@gmail.com> * fix test Signed-off-by: ryjiang <jiangruiyi@gmail.com> * add test Signed-off-by: ryjiang <jiangruiyi@gmail.com> --------- Signed-off-by: ryjiang <jiangruiyi@gmail.com> * Support more types of sparse vectors (#293) * generate different types of sparse vector Signed-off-by: ryjiang <jiangruiyi@gmail.com> * fix sparse array in js Signed-off-by: ryjiang <jiangruiyi@gmail.com> * add sparse array test Signed-off-by: ryjiang <jiangruiyi@gmail.com> * add csr sparse vector test Signed-off-by: ryjiang <jiangruiyi@gmail.com> * add coo support Signed-off-by: ryjiang <jiangruiyi@gmail.com> * remove unused import Signed-off-by: ryjiang <jiangruiyi@gmail.com> * refine comments Signed-off-by: ryjiang <jiangruiyi@gmail.com> * refine comment Signed-off-by: ryjiang <jiangruiyi@gmail.com> --------- Signed-off-by: ryjiang <jiangruiyi@gmail.com> * Sparse test update (#296) * update sparse test case Signed-off-by: ryjiang <jiangruiyi@gmail.com> * log level Signed-off-by: ryjiang <jiangruiyi@gmail.com> --------- Signed-off-by: ryjiang <jiangruiyi@gmail.com> * rename sparsevector test Signed-off-by: ryjiang <jiangruiyi@gmail.com> * Add nq > 1 tests for sparse vectors and upgrade protos (#297) * add more test Signed-off-by: ryjiang <jiangruiyi@gmail.com> * add nq > 1 tests for sparse vectors Signed-off-by: ryjiang <jiangruiyi@gmail.com> * update test version Signed-off-by: ryjiang <jiangruiyi@gmail.com> --------- Signed-off-by: ryjiang <jiangruiyi@gmail.com> * add nq>1 tests for hybridSearch (#298) Signed-off-by: ryjiang <jiangruiyi@gmail.com> * Fix single search failed on mutliple vectors collection if the anns field is specified. (#300) * add more tests Signed-off-by: ryjiang <jiangruiyi@gmail.com> * Fix multiple test Signed-off-by: ryjiang <jiangruiyi@gmail.com> --------- Signed-off-by: ryjiang <jiangruiyi@gmail.com> * update README.md Signed-off-by: ryjiang <jiangruiyi@gmail.com> * add more tests for client contstructor (#301) Signed-off-by: ryjiang <jiangruiyi@gmail.com> * Add bfloat16 support (#302) * add test for bf16 Signed-off-by: ryjiang <jiangruiyi@gmail.com> * add bf16 support Signed-off-by: ryjiang <jiangruiyi@gmail.com> --------- Signed-off-by: ryjiang <jiangruiyi@gmail.com> * add transformers (#303) Signed-off-by: ryjiang <jiangruiyi@gmail.com> * rename types Signed-off-by: ryjiang <jiangruiyi@gmail.com> * update readme (#304) Signed-off-by: ryjiang <jiangruiyi@gmail.com> * Fix search transformers Signed-off-by: ryjiang <jiangruiyi@gmail.com> * Revert "Fix search transformers" This reverts commit 2a14e0e. * make transformer optional (#305) * make transform optional Signed-off-by: shanghaikid <jiangruiyi@gmail.com> * update readme Signed-off-by: shanghaikid <jiangruiyi@gmail.com> * fix http test Signed-off-by: shanghaikid <jiangruiyi@gmail.com> * fix format test Signed-off-by: shanghaikid <jiangruiyi@gmail.com> * fix sparse array test Signed-off-by: ryjiang <jiangruiyi@gmail.com> --------- Signed-off-by: shanghaikid <jiangruiyi@gmail.com> Signed-off-by: ryjiang <jiangruiyi@gmail.com> * feat: milvus api v2 (#295) Signed-off-by: Shuyou <shuyou.zhan@zilliz.com> * bump version Signed-off-by: ryjiang <jiangruiyi@gmail.com> * fix build Signed-off-by: ryjiang <jiangruiyi@gmail.com> --------- Signed-off-by: ryjiang <jiangruiyi@gmail.com> Signed-off-by: ruiyi.jiang <ruiyi.jiang@zilliz.com> Signed-off-by: shanghaikid <jiangruiyi@gmail.com> Signed-off-by: Shuyou <shuyou.zhan@zilliz.com> Co-authored-by: Shuyoou <shuyou.zhan@zilliz.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.