Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Vector Search #9032

Open
breezewish opened this issue May 11, 2024 · 0 comments
Open

Vector Search #9032

breezewish opened this issue May 11, 2024 · 0 comments
Labels
type/feature-request Categorizes issue or PR as related to a new feature.

Comments

@breezewish
Copy link
Member

breezewish commented May 11, 2024 •
edited
Loading

Enhancement

Support Vector Search.

TiDB tracking issue: pingcap/tidb#54245
@breezewish breezewish added the type/enhancement The issue or PR belongs to an enhancement. label May 11, 2024
@breezewish breezewish mentioned this issue May 11, 2024
Merged
12 tasks
@JaySon-Huang JaySon-Huang added type/feature-request Categorizes issue or PR as related to a new feature. and removed type/enhancement The issue or PR belongs to an enhancement. labels May 11, 2024
ti-chi-bot bot pushed a commit that referenced this issue May 11, 2024
@breezewish
metrics: Add Vector Search panel (#9033)
2378444 
ref #9032
@JaySon-Huang JaySon-Huang mentioned this issue May 16, 2024
Open
@breezewish breezewish mentioned this issue Jun 26, 2024
Open
This was referenced Jul 29, 2024
Merged
Merged
ti-chi-bot bot added a commit that referenced this issue Jul 31, 2024
@Lloyd-Pottiger @JaySon-Huang @ti-chi-bot
compute: Add Vector data type and functions (#9262)
0856586 
ref #9032

Signed-off-by: Lloyd-Pottiger <yan1579196623@gmail.com>

Co-authored-by: JaySon-Huang <tshent@qq.com>
Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
@JaySon-Huang JaySon-Huang mentioned this issue Aug 1, 2024
Merged
12 tasks
ti-chi-bot bot pushed a commit that referenced this issue Aug 1, 2024
@JaySon-Huang
coprocessor: Refactor encoding TiDBColumn (#9279)
57c542e 
ref #9032
ti-chi-bot bot added a commit that referenced this issue Aug 12, 2024
@Lloyd-Pottiger @JaySon-Huang @ti-chi-bot
storage: Support vector index and ANN hint (#9261)
32d911b 
ref #9032

Co-authored-by: JaySon-Huang <tshent@qq.com>
Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
@Lloyd-Pottiger Lloyd-Pottiger mentioned this issue Aug 12, 2024
Merged
12 tasks
@JaySon-Huang JaySon-Huang mentioned this issue Aug 21, 2024
Merged
12 tasks
ti-chi-bot bot pushed a commit that referenced this issue Aug 21, 2024
@JaySon-Huang @Lloyd-Pottiger
*: Vector Data types and Functions (#9341)
0d0463a 
ref #9032

*: Vector Data types and Functions

Support parsing vector data type written by TiDB
Support basic functions for vector data type: CastVectorAsText, VecDims, VecL1Distance, VecL2Distance, VecL2Norm, VecCosineDistance, VecNegativeInnerProduct

Signed-off-by: Lloyd-Pottiger <yan1579196623@gmail.com>

Co-authored-by: Lloyd-Pottiger <60744015+Lloyd-Pottiger@users.noreply.github.com>
Co-authored-by: JaySon-Huang <tshent@qq.com>
ti-chi-bot bot pushed a commit that referenced this issue Aug 26, 2024
@Lloyd-Pottiger @JaySon-Huang
storage: Use mmap to view vector index (#9313)
d6abc70 
ref #9032

storage: Use mmap to view vector index

Signed-off-by: Lloyd-Pottiger <yan1579196623@gmail.com>

Co-authored-by: JaySon-Huang <tshent@qq.com>
This was referenced Aug 26, 2024
Merged
Merged
ti-chi-bot bot pushed a commit that referenced this issue Aug 26, 2024
@Lloyd-Pottiger @breezewish
storage: Add vector search metrics (#9349)
3f15689 
ref #9032

storage: Add vector search metrics

Signed-off-by: Wish <breezewish@outlook.com>

Co-authored-by: Wenxuan <breezewish@outlook.com>
ti-chi-bot bot pushed a commit that referenced this issue Aug 26, 2024
@EricZequan @JaySon-Huang
libcommon: Provide RSS details metrics (#9218)
bfb8c5d 
ref #9032

Signed-off-by: “EricZequan” <zequany33@gmail.com>

Co-authored-by: JaySon <tshent@qq.com>
This was referenced Aug 26, 2024
Merged
Merged
Merged
Merged
ti-chi-bot bot pushed a commit that referenced this issue Aug 27, 2024
@Lloyd-Pottiger @breezewish @JaySon-Huang
storage: Add keyspace_id to DT system tables (#9371)
d113404 
ref #9032

Signed-off-by: Wish <breezewish@outlook.com>

Co-authored-by: Wenxuan <breezewish@outlook.com>
Co-authored-by: JaySon <tshent@qq.com>
ti-chi-bot bot added a commit that referenced this issue Aug 27, 2024
@Lloyd-Pottiger @breezewish
@JaySon-Huang @ti-chi-bot
storage: Fix TiFlash system tables cannot query in Keyspace Mode (#9370)
d94b18a 
ref #9032

Signed-off-by: Wish <breezewish@outlook.com>

Co-authored-by: Wenxuan <breezewish@outlook.com>
Co-authored-by: JaySon <tshent@qq.com>
Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
ti-chi-bot bot pushed a commit that referenced this issue Aug 27, 2024
@Lloyd-Pottiger
*: use SimSIMD for vectors (#9372)
5f08ae6 
ref #9032

*: use SimSIMD for vectors

Signed-off-by: Lloyd-Pottiger <yan1579196623@gmail.com>
@Lloyd-Pottiger Lloyd-Pottiger mentioned this issue Aug 28, 2024
Merged
12 tasks
ti-chi-bot bot pushed a commit that referenced this issue Aug 28, 2024
@Lloyd-Pottiger
storage: Add system.dt_local_indexes (#9379)
3e3f23c 
ref #9032

storage: Add system.dt_local_indexes

Signed-off-by: Lloyd-Pottiger <yan1579196623@gmail.com>
@Lloyd-Pottiger Lloyd-Pottiger mentioned this issue Aug 28, 2024
Merged
12 tasks
Lloyd-Pottiger added a commit that referenced this issue Aug 30, 2024
@Lloyd-Pottiger @breezewish @JaySon-Huang
DMFile: Support modify DMFile meta (#9365)
8d95a13 
ref #9032

DMFile: Support modify DMFile meta

---------

Signed-off-by: Wish <breezewish@outlook.com>
Signed-off-by: Lloyd-Pottiger <yan1579196623@gmail.com>
Co-authored-by: Wenxuan <breezewish@outlook.com>
Co-authored-by: JaySon <tshent@qq.com>
@JaySon-Huang JaySon-Huang mentioned this issue Sep 2, 2024
Merged
12 tasks
ti-chi-bot bot pushed a commit that referenced this issue Sep 2, 2024
@Lloyd-Pottiger @breezewish
storage: Force evict when downloading vector index files (#9391)
919b053 
ref #9032

storage: Force evict when downloading vector index files

Signed-off-by: Wish <breezewish@outlook.com>
Signed-off-by: Lloyd-Pottiger <yan1579196623@gmail.com>

Co-authored-by: Wenxuan <breezewish@outlook.com>
ti-chi-bot bot added a commit that referenced this issue Sep 4, 2024
@Lloyd-Pottiger @ti-chi-bot
storage: add local indexer scheduler (#9383)
4fac01c 
ref #9032

storage: add local indexer scheduler

Signed-off-by: Lloyd-Pottiger <yan1579196623@gmail.com>

Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
@Lloyd-Pottiger Lloyd-Pottiger mentioned this issue Sep 5, 2024
Merged
12 tasks
ti-chi-bot bot pushed a commit that referenced this issue Sep 19, 2024
@Lloyd-Pottiger
storage: Support adding vector index in background (#9411)
19cecc1 
ref #9032

storage: Support adding vector index in background

Signed-off-by: Lloyd-Pottiger <yan1579196623@gmail.com>
This was referenced Sep 20, 2024
Merged
Merged
ti-chi-bot bot pushed a commit that referenced this issue Sep 20, 2024
@Lloyd-Pottiger @breezewish
storage: Abort vector index building as soon as possible (#9443)
4df924b 
close #9032

storage: Abort vector index building as soon as possible

Signed-off-by: Wish <breezewish@outlook.com>
Signed-off-by: Lloyd-Pottiger <yan1579196623@gmail.com>

Co-authored-by: Wenxuan <breezewish@outlook.com>
Co-authored-by: Lloyd-Pottiger <60744015+Lloyd-Pottiger@users.noreply.github.com>
This was referenced Sep 20, 2024
Merged
Merged
ti-chi-bot bot pushed a commit that referenced this issue Sep 20, 2024
@Lloyd-Pottiger @JaySon-Huang
ddl: Support parsing VectorIndex defined in IndexInfo (#9448)
db17e31 
ref #9032

ddl: Support parsing VectorIndex defined in IndexInfo

Co-authored-by: JaySon <tshent@qq.com>
ti-chi-bot bot added a commit that referenced this issue Sep 20, 2024
@Lloyd-Pottiger @zimulala @ti-chi-bot
storage: support the HTTP API of sync table schema (#9449)
355ab8c 
ref #9032

storage: support the HTTP API of sync table schema

Signed-off-by: Lloyd-Pottiger <yan1579196623@gmail.com>

Co-authored-by: Lynn <zimu_xia@126.com>
Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
@Lloyd-Pottiger Lloyd-Pottiger mentioned this issue Sep 20, 2024
Merged
12 tasks
ti-chi-bot bot added a commit that referenced this issue Sep 21, 2024
@Lloyd-Pottiger @ti-chi-bot
storage: long term cache for integer-like PK column in memory (#9445)
5a41ce2 
ref #9032

storage: cache PK column in memory

Signed-off-by: Lloyd-Pottiger <yan1579196623@gmail.com>

Co-authored-by: ti-chi-bot[bot] <108142056+ti-chi-bot[bot]@users.noreply.github.com>
ti-chi-bot bot pushed a commit that referenced this issue Sep 25, 2024
@Lloyd-Pottiger @JaySon-Huang
*: support vector index and adding/dropping vector index when doing s…
1a781c7 
…yncTableSchema (#9451)

ref #9032

*: support vector index and adding/dropping vector index when doing syncTableSchema

Signed-off-by: Lloyd-Pottiger <yan1579196623@gmail.com>

Co-authored-by: JaySon <tshent@qq.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
type/feature-request Categorizes issue or PR as related to a new feature.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@breezewish @JaySon-Huang