Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request]: Supports tensor data type #1179

Open
1 task done
JinHai-CN opened this issue May 7, 2024 · 0 comments
Open
1 task done

[Feature Request]: Supports tensor data type #1179

JinHai-CN opened this issue May 7, 2024 · 0 comments
Assignees
Labels
feature request New feature or request

Comments

@JinHai-CN
Copy link
Contributor

JinHai-CN commented May 7, 2024

Is there an existing issue for the same feature request?

  • I have checked the existing issues.

Is your feature request related to a problem?

No response

Describe the feature you'd like

Tensor data type support enables infinity to support some more advanced search capabilities, which can better enable infinity to support Retrieval Augmented Generation systems.

Describe implementation you've considered

No response

@JinHai-CN JinHai-CN added the feature request New feature or request label May 7, 2024
@JinHai-CN JinHai-CN mentioned this issue May 7, 2024
33 tasks
JinHai-CN pushed a commit that referenced this issue May 14, 2024
### What problem does this PR solve?

Add initial support for tensor data type

Issue link:#1179

### Type of change

- [x] New Feature (non-breaking change which adds functionality)
- [x] Breaking Change (fix or feature that could cause existing
functionality not to work as expected)
- [x] Refactoring
- [x] Test cases
JinHai-CN pushed a commit that referenced this issue May 17, 2024
### What problem does this PR solve?

Add MatchTensorScan operator
Now only support exhaustive MaxSim top-n search

Change sql syntax:
SEARCH MATCH -> SEARCH MATCH TEXT    (fulltext topk search)
SEARCH KNN -> SEARCH MATCH VECTOR   (embedding knn search)

Add sql syntax:
SEARCH MATCH TENSOR (now only support exhaustive MaxSim topn search)

Issue link:#1179

### Type of change

- [x] New Feature (non-breaking change which adds functionality)
- [x] Breaking Change (fix or feature that could cause existing
functionality not to work as expected)
- [x] Refactoring
- [x] Test cases
JinHai-CN pushed a commit that referenced this issue May 23, 2024
### What problem does this PR solve?

Support storage of TensorArray data type

Issue link:#1179

### Type of change

- [x] New Feature (non-breaking change which adds functionality)
- [x] Breaking Change (fix or feature that could cause existing
functionality not to work as expected)
- [x] Refactoring
- [x] Test cases
JinHai-CN pushed a commit that referenced this issue May 23, 2024
…ay data type (#1241)

### What problem does this PR solve?

Support default value and json format import for Tensor and TensorArray
data type

Issue link:#1179

### Type of change

- [x] New Feature (non-breaking change which adds functionality)
- [x] Refactoring
- [x] Test cases
yingfeng pushed a commit that referenced this issue May 24, 2024
### What problem does this PR solve?

Provide Tensor MaxSim reranker for Fusion operator
Support Multiple fusion operators

Issue link:#1179

### Type of change

- [x] New Feature (non-breaking change which adds functionality)
- [x] Test cases
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants