Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ENH: Clear cache for embedding and rerank #1360

Merged
merged 1 commit into from
Apr 24, 2024
Merged

ENH: Clear cache for embedding and rerank #1360

merged 1 commit into from
Apr 24, 2024

Conversation

codingl2k1
Copy link
Contributor

  • Support XINFERENCE_EMBEDDING_EMPTY_CACHE_COUNT, default 10
  • Support XINFERENCE_RERANK_EMPTY_CACHE_COUNT, default 10

@XprobeBot XprobeBot added the enhancement New feature or request label Apr 23, 2024
@XprobeBot XprobeBot added this to the v0.10.3 milestone Apr 23, 2024
@codingl2k1 codingl2k1 changed the title [ENH] Clear cache for embedding and rerank ENH: Clear cache for embedding and rerank Apr 23, 2024
qinxuye
qinxuye approved these changes Apr 24, 2024
View reviewed changes
Copy link
Contributor

@qinxuye qinxuye left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@qinxuye qinxuye marked this pull request as ready for review April 24, 2024 02:45
@qinxuye qinxuye merged commit 2ba72b0 into xorbitsai:main Apr 24, 2024
11 of 12 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@qinxuye qinxuye qinxuye approved these changes

Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
v0.10.3
Development

Successfully merging this pull request may close these issues.

None yet
3 participants
@codingl2k1 @qinxuye @XprobeBot