Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

add optimization for offloading models to CPU #330

Closed
ssube opened this issue Apr 14, 2023 · 0 comments
Closed

add optimization for offloading models to CPU #330

ssube opened this issue Apr 14, 2023 · 0 comments
Labels
scope/api status/fixed issues that have been fixed and released type/feature new features
Milestone
v0.10

Comments

@ssube
Copy link
Owner

ssube commented Apr 14, 2023

Add the other low-memory optimizations discussed in #241 (comment)
@ssube ssube added status/planned issues that have been planned but not started type/feature new features scope/api labels Apr 14, 2023
@ssube ssube added this to the v0.10 milestone Apr 14, 2023
ssube added a commit that referenced this issue Apr 24, 2023
@ssube
feat(api): allow offloading individual models to CPU (#330)
cad87b9
@ssube ssube added status/fixed issues that have been fixed and released and removed status/planned issues that have been planned but not started labels Apr 24, 2023
@ssube ssube closed this as completed Apr 24, 2023
@ssube ssube mentioned this issue May 1, 2023
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
scope/api status/fixed issues that have been fixed and released type/feature new features
Projects
None yet
Milestone
v0.10
Development

No branches or pull requests
1 participant
@ssube