feat: add GPU acceleration in advanced settings #1646
Labels
engineering: Jan Inference Layer
Jan can serve models locally: with correct data structs, APIs, multi-inference engines, multi-model
roadmap: Observability
System Monitor, logs, observability and hardware insights
status: needs designs
Needs designs
type: feature request
A new feature
Milestone
Epic: https://github.com/orgs/janhq/projects/5/views/16?pane=issue&itemId=46869443
Specs
Settings / Advanced Settings
Enhance model performance by utilizing your device's GPU for acceleration.
)GPU Monitoring Toggle:
GPU Monitoring Warning:
GPU Selection:
Device Compatibility Check:
(Optional: provide a suggestion or link to update GPU drivers or install a compatible GPU).
Feedback:
Error scenarios:
1. User tries to enable GPU monitoring, but their device doesn't have a compatible GPU
2. GPU Selection with Incompatible GPU
User wants to select a specific GPU for monitoring, but that GPU is not compatible -> incompatible GPU will be disable.
3. GPU Monitoring Turned Off with Compatible GPU
User attempts to turn off GPU monitoring when they have a compatible GPU.
Tooltip when hover warning icon:
Out-of-scope:
Design
Figma link: https://www.figma.com/file/ytn1nRZ17FUmJHTlhmZB9f/Jan-App?type=design&node-id=2303-39294&mode=design&t=cyen6gHzxMZyZEER-4
The text was updated successfully, but these errors were encountered: