-
Notifications
You must be signed in to change notification settings - Fork 1.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat: [FE] Implement GPU acceleration #1851
Comments
@urmauur
|
On the other hand, can we simplify the GPU section a little bit? |
@Van-QA , please help to validate this issue with nightly build. Thank you! |
hi @namchuai, Please double check this scenario ❌ : |
additional issue is when in dark mode, the placeholder text in the dropdown blends with the background @louis-jan |
Tested and looking good on Jan v0.4.6-280 ✅ |
Epic: #905
Related design ticket: #1646
Related implementation ticket from @hiento09: #1730
Design
Figma link: https://www.figma.com/file/ytn1nRZ17FUmJHTlhmZB9f/Jan-App?type=design&node-id=2596-81009&mode=design&t=vDzqYrfNOU0W8KmX-4
When users have compatible GPU(s)
When click on choosing GPU, there are 2 cases:
When users select more than 1 GPU
If multi-GPU is enabled with different GPU models or without NVLink, it could impact token speed
When users turn off GPU acceleration although they have compatible GPU
Show warning icon -> when hover, users see tooltip suggestion that users should turn it on:
Disabling GPU Acceleration may result in reduced performance. It's recommended to keep this enabled for optimal user experience.
When users don't have any compatible GPU
Your current device does not have a compatible GPU for monitoring. To enable GPU monitoring, please ensure your device has a supported Nvidia or AMD GPU with updated drivers.
Edge case
When the local API server is running, users are not allowed to change GPU settings
The text was updated successfully, but these errors were encountered: