You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I upgraded my server recently and tried to run LLamaGPT on it. It bombs the CPU and doesn't touch the gpu at all. To run AI on a GPU it has to be from Nvidia and the OS has to use the proprietary nvidia driver, so it should probably be an optional feature.
I upgraded my server recently and tried to run LLamaGPT on it. It bombs the CPU and doesn't touch the gpu at all. To run AI on a GPU it has to be from Nvidia and the OS has to use the proprietary nvidia driver, so it should probably be an optional feature.
Useful links:
https://wiki.debian.org/NvidiaGraphicsDrivers#Debian_12_.22Bookworm.22
https://docs.docker.com/compose/gpu-support/
https://www.tensorflow.org/guide/gpu NOTE: some distros have a separate tensorflow_gpu package
The text was updated successfully, but these errors were encountered: