Releases: likelovewant/ollama-for-amd
Release list
v0.33.0
Merge branch 'ollama:main' into main
v0.32.11
Merge branch 'ollama:main' into main
v0.30.8
Quick Setup for Ollama on AMD (ROCm 7.1.1)
⚠️ Demo Release Notice
The releases here are for demo purposes and may not be up to date. For the latest version, please build it yourself or refer to the detailed wiki guide.
Tip
Ollama Official Support AMD in Vulkan * Ollama now natively supports AMD GPUs via Vulkan for most architectures. No need for the complex steps in this repo – just use the official installer.
Downloads
OllamaSetup.exe– built with ROCm 7.1 (hipsdk 7.1.1).ollama-windows-amd64-rocm.zip– for ROCm 7.1.1.- ROCm libs v7.1.1
Supported GPUs
gfx1010; gfx1011; gfx1012; gfx1030; gfx1031; gfx1032; gfx1034; gfx1035; gfx1036; gfx1100; gfx1101; gfx1102; gfx1103; gfx1150; gfx1151; gfx1152; gfx1153; gfx1200; gfx1201
Setup Steps
-
Install Ollama
- Download and run
OllamaSetup.exe(from this repo or the official site). - If using the official installer, replace the
ggml-hipfiles inC:\Users\<username>\AppData\Local\Programs\Ollama\lib\ollama\rocm_v7_1with those fromollama-windows-amd64-rocm.zip(skip if you used this repo's installer).
- Download and run
-
Replace ROCm libraries
- Go to
C:\Users\<username>\AppData\Local\Programs\Ollama\lib\ollama\rocm_v7_1. - Delete the
rocblas/libraryfolder. - Copy the correct ROCm libs for your GPU from the ROCmLibs v7.1.1 release into the same location.
- Go to
-
Restart your PC (if you see internal errors), then launch Ollama.
For integrated GPUs (e.g., gfx1103, gfx1151…)
Set the environment variable OLLAMA_IGPU_ENABLE=1.
Learn how to set environment variables on Windows. Otherwise, your GPU may not be detected.
v0.30.5
update merge
v0.30.0
- Detailed Installation Guide: please refer to the wiki guide:
Demo Release Version:
This releaseOllamaSetup.exebuild withROCm7.1 [hipsdk 7.1.1], make sure to replace the libs with v0.7.1.1
Tip
Update * Please note that the releases on this repository are intended for demonstration purposes only and may not be kept up to date. In such cases, please consider building it yourself, following the guidance provided in the wiki links.
ollama-windows-amd64.7z for ROCm7.1.1
ROCmlibs for 7.1 available at ROCmlibs for 7.1.1
Support lists gfx906:xnack- gfx1010:xnack- gfx1011:xnack- gfx1012:xnack- gfx1030 gfx1031 gfx1032 gfx1034 gfx1035 gfx1036 gfx1100 gfx1101 gfx1103 gfx1150 gfx1151 gfx1152 gfx1153 gfx1200 gfx1201 .
Note
Let's get Ollama set up!
-
Install or Extract: Download and install OllamaSetup.exe from this repo,delete the entire rocm in
C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocmreplaceggml-hipollama.exefromollama-windows-amd64.7zfrom this repo. -
Update ROCm Libraries:
- Find the
rocblas.dllfile and therocblas/libraryfolder within your Ollama installation folder (usually
located atC:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm). - Delete the existing
rocblas/libraryfolder. - Replace it with the correct ROCm libraries. You’ll need the right version for your GPU. You can find
them here: ROCmLibs for7.1.1
- Find the
-
Reboot your System (if internal error show) and Start Ollama: Once the ROCm libraries are updated, you can start using Ollama.
Tip
Ollama GUI App Use( in ROCm7.1) * Download Official OllamaSetup.exe and install, replace all content in C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm from ollama-windows-amd64-rocm.7z , also make sure replace your gup-arches ROCm Libraries and rocblas.dll
If there is error log show amdgpu is not supported (supported types:[gfx1030 gfx1100 gfx1101 gfx1102 gfx906] it's means you are missing some steps . please check the above steps or possible replace the rocmlibs in your hipsdk
v0.20.8
- Detailed Installation Guide: please refer to the wiki guide:
Demo Release Version:
This releaseOllamaSetup.exebuild withROCm6.4 [hipsdk 6.4.2], make sure to replace the libs with v0.6.4.2
Tip
Update * Please note that the releases on this repository are intended for demonstration purposes only and may not be kept up to date. In such cases, please consider building it yourself, following the guidance provided in the wiki links.
ollama-windows-amd64.7z for ROCm6.4.2
ROCmlibs for 6.4 available at ROCmlibs for 6.4.2
Support lists gfx906:xnack- gfx1010:xnack- gfx1012:xnack- gfx1030 gfx1031 gfx1032 gfx1034 gfx1035 gfx1036 gfx1100 gfx1101 gfx1103 gfx1150 gfx1151 gfx1152 gfx1153 gfx1200 gfx1201 Note for gfx1200, gfx1201,make sure change the amdhip64.dll in ollama/../rocm directory from you system windows/systme32 to get the latest driver if you card did get correctly.
Note
Let's get Ollama set up!
-
Install or Extract: Download and install Official OllamaSetup.exe ,delete the entire rocm in
C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocmreplace the full content orggml-hipfromollama-windows-amd64.7zfrom this repo. -
Update ROCm Libraries:
- Find the
rocblas.dllfile and therocblas/libraryfolder within your Ollama installation folder (usually
located atC:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm). - Delete the existing
rocblas/libraryfolder. - Replace it with the correct ROCm libraries. You’ll need the right version for your GPU. You can find
them here: ROCmLibs for 6.4.2
- Find the
-
Start Ollama: Once the ROCm libraries are updated, you can start using Ollama.
Tip
Ollama GUI App Use( in ROCm6.4) * Download Official OllamaSetup.exe and install, replace all content in C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm from ollama-windows-amd64-rocm.7z , also make sure replace your gup-arches ROCm Libraries and rocblas.dll
If there is error log show amdgpu is not supported (supported types:[gfx1030 gfx1100 gfx1101 gfx1102 gfx906] it's means you are missing some steps . please check the above steps or possible replace the rocmlibs in your hipsdk
v0.18.2
- Detailed Installation Guide: please refer to the wiki guide:
Demo Release Version:
This releaseOllamaSetup.exebuild withROCm6.4 [hipsdk 6.4.2], make sure to replace the libs with v0.6.4.2
Tip
Update * Please note that the releases on this repository are intended for demonstration purposes only and may not be kept up to date. In such cases, please consider building it yourself, following the guidance provided in the wiki links.
ollama-windows-amd64.7z for ROCm6.4.2
ROCmlibs for 6.4 available at ROCmlibs for 6.4.2
Support lists gfx906:xnack- gfx1010:xnack- gfx1012:xnack- gfx1030 gfx1031 gfx1032 gfx1034 gfx1035 gfx1036 gfx1100 gfx1101 gfx1103 gfx1150 gfx1151 gfx1152 gfx1153 gfx1200 gfx1201 Note for gfx1200, gfx1201,make sure change the amdhip64.dll in ollama/../rocm directory from you system windows/systme32 to get the latest driver if you card did get correctly.
Note
Let's get Ollama set up!
-
Install or Extract: Download and install Official OllamaSetup.exe ,delete the entire rocm in
C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocmreplace the content fromollama-windows-amd64.7zfrom this repo. -
Update ROCm Libraries:
- Find the
rocblas.dllfile and therocblas/libraryfolder within your Ollama installation folder (usually
located atC:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm). - Delete the existing
rocblas/libraryfolder. - Replace it with the correct ROCm libraries. You’ll need the right version for your GPU. You can find
them here: ROCmLibs for 6.4.2
- Find the
-
Start Ollama: Once the ROCm libraries are updated, you can start using Ollama.
Tip
Ollama GUI App Use( in ROCm6.4) * Download Official OllamaSetup.exe and install, replace all content in C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm from ollama-windows-amd64-rocm.7z , also make sure replace your gup-arches ROCm Libraries and rocblas.dll
If there is error log show amdgpu is not supported (supported types:[gfx1030 gfx1100 gfx1101 gfx1102 gfx906] it's means you are missing some steps . please check the above steps or possible replace the rocmlibs in your hipsdk
v0.16.1
- Detailed Installation Guide: please refer to the wiki guide:
Demo Release Version:
This releaseOllamaSetup.exebuild withROCm6.4 [hipsdk 6.4.2], make sure to replace the libs with v0.6.4.2
Tip
ROCm5.7 version * no longer supported due to upstream update .
ollama-windows-amd64.7z for ROCm6.4.2
ROCmlibs for 6.4 available at ROCmlibs for 6.4.2
Support lists gfx906:xnack- gfx1010:xnack- gfx1012:xnack- gfx1030 gfx1031 gfx1032 gfx1034 gfx1035 gfx1036 gfx1100 gfx1101 gfx1103 gfx1150 gfx1151 gfx1152 gfx1153 gfx1200 gfx1201 Note for gfx1200, gfx1201,make sure change the amdhip64.dll in ollama/../rocm directory from you system windows/systme32 to get the latest driver if you card did get correctly.
Note
Let's get Ollama set up!
-
Install or Extract: Download and install Official OllamaSetup.exe ,delete the entire rocm in
C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocmreplace the content fromollama-windows-amd64.7zfrom this repo. -
Update ROCm Libraries:
- Find the
rocblas.dllfile and therocblas/libraryfolder within your Ollama installation folder (usually
located atC:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm). - Delete the existing
rocblas/libraryfolder. - Replace it with the correct ROCm libraries. You’ll need the right version for your GPU. You can find
them here: ROCmLibs for 6.4.2
- Find the
-
Start Ollama: Once the ROCm libraries are updated, you can start using Ollama.
Tip
Ollama GUI App Use( in ROCm6.4) * Download Official OllamaSetup.exe and install, replace all content in C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm from ollama-windows-amd64-rocm.7z , also make sure replace your gup-arches ROCm Libraries and rocblas.dll
If there is error log show amdgpu is not supported (supported types:[gfx1030 gfx1100 gfx1101 gfx1102 gfx906] it's means you are missing some steps . please check the above steps or possible replace the rocmlibs in your hipsdk
v0.15.5
Merge branch 'ollama:main' into main
v0.14.3
- Detailed Installation Guide: please refer to the wiki guide:
Demo Release Version:
This releaseOllamaSetup.exebuild withROCm6.4 [hipsdk 6.4.2], make sure to replace the libs with v0.6.4.2
Tip
ROCm5.7 version * no longer supported due to upstream update .
ollama-windows-amd64.7z for ROCm6.4.2
ROCmlibs for 6.4 available at ROCmlibs for 6.4.2
Support lists gfx906:xnack- gfx1010:xnack- gfx1012:xnack- gfx1030 gfx1031 gfx1032 gfx1034 gfx1035 gfx1036 gfx1100 gfx1101 gfx1103 gfx1150 gfx1151 gfx1152 gfx1153 gfx1200 gfx1201 Note for gfx1200, gfx1201,make sure change the amdhip64.dll in ollama/../rocm directory from you system windows/systme32 to get the latest driver if you card did get correctly.
Note
Let's get Ollama set up!
-
Install or Extract: Download and install Official OllamaSetup.exe ,delete the entire rocm in
C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocmreplace the content fromollama-windows-amd64.7zfrom this repo. -
Update ROCm Libraries:
- Find the
rocblas.dllfile and therocblas/libraryfolder within your Ollama installation folder (usually
located atC:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm). - Delete the existing
rocblas/libraryfolder. - Replace it with the correct ROCm libraries. You’ll need the right version for your GPU. You can find
them here: ROCmLibs for 6.4.2
- Find the
-
Start Ollama: Once the ROCm libraries are updated, you can start using Ollama.
Tip
Ollama GUI App Use( in ROCm6.4) * Download Official OllamaSetup.exe and install, replace all content in C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm from ollama-windows-amd64-rocm.7z , also make sure replace your gup-arches ROCm Libraries and rocblas.dll
If there is error log show amdgpu is not supported (supported types:[gfx1030 gfx1100 gfx1101 gfx1102 gfx906] it's means you are missing some steps . please check the above steps or possible replace the rocmlibs in your hipsdk
Full Changelog: v0.13.5...v0.14.3