Releases: likelovewant/ollama-for-amd
v0.30.5
update merge
v0.30.0
- Detailed Installation Guide: please refer to the wiki guide:
Demo Release Version:
This releaseOllamaSetup.exebuild withROCm7.1 [hipsdk 7.1.1], make sure to replace the libs with v0.7.1.1
Tip
Update * Please note that the releases on this repository are intended for demonstration purposes only and may not be kept up to date. In such cases, please consider building it yourself, following the guidance provided in the wiki links.
ollama-windows-amd64.7z for ROCm7.1.1
ROCmlibs for 7.1 available at ROCmlibs for 7.1.1
Support lists gfx906:xnack- gfx1010:xnack- gfx1011:xnack- gfx1012:xnack- gfx1030 gfx1031 gfx1032 gfx1034 gfx1035 gfx1036 gfx1100 gfx1101 gfx1103 gfx1150 gfx1151 gfx1152 gfx1153 gfx1200 gfx1201 .
Note
Let's get Ollama set up!
-
Install or Extract: Download and install Official OllamaSetup.exe ,delete the entire rocm in
C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocmreplaceggml-hipollama.exefromollama-windows-amd64.7zfrom this repo. -
Update ROCm Libraries:
- Find the
rocblas.dllfile and therocblas/libraryfolder within your Ollama installation folder (usually
located atC:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm). - Delete the existing
rocblas/libraryfolder. - Replace it with the correct ROCm libraries. You’ll need the right version for your GPU. You can find
them here: ROCmLibs for7.1.1
- Find the
-
Reboot your System (if internal error show) and Start Ollama: Once the ROCm libraries are updated, you can start using Ollama.
Tip
Ollama GUI App Use( in ROCm7.1) * Download Official OllamaSetup.exe and install, replace all content in C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm from ollama-windows-amd64-rocm.7z , also make sure replace your gup-arches ROCm Libraries and rocblas.dll
If there is error log show amdgpu is not supported (supported types:[gfx1030 gfx1100 gfx1101 gfx1102 gfx906] it's means you are missing some steps . please check the above steps or possible replace the rocmlibs in your hipsdk
v0.20.8
- Detailed Installation Guide: please refer to the wiki guide:
Demo Release Version:
This releaseOllamaSetup.exebuild withROCm6.4 [hipsdk 6.4.2], make sure to replace the libs with v0.6.4.2
Tip
Update * Please note that the releases on this repository are intended for demonstration purposes only and may not be kept up to date. In such cases, please consider building it yourself, following the guidance provided in the wiki links.
ollama-windows-amd64.7z for ROCm6.4.2
ROCmlibs for 6.4 available at ROCmlibs for 6.4.2
Support lists gfx906:xnack- gfx1010:xnack- gfx1012:xnack- gfx1030 gfx1031 gfx1032 gfx1034 gfx1035 gfx1036 gfx1100 gfx1101 gfx1103 gfx1150 gfx1151 gfx1152 gfx1153 gfx1200 gfx1201 Note for gfx1200, gfx1201,make sure change the amdhip64.dll in ollama/../rocm directory from you system windows/systme32 to get the latest driver if you card did get correctly.
Note
Let's get Ollama set up!
-
Install or Extract: Download and install Official OllamaSetup.exe ,delete the entire rocm in
C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocmreplace the full content orggml-hipfromollama-windows-amd64.7zfrom this repo. -
Update ROCm Libraries:
- Find the
rocblas.dllfile and therocblas/libraryfolder within your Ollama installation folder (usually
located atC:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm). - Delete the existing
rocblas/libraryfolder. - Replace it with the correct ROCm libraries. You’ll need the right version for your GPU. You can find
them here: ROCmLibs for 6.4.2
- Find the
-
Start Ollama: Once the ROCm libraries are updated, you can start using Ollama.
Tip
Ollama GUI App Use( in ROCm6.4) * Download Official OllamaSetup.exe and install, replace all content in C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm from ollama-windows-amd64-rocm.7z , also make sure replace your gup-arches ROCm Libraries and rocblas.dll
If there is error log show amdgpu is not supported (supported types:[gfx1030 gfx1100 gfx1101 gfx1102 gfx906] it's means you are missing some steps . please check the above steps or possible replace the rocmlibs in your hipsdk
v0.18.2
- Detailed Installation Guide: please refer to the wiki guide:
Demo Release Version:
This releaseOllamaSetup.exebuild withROCm6.4 [hipsdk 6.4.2], make sure to replace the libs with v0.6.4.2
Tip
Update * Please note that the releases on this repository are intended for demonstration purposes only and may not be kept up to date. In such cases, please consider building it yourself, following the guidance provided in the wiki links.
ollama-windows-amd64.7z for ROCm6.4.2
ROCmlibs for 6.4 available at ROCmlibs for 6.4.2
Support lists gfx906:xnack- gfx1010:xnack- gfx1012:xnack- gfx1030 gfx1031 gfx1032 gfx1034 gfx1035 gfx1036 gfx1100 gfx1101 gfx1103 gfx1150 gfx1151 gfx1152 gfx1153 gfx1200 gfx1201 Note for gfx1200, gfx1201,make sure change the amdhip64.dll in ollama/../rocm directory from you system windows/systme32 to get the latest driver if you card did get correctly.
Note
Let's get Ollama set up!
-
Install or Extract: Download and install Official OllamaSetup.exe ,delete the entire rocm in
C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocmreplace the content fromollama-windows-amd64.7zfrom this repo. -
Update ROCm Libraries:
- Find the
rocblas.dllfile and therocblas/libraryfolder within your Ollama installation folder (usually
located atC:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm). - Delete the existing
rocblas/libraryfolder. - Replace it with the correct ROCm libraries. You’ll need the right version for your GPU. You can find
them here: ROCmLibs for 6.4.2
- Find the
-
Start Ollama: Once the ROCm libraries are updated, you can start using Ollama.
Tip
Ollama GUI App Use( in ROCm6.4) * Download Official OllamaSetup.exe and install, replace all content in C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm from ollama-windows-amd64-rocm.7z , also make sure replace your gup-arches ROCm Libraries and rocblas.dll
If there is error log show amdgpu is not supported (supported types:[gfx1030 gfx1100 gfx1101 gfx1102 gfx906] it's means you are missing some steps . please check the above steps or possible replace the rocmlibs in your hipsdk
v0.16.1
- Detailed Installation Guide: please refer to the wiki guide:
Demo Release Version:
This releaseOllamaSetup.exebuild withROCm6.4 [hipsdk 6.4.2], make sure to replace the libs with v0.6.4.2
Tip
ROCm5.7 version * no longer supported due to upstream update .
ollama-windows-amd64.7z for ROCm6.4.2
ROCmlibs for 6.4 available at ROCmlibs for 6.4.2
Support lists gfx906:xnack- gfx1010:xnack- gfx1012:xnack- gfx1030 gfx1031 gfx1032 gfx1034 gfx1035 gfx1036 gfx1100 gfx1101 gfx1103 gfx1150 gfx1151 gfx1152 gfx1153 gfx1200 gfx1201 Note for gfx1200, gfx1201,make sure change the amdhip64.dll in ollama/../rocm directory from you system windows/systme32 to get the latest driver if you card did get correctly.
Note
Let's get Ollama set up!
-
Install or Extract: Download and install Official OllamaSetup.exe ,delete the entire rocm in
C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocmreplace the content fromollama-windows-amd64.7zfrom this repo. -
Update ROCm Libraries:
- Find the
rocblas.dllfile and therocblas/libraryfolder within your Ollama installation folder (usually
located atC:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm). - Delete the existing
rocblas/libraryfolder. - Replace it with the correct ROCm libraries. You’ll need the right version for your GPU. You can find
them here: ROCmLibs for 6.4.2
- Find the
-
Start Ollama: Once the ROCm libraries are updated, you can start using Ollama.
Tip
Ollama GUI App Use( in ROCm6.4) * Download Official OllamaSetup.exe and install, replace all content in C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm from ollama-windows-amd64-rocm.7z , also make sure replace your gup-arches ROCm Libraries and rocblas.dll
If there is error log show amdgpu is not supported (supported types:[gfx1030 gfx1100 gfx1101 gfx1102 gfx906] it's means you are missing some steps . please check the above steps or possible replace the rocmlibs in your hipsdk
v0.15.5
Merge branch 'ollama:main' into main
v0.14.3
- Detailed Installation Guide: please refer to the wiki guide:
Demo Release Version:
This releaseOllamaSetup.exebuild withROCm6.4 [hipsdk 6.4.2], make sure to replace the libs with v0.6.4.2
Tip
ROCm5.7 version * no longer supported due to upstream update .
ollama-windows-amd64.7z for ROCm6.4.2
ROCmlibs for 6.4 available at ROCmlibs for 6.4.2
Support lists gfx906:xnack- gfx1010:xnack- gfx1012:xnack- gfx1030 gfx1031 gfx1032 gfx1034 gfx1035 gfx1036 gfx1100 gfx1101 gfx1103 gfx1150 gfx1151 gfx1152 gfx1153 gfx1200 gfx1201 Note for gfx1200, gfx1201,make sure change the amdhip64.dll in ollama/../rocm directory from you system windows/systme32 to get the latest driver if you card did get correctly.
Note
Let's get Ollama set up!
-
Install or Extract: Download and install Official OllamaSetup.exe ,delete the entire rocm in
C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocmreplace the content fromollama-windows-amd64.7zfrom this repo. -
Update ROCm Libraries:
- Find the
rocblas.dllfile and therocblas/libraryfolder within your Ollama installation folder (usually
located atC:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm). - Delete the existing
rocblas/libraryfolder. - Replace it with the correct ROCm libraries. You’ll need the right version for your GPU. You can find
them here: ROCmLibs for 6.4.2
- Find the
-
Start Ollama: Once the ROCm libraries are updated, you can start using Ollama.
Tip
Ollama GUI App Use( in ROCm6.4) * Download Official OllamaSetup.exe and install, replace all content in C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm from ollama-windows-amd64-rocm.7z , also make sure replace your gup-arches ROCm Libraries and rocblas.dll
If there is error log show amdgpu is not supported (supported types:[gfx1030 gfx1100 gfx1101 gfx1102 gfx906] it's means you are missing some steps . please check the above steps or possible replace the rocmlibs in your hipsdk
Full Changelog: v0.13.5...v0.14.3
v0.13.5
- Detailed Installation Guide: please refer to the wiki guide:
Demo Release Version:
This releaseOllamaSetup.exebuild withROCm6.4 [hipsdk 6.4.2], make sure to replace the libs with v0.6.4.2
Tip
ROCm5.7 version * no longer supported due to upstream update .
ollama-windows-amd64.7z for ROCm6.4.2
ROCmlibs for 6.4 available at ROCmlibs for 6.4.2
Support lists gfx906:xnack- gfx1010:xnack- gfx1012:xnack- gfx1030 gfx1031 gfx1032 gfx1034 gfx1035 gfx1036 gfx1100 gfx1101 gfx1103 gfx1150 gfx1151 gfx1152 gfx1153 gfx1200 gfx1201 Note for gfx1200, gfx1201,make sure change the amdhip64.dll in ollama/../rocm directory from you system windows/systme32 to get the latest driver if you card did get correctly.
Note
Let's get Ollama set up!
-
Install or Extract: Download and install Official OllamaSetup.exe ,delete the entire rocm in
C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocmreplace the content fromollama-windows-amd64.7zfrom this repo. -
Update ROCm Libraries:
- Find the
rocblas.dllfile and therocblas/libraryfolder within your Ollama installation folder (usually
located atC:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm). - Delete the existing
rocblas/libraryfolder. - Replace it with the correct ROCm libraries. You’ll need the right version for your GPU. You can find
them here: ROCmLibs for 6.4.2
- Find the
-
Start Ollama: Once the ROCm libraries are updated, you can start using Ollama.
Tip
Ollama GUI App Use( in ROCm6.4) * Download Official OllamaSetup.exe and install, replace all content in C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm from ollama-windows-amd64-rocm.7z , also make sure replace your gup-arches ROCm Libraries and rocblas.dll
If there is error log show amdgpu is not supported (supported types:[gfx1030 gfx1100 gfx1101 gfx1102 gfx906] it's means you are missing some steps . please check the above steps or possible replace the rocmlibs in your hipsdk
v0.13.3
Merge branch 'ollama:main' into main
v0.13.2
Merge branch 'ollama:main' into main