Skip to content

v0.13.5

Choose a tag to compare

@likelovewant likelovewant released this 19 Dec 11:19
· 577 commits to main since this release
cbb2f09
  • Detailed Installation Guide: please refer to the wiki guide:
    Demo Release Version:
    This release OllamaSetup.exe build with ROCm6.4 [hipsdk 6.4.2], make sure to replace the libs with v0.6.4.2

Tip

ROCm5.7 version * no longer supported due to upstream update .

ollama-windows-amd64.7z for ROCm6.4.2
ROCmlibs for 6.4 available at ROCmlibs for 6.4.2

Support lists gfx906:xnack- gfx1010:xnack- gfx1012:xnack- gfx1030 gfx1031 gfx1032 gfx1034 gfx1035 gfx1036 gfx1100 gfx1101 gfx1103 gfx1150 gfx1151 gfx1152 gfx1153 gfx1200 gfx1201 Note for gfx1200, gfx1201,make sure change the amdhip64.dll in ollama/../rocm directory from you system windows/systme32 to get the latest driver if you card did get correctly.

Note

Let's get Ollama set up!

  1. Install or Extract: Download and install Official OllamaSetup.exe ,delete the entire rocm in C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm replace the content from ollama-windows-amd64.7z from this repo.

  2. Update ROCm Libraries:

    • Find the rocblas.dll file and the rocblas/library folder within your Ollama installation folder (usually
      located at C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm).
    • Delete the existing rocblas/library folder.
    • Replace it with the correct ROCm libraries. You’ll need the right version for your GPU. You can find
      them here: ROCmLibs for 6.4.2
  3. Start Ollama: Once the ROCm libraries are updated, you can start using Ollama.

Tip

Ollama GUI App Use( in ROCm6.4) * Download Official OllamaSetup.exe and install, replace all content in C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm from ollama-windows-amd64-rocm.7z , also make sure replace your gup-arches ROCm Libraries and rocblas.dll

If there is error log show amdgpu is not supported (supported types:[gfx1030 gfx1100 gfx1101 gfx1102 gfx906] it's means you are missing some steps . please check the above steps or possible replace the rocmlibs in your hipsdk