Skip to content

v0.18.2

Choose a tag to compare

@likelovewant likelovewant released this 18 Mar 13:14
· 285 commits to main since this release
  • Detailed Installation Guide: please refer to the wiki guide:
    Demo Release Version:
    This release OllamaSetup.exe build with ROCm6.4 [hipsdk 6.4.2], make sure to replace the libs with v0.6.4.2

Tip

Update * Please note that the releases on this repository are intended for demonstration purposes only and may not be kept up to date. In such cases, please consider building it yourself, following the guidance provided in the wiki links.

ollama-windows-amd64.7z for ROCm6.4.2
ROCmlibs for 6.4 available at ROCmlibs for 6.4.2

Support lists gfx906:xnack- gfx1010:xnack- gfx1012:xnack- gfx1030 gfx1031 gfx1032 gfx1034 gfx1035 gfx1036 gfx1100 gfx1101 gfx1103 gfx1150 gfx1151 gfx1152 gfx1153 gfx1200 gfx1201 Note for gfx1200, gfx1201,make sure change the amdhip64.dll in ollama/../rocm directory from you system windows/systme32 to get the latest driver if you card did get correctly.

Note

Let's get Ollama set up!

  1. Install or Extract: Download and install Official OllamaSetup.exe ,delete the entire rocm in C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm replace the content from ollama-windows-amd64.7z from this repo.

  2. Update ROCm Libraries:

    • Find the rocblas.dll file and the rocblas/library folder within your Ollama installation folder (usually
      located at C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm).
    • Delete the existing rocblas/library folder.
    • Replace it with the correct ROCm libraries. You’ll need the right version for your GPU. You can find
      them here: ROCmLibs for 6.4.2
  3. Start Ollama: Once the ROCm libraries are updated, you can start using Ollama.

Tip

Ollama GUI App Use( in ROCm6.4) * Download Official OllamaSetup.exe and install, replace all content in C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm from ollama-windows-amd64-rocm.7z , also make sure replace your gup-arches ROCm Libraries and rocblas.dll

If there is error log show amdgpu is not supported (supported types:[gfx1030 gfx1100 gfx1101 gfx1102 gfx906] it's means you are missing some steps . please check the above steps or possible replace the rocmlibs in your hipsdk