Skip to content

v0.30.0

Choose a tag to compare

@likelovewant likelovewant released this 16 May 04:40
· 87 commits to main since this release
7d0c453
  • Detailed Installation Guide: please refer to the wiki guide:
    Demo Release Version:
    This release OllamaSetup.exe build with ROCm7.1 [hipsdk 7.1.1], make sure to replace the libs with v0.7.1.1

Tip

Update * Please note that the releases on this repository are intended for demonstration purposes only and may not be kept up to date. In such cases, please consider building it yourself, following the guidance provided in the wiki links.

ollama-windows-amd64.7z for ROCm7.1.1
ROCmlibs for 7.1 available at ROCmlibs for 7.1.1

Support lists gfx906:xnack- gfx1010:xnack- gfx1011:xnack- gfx1012:xnack- gfx1030 gfx1031 gfx1032 gfx1034 gfx1035 gfx1036 gfx1100 gfx1101 gfx1103 gfx1150 gfx1151 gfx1152 gfx1153 gfx1200 gfx1201 .

Note

Let's get Ollama set up!

  1. Install or Extract: Download and install OllamaSetup.exe from this repo,delete the entire rocm in C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm replace ggml-hip ollama.exe from ollama-windows-amd64.7z from this repo.

  2. Update ROCm Libraries:

    • Find the rocblas.dll file and the rocblas/library folder within your Ollama installation folder (usually
      located at C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm).
    • Delete the existing rocblas/library folder.
    • Replace it with the correct ROCm libraries. You’ll need the right version for your GPU. You can find
      them here: ROCmLibs for7.1.1
  3. Reboot your System (if internal error show) and Start Ollama: Once the ROCm libraries are updated, you can start using Ollama.

Tip

Ollama GUI App Use( in ROCm7.1) * Download Official OllamaSetup.exe and install, replace all content in C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm from ollama-windows-amd64-rocm.7z , also make sure replace your gup-arches ROCm Libraries and rocblas.dll

If there is error log show amdgpu is not supported (supported types:[gfx1030 gfx1100 gfx1101 gfx1102 gfx906] it's means you are missing some steps . please check the above steps or possible replace the rocmlibs in your hipsdk