Skip to content

Releases: likelovewant/ollama-for-amd

v0.33.0

v0.33.0 Pre-release
Pre-release

Choose a tag to compare

@likelovewant likelovewant released this 22 Aug 01:15
a6c9bfc
Merge branch 'ollama:main' into main

v0.32.11

v0.32.11 Pre-release
Pre-release

Choose a tag to compare

@likelovewant likelovewant released this 14 Aug 11:44
d633ccf
Merge branch 'ollama:main' into main

v0.30.8

Choose a tag to compare

@likelovewant likelovewant released this 13 Jun 09:46
4698f6d

Quick Setup for Ollama on AMD (ROCm 7.1.1)

⚠️ Demo Release Notice
The releases here are for demo purposes and may not be up to date. For the latest version, please build it yourself or refer to the detailed wiki guide.

Tip

Ollama Official Support AMD in Vulkan * Ollama now natively supports AMD GPUs via Vulkan for most architectures. No need for the complex steps in this repo – just use the official installer.

Downloads

Supported GPUs
gfx1010; gfx1011; gfx1012; gfx1030; gfx1031; gfx1032; gfx1034; gfx1035; gfx1036; gfx1100; gfx1101; gfx1102; gfx1103; gfx1150; gfx1151; gfx1152; gfx1153; gfx1200; gfx1201


Setup Steps

  1. Install Ollama

    • Download and run OllamaSetup.exe (from this repo or the official site).
    • If using the official installer, replace the ggml-hip files in C:\Users\<username>\AppData\Local\Programs\Ollama\lib\ollama\rocm_v7_1 with those from ollama-windows-amd64-rocm.zip (skip if you used this repo's installer).
  2. Replace ROCm libraries

    • Go to C:\Users\<username>\AppData\Local\Programs\Ollama\lib\ollama\rocm_v7_1.
    • Delete the rocblas/library folder.
    • Copy the correct ROCm libs for your GPU from the ROCmLibs v7.1.1 release into the same location.
  3. Restart your PC (if you see internal errors), then launch Ollama.


For integrated GPUs (e.g., gfx1103, gfx1151…)

Set the environment variable OLLAMA_IGPU_ENABLE=1.
Learn how to set environment variables on Windows. Otherwise, your GPU may not be detected.

v0.30.5

v0.30.5 Pre-release
Pre-release

Choose a tag to compare

@likelovewant likelovewant released this 05 Jun 10:31
update merge

v0.30.0

Choose a tag to compare

@likelovewant likelovewant released this 16 May 04:40
7d0c453
  • Detailed Installation Guide: please refer to the wiki guide:
    Demo Release Version:
    This release OllamaSetup.exe build with ROCm7.1 [hipsdk 7.1.1], make sure to replace the libs with v0.7.1.1

Tip

Update * Please note that the releases on this repository are intended for demonstration purposes only and may not be kept up to date. In such cases, please consider building it yourself, following the guidance provided in the wiki links.

ollama-windows-amd64.7z for ROCm7.1.1
ROCmlibs for 7.1 available at ROCmlibs for 7.1.1

Support lists gfx906:xnack- gfx1010:xnack- gfx1011:xnack- gfx1012:xnack- gfx1030 gfx1031 gfx1032 gfx1034 gfx1035 gfx1036 gfx1100 gfx1101 gfx1103 gfx1150 gfx1151 gfx1152 gfx1153 gfx1200 gfx1201 .

Note

Let's get Ollama set up!

  1. Install or Extract: Download and install OllamaSetup.exe from this repo,delete the entire rocm in C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm replace ggml-hip ollama.exe from ollama-windows-amd64.7z from this repo.

  2. Update ROCm Libraries:

    • Find the rocblas.dll file and the rocblas/library folder within your Ollama installation folder (usually
      located at C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm).
    • Delete the existing rocblas/library folder.
    • Replace it with the correct ROCm libraries. You’ll need the right version for your GPU. You can find
      them here: ROCmLibs for7.1.1
  3. Reboot your System (if internal error show) and Start Ollama: Once the ROCm libraries are updated, you can start using Ollama.

Tip

Ollama GUI App Use( in ROCm7.1) * Download Official OllamaSetup.exe and install, replace all content in C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm from ollama-windows-amd64-rocm.7z , also make sure replace your gup-arches ROCm Libraries and rocblas.dll

If there is error log show amdgpu is not supported (supported types:[gfx1030 gfx1100 gfx1101 gfx1102 gfx906] it's means you are missing some steps . please check the above steps or possible replace the rocmlibs in your hipsdk

v0.20.8

Choose a tag to compare

@likelovewant likelovewant released this 16 Apr 11:13
fc83007
  • Detailed Installation Guide: please refer to the wiki guide:
    Demo Release Version:
    This release OllamaSetup.exe build with ROCm6.4 [hipsdk 6.4.2], make sure to replace the libs with v0.6.4.2

Tip

Update * Please note that the releases on this repository are intended for demonstration purposes only and may not be kept up to date. In such cases, please consider building it yourself, following the guidance provided in the wiki links.

ollama-windows-amd64.7z for ROCm6.4.2
ROCmlibs for 6.4 available at ROCmlibs for 6.4.2

Support lists gfx906:xnack- gfx1010:xnack- gfx1012:xnack- gfx1030 gfx1031 gfx1032 gfx1034 gfx1035 gfx1036 gfx1100 gfx1101 gfx1103 gfx1150 gfx1151 gfx1152 gfx1153 gfx1200 gfx1201 Note for gfx1200, gfx1201,make sure change the amdhip64.dll in ollama/../rocm directory from you system windows/systme32 to get the latest driver if you card did get correctly.

Note

Let's get Ollama set up!

  1. Install or Extract: Download and install Official OllamaSetup.exe ,delete the entire rocm in C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm replace the full content or ggml-hip from ollama-windows-amd64.7z from this repo.

  2. Update ROCm Libraries:

    • Find the rocblas.dll file and the rocblas/library folder within your Ollama installation folder (usually
      located at C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm).
    • Delete the existing rocblas/library folder.
    • Replace it with the correct ROCm libraries. You’ll need the right version for your GPU. You can find
      them here: ROCmLibs for 6.4.2
  3. Start Ollama: Once the ROCm libraries are updated, you can start using Ollama.

Tip

Ollama GUI App Use( in ROCm6.4) * Download Official OllamaSetup.exe and install, replace all content in C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm from ollama-windows-amd64-rocm.7z , also make sure replace your gup-arches ROCm Libraries and rocblas.dll

If there is error log show amdgpu is not supported (supported types:[gfx1030 gfx1100 gfx1101 gfx1102 gfx906] it's means you are missing some steps . please check the above steps or possible replace the rocmlibs in your hipsdk

v0.18.2

Choose a tag to compare

@likelovewant likelovewant released this 18 Mar 13:14
  • Detailed Installation Guide: please refer to the wiki guide:
    Demo Release Version:
    This release OllamaSetup.exe build with ROCm6.4 [hipsdk 6.4.2], make sure to replace the libs with v0.6.4.2

Tip

Update * Please note that the releases on this repository are intended for demonstration purposes only and may not be kept up to date. In such cases, please consider building it yourself, following the guidance provided in the wiki links.

ollama-windows-amd64.7z for ROCm6.4.2
ROCmlibs for 6.4 available at ROCmlibs for 6.4.2

Support lists gfx906:xnack- gfx1010:xnack- gfx1012:xnack- gfx1030 gfx1031 gfx1032 gfx1034 gfx1035 gfx1036 gfx1100 gfx1101 gfx1103 gfx1150 gfx1151 gfx1152 gfx1153 gfx1200 gfx1201 Note for gfx1200, gfx1201,make sure change the amdhip64.dll in ollama/../rocm directory from you system windows/systme32 to get the latest driver if you card did get correctly.

Note

Let's get Ollama set up!

  1. Install or Extract: Download and install Official OllamaSetup.exe ,delete the entire rocm in C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm replace the content from ollama-windows-amd64.7z from this repo.

  2. Update ROCm Libraries:

    • Find the rocblas.dll file and the rocblas/library folder within your Ollama installation folder (usually
      located at C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm).
    • Delete the existing rocblas/library folder.
    • Replace it with the correct ROCm libraries. You’ll need the right version for your GPU. You can find
      them here: ROCmLibs for 6.4.2
  3. Start Ollama: Once the ROCm libraries are updated, you can start using Ollama.

Tip

Ollama GUI App Use( in ROCm6.4) * Download Official OllamaSetup.exe and install, replace all content in C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm from ollama-windows-amd64-rocm.7z , also make sure replace your gup-arches ROCm Libraries and rocblas.dll

If there is error log show amdgpu is not supported (supported types:[gfx1030 gfx1100 gfx1101 gfx1102 gfx906] it's means you are missing some steps . please check the above steps or possible replace the rocmlibs in your hipsdk

v0.16.1

Choose a tag to compare

@likelovewant likelovewant released this 13 Feb 11:46
  • Detailed Installation Guide: please refer to the wiki guide:
    Demo Release Version:
    This release OllamaSetup.exe build with ROCm6.4 [hipsdk 6.4.2], make sure to replace the libs with v0.6.4.2

Tip

ROCm5.7 version * no longer supported due to upstream update .

ollama-windows-amd64.7z for ROCm6.4.2
ROCmlibs for 6.4 available at ROCmlibs for 6.4.2

Support lists gfx906:xnack- gfx1010:xnack- gfx1012:xnack- gfx1030 gfx1031 gfx1032 gfx1034 gfx1035 gfx1036 gfx1100 gfx1101 gfx1103 gfx1150 gfx1151 gfx1152 gfx1153 gfx1200 gfx1201 Note for gfx1200, gfx1201,make sure change the amdhip64.dll in ollama/../rocm directory from you system windows/systme32 to get the latest driver if you card did get correctly.

Note

Let's get Ollama set up!

  1. Install or Extract: Download and install Official OllamaSetup.exe ,delete the entire rocm in C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm replace the content from ollama-windows-amd64.7z from this repo.

  2. Update ROCm Libraries:

    • Find the rocblas.dll file and the rocblas/library folder within your Ollama installation folder (usually
      located at C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm).
    • Delete the existing rocblas/library folder.
    • Replace it with the correct ROCm libraries. You’ll need the right version for your GPU. You can find
      them here: ROCmLibs for 6.4.2
  3. Start Ollama: Once the ROCm libraries are updated, you can start using Ollama.

Tip

Ollama GUI App Use( in ROCm6.4) * Download Official OllamaSetup.exe and install, replace all content in C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm from ollama-windows-amd64-rocm.7z , also make sure replace your gup-arches ROCm Libraries and rocblas.dll

If there is error log show amdgpu is not supported (supported types:[gfx1030 gfx1100 gfx1101 gfx1102 gfx906] it's means you are missing some steps . please check the above steps or possible replace the rocmlibs in your hipsdk

v0.15.5

v0.15.5 Pre-release
Pre-release

Choose a tag to compare

@likelovewant likelovewant released this 04 Feb 09:52
8957b56
Merge branch 'ollama:main' into main

v0.14.3

v0.14.3 Pre-release
Pre-release

Choose a tag to compare

@likelovewant likelovewant released this 17 Jan 04:08
8957b56
  • Detailed Installation Guide: please refer to the wiki guide:
    Demo Release Version:
    This release OllamaSetup.exe build with ROCm6.4 [hipsdk 6.4.2], make sure to replace the libs with v0.6.4.2

Tip

ROCm5.7 version * no longer supported due to upstream update .

ollama-windows-amd64.7z for ROCm6.4.2
ROCmlibs for 6.4 available at ROCmlibs for 6.4.2

Support lists gfx906:xnack- gfx1010:xnack- gfx1012:xnack- gfx1030 gfx1031 gfx1032 gfx1034 gfx1035 gfx1036 gfx1100 gfx1101 gfx1103 gfx1150 gfx1151 gfx1152 gfx1153 gfx1200 gfx1201 Note for gfx1200, gfx1201,make sure change the amdhip64.dll in ollama/../rocm directory from you system windows/systme32 to get the latest driver if you card did get correctly.

Note

Let's get Ollama set up!

  1. Install or Extract: Download and install Official OllamaSetup.exe ,delete the entire rocm in C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm replace the content from ollama-windows-amd64.7z from this repo.

  2. Update ROCm Libraries:

    • Find the rocblas.dll file and the rocblas/library folder within your Ollama installation folder (usually
      located at C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm).
    • Delete the existing rocblas/library folder.
    • Replace it with the correct ROCm libraries. You’ll need the right version for your GPU. You can find
      them here: ROCmLibs for 6.4.2
  3. Start Ollama: Once the ROCm libraries are updated, you can start using Ollama.

Tip

Ollama GUI App Use( in ROCm6.4) * Download Official OllamaSetup.exe and install, replace all content in C:\Users\usrname\AppData\Local\Programs\Ollama\lib\ollama\rocm from ollama-windows-amd64-rocm.7z , also make sure replace your gup-arches ROCm Libraries and rocblas.dll

If there is error log show amdgpu is not supported (supported types:[gfx1030 gfx1100 gfx1101 gfx1102 gfx906] it's means you are missing some steps . please check the above steps or possible replace the rocmlibs in your hipsdk
Full Changelog: v0.13.5...v0.14.3