Skip to content
This repository has been archived by the owner on Nov 22, 2023. It is now read-only.

Commit

Permalink
document hipblas mudler/LocalAI#1100
Browse files Browse the repository at this point in the history
  • Loading branch information
mudler committed Sep 30, 2023
1 parent 5e2d084 commit 7a7e153
Showing 1 changed file with 17 additions and 1 deletion.
18 changes: 17 additions & 1 deletion content/build/_index.en.md
Original file line number Diff line number Diff line change
Expand Up @@ -119,7 +119,7 @@ List of the variables available to customize the build:

| Variable | Default | Description |
| ---------------------| ------- | ----------- |
| `BUILD_TYPE` | None | Build type. Available: `cublas`, `openblas`, `clblas`, `metal` |
| `BUILD_TYPE` | None | Build type. Available: `cublas`, `openblas`, `clblas`, `metal`,`hipblas` |
| `GO_TAGS` | `tts stablediffusion` | Go tags. Available: `stablediffusion`, `tts` |
| `CLBLAST_DIR` | | Specify a CLBlast directory |
| `CUDA_LIBPATH` | | Specify a CUDA library path |
Expand Down Expand Up @@ -148,6 +148,22 @@ make BUILD_TYPE=cublas build

More informations available in the upstream PR: https://github.com/ggerganov/llama.cpp/pull/1412

#### Hipblas (AMD GPU)

AMD GPU Acceleration

Requirement: ROCm

```
make BUILD_TYPE=hipblas build
```

Specific GPU targets can be specified with `GPU_TARGETS`:

```
make BUILD_TYPE=hipblas GPU_TARGETS=gfx90a build
```

#### ClBLAS

AMD/Intel GPU acceleration.
Expand Down

0 comments on commit 7a7e153

Please sign in to comment.