Skip to content

malaikat 0.1.0

Choose a tag to compare

View all tags
@thesimonharms thesimonharms released this 12 Aug 03:10
· 12 commits to master since this release
v0.1.0
40e269a

malaikat 0.1.0

All-in-one Windows exe for AMD Strix Halo (gfx1151) ROCm inference.

Bundled: malaikat launcher + lemonade-sdk llamacpp-rocm b1310 (Windows ROCm gfx1151).
Not bundled: GGUF model weights — pass -m or a config.

Quick start

.\malaikat-0.1.0-windows-amd64.exe serve -m path\to\moe-mtp.gguf

First run extracts the ROCm runtime to %LocalAppData%\malaikat\runtime. Optional config: see coding.example.yaml in this release.

API: http://127.0.0.1:8080/v1

Assets 4
Loading