Hardware: Apple M1 Arm64, 8GB RAM
Operating System: macOS Sonoma 14.3
Kernel Version: Darwin 23.3.0-
Built and ran whisper tiny.en model by following this guide.

-
Built WasmEdge with llama.cpp plugin by following this guide.

-
Execution(1) llama.cpp
Modified this example to run "llama2 7b chat model in GGUF format" in WasmEdge
-
Execution(2) API Server
Ran Mistral-7B-Instruct-v0.1 and created an OpenAI compatible API server for the model following this guide.