Skip to content

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

11 Commits
 
 
 
 
 
 

Repository files navigation

Pretest Task Whisper

System information

Hardware: Apple M1 Arm64, 8GB RAM
Operating System: macOS Sonoma 14.3
Kernel Version: Darwin 23.3.0

Framework execution

  1. Built and ran whisper tiny.en model by following this guide.

    Screenshot 2024-02-08 at 6 57 42 PM Screenshot 2024-02-08 at 6 57 50 PM

  2. Built WasmEdge with llama.cpp plugin by following this guide.

    wasmedge

  3. Execution(1) llama.cpp

    Modified this example to run "llama2 7b chat model in GGUF format" in WasmEdge

    llama

  4. Execution(2) API Server

    Ran Mistral-7B-Instruct-v0.1 and created an OpenAI compatible API server for the model following this guide.

    Screenshot 2024-02-17 at 6 03 54 PM

Initial work

About

Playing around with ggml, llama.cpp and whisper.cpp!

Resources

Stars

0 stars

Watchers

1 watching

Forks

Releases

Packages

Contributors