You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I am trying to convert the SmolLM models into llamafiles in bf16 and there is something weird happening. I thought I had this working earlier today but maybe that was in f16. Looks like @jart has this working in #495 but maybe that wasn't for metal?
ggml_metal_graph_compute_block_invoke: error: unsupported op 'MUL_MAT'
GGML_ASSERT: /Users/jts/.llamafile/v/0.8.9/ggml-metal.m:946: !"unsupported op"
It hangs here and the terminal must be force quitted. Ctrl-C does nothing
Contact Details
jason.t.stillerman@gmail.com
What happened?
I am trying to convert the SmolLM models into llamafiles in bf16 and there is something weird happening. I thought I had this working earlier today but maybe that was in f16. Looks like @jart has this working in #495 but maybe that wasn't for metal?
It hangs here and the terminal must be force quitted. Ctrl-C does nothing
Here is my setup
Full logs in the "relevant log output" section
Version
llamafile v0.8.9
M2 MacBook Air 2023 Running Sonoma 14.0
What operating system are you seeing the problem on?
Mac
Relevant log output
The text was updated successfully, but these errors were encountered: