Muse Glimmer via oMLX?

[dshenster-byte]

Hi all, looking to run Muse Glimmer via oMLX. I see that 0.6.0 is the latest. Will that do it? I am on 0.5.7 now. Thanks!

[MLuc24]

Yes, 0.6.0 will do it — and 0.5.7 is the reason it doesn't work for you now, since support landed just after it.

It arrived in the 0.5.8 development line:

0.5.8.dev3 — This development release adds Meta Muse Glimmer 30B with DFlash speculative decoding…

and 0.6.0 carries it forward, per the release-candidate notes:

It rolls up every change since 0.5.7, including the 0.5.8 development releases and 0.6.0.dev1.

So going straight from 0.5.7 to 0.6.0 is the right move — you don't need to pick up a dev build to get it. The speculative decoding came in the same change, so you should also get the faster generation rather than just bare model support.