run-detectors: unable to find an interpreter for ./llava-v1.5-7b-q4-server.llamafile

[asmith26]

Hi there,

I've followed the QuickStart, but unfortunately when I get to step 4 I get the following error:

$ ./llava-v1.5-7b-q4-server.llamafile 
run-detectors: unable to find an interpreter for ./llava-v1.5-7b-q4-server.llamafile

Not sure if I'm missing something? Many thanks for any help (and this amazing lib!)

[jart]

On some Linux systems, you might get errors relating to run-detectors or WINE. This is due to binfmt_misc registrations. You can fix that by adding an additional registration for the APE file format llamafile uses:

sudo wget -O /usr/bin/ape https://cosmo.zip/pub/cosmos/bin/ape-$(uname -m).elf
sudo chmod +x /usr/bin/ape
sudo sh -c "echo ':APE:M::MZqFpD::/usr/bin/ape:' >/proc/sys/fs/binfmt_misc/register"
sudo sh -c "echo ':APE-jart:M::jartsr::/usr/bin/ape:' >/proc/sys/fs/binfmt_misc/register"

See also the Gotchas section of the README.

You should be good to go now. Enjoy llamafile! If you like it or have any other feedback later, then we're happy to hear about it.

[asmith26]

Many thanks for the detailed response @jart that worked (I seemed to have to also run sudo chown MYUSER:MYUSER /usr/bin/ape).

Regarding feedback, this is amazing!! I love the concept of being able to run an entire LLM from a single file, and it works really well (I'm very impressed with it's ability to understand/debug code!)

Regarding other feedback, a feature I would love but not sure how feasible it is speech input. (Looks like this might also be of interest to others, e.g. #17).

Many thanks again for your help, work, and an amazing lib :)

[jart]

That's so nice to hear. Feedback like that is what I live for. As for speech input, what I want you to do is leave a comment in #17 saying you want it. That'll subscribe you for updates on any progress. It also helps us plan which things to focus on. The same applies to any other issue that interests you, and other folks reading this are encouraged to do the same.

[raphael10-collab]

@jart

How to make these #47 (comment) commands long-lasting, and not required to be applied again after rebooting?