llama-cpp-python

[Nwokike]

Hello Flet team!

I am building a local AI agent app for Android/iOS using Flet. I rely on llama-cpp-python for running local GGUF models directly on device.

Because llama-cpp-python relies on building the llama.cpp C++ engine from source, it currently throws a missing wheel error ("No matching distribution found") during the flet build apk process since there are no pre-compiled Android/iOS wheels available on PyPI.

Package Details:

• Name: llama-cpp-python
• PyPI: https://pypi.org/project/llama-cpp-python/
• Use Case: High-performance native bindings for llama.cpp. This is absolutely critical for allowing us to execute LLM inference directly on mobile devices, which is a strict requirement for offline/local-first AI applications.

Could we get llama-cpp-python added to the mobile forge (pypi.flet.dev) so we can run LLMs natively on Flet mobile?

Thank you!