Support for Apple's on-device models or Private Cloud Compute models

[iad81]

#51

Hi, is there any possibility of adding support for Apple's local, on-device AI models that ship with MacOS?
https://9to5mac.com/2025/06/11/how-do-apple-new-local-models-compare/

Additionally, with MacOS 26 Tahoe, it seems Apple let's you access their remote Private Cloud Compute models. However, I'm not sure if this is restricted to select first-party Apple apps (e.g. Shortcuts) or if third-party developers get access too.

Rather than just choosing between remote models like Gemini and local models via Ollama, I feel these additional options from Apple would strike a good compromise between privacy, cost and efficiency.

Thanks!

[nickolasclarke]

I am also curious about this. I'll probably sic claude on this to see if it can implement the feature at some point. Has anyone else tried yet?

[iad81]

Any luck with this?

[JerryZLiu]

Last i checked in the docs, they actually don't support image outputs (despite saying that they do in the marketing materials). LMK if that's wrong though!