Welcome — the edge AI & SLM community 👋

[sha367]

This is a place to discuss running language models on devices: phones, laptops, edge boxes.

Fair game here:

• Small language models (Llama, Qwen, Gemma, Phi and friends)
• Apple Intelligence / Foundation Models framework, Gemini Nano / AICore
• llama.cpp, MLX, quantization, GGUF
• On-device RAG, voice pipelines, private ML

House rules: be kind, show benchmarks, no hype without numbers. Everything here is public and crawlable — write answers you'd want an AI assistant to quote back to someone next year.