EdgeLLM v0.1.0 - Initial Release

EdgeLLM v0.1.0 - Initial Release

The first release of EdgeLLM - Simple LLM SDK for iOS

✨ Features

• One-line LLM usage: EdgeLLM.chat("Hello!")
• Supported Models: Llama 3.2 (3B), Gemma 2 (2B), Phi-3.5 Mini
• Streaming responses with AsyncStream support
• Automatic model management and caching
• Metal GPU acceleration for optimal performance
• Privacy-first: Everything runs on-device

📦 Installation

Swift Package Manager

dependencies: [
    .package(url: "https://github.com/john-rocky/EdgeLLM.git", from: "0.1.0")
]

Binary Distribution

For pre-built XCFramework, download EdgeLLM-Bundle.zip below.

• Size: 7.9MB
• Checksum: bc9188ab45b36f6a071cce7e1c9196ccf84c2cdc2dfcd51c33518f10db4ed8e5

🚀 Quick Start

import EdgeLLM

// Simple one-liner
let response = try await EdgeLLM.chat("Hello, world!")

// With streaming
for try await token in EdgeLLM.stream("Tell me a story") {
    print(token, terminator: "")
}

📋 Requirements

• iOS 14.0+
• Xcode 15.0+
• ~2GB free space for models

📖 Documentation

See the README for detailed documentation.