Skip to content

EdgeLLM v0.3.0 - MLCSwift Integration

Choose a tag to compare

@john-rocky john-rocky released this 01 Jul 22:39
· 71 commits to main since this release

Changes in v0.3.0

New Features

  • MLCSwift Integration: MLCSwift sources are now integrated directly into EdgeLLM
  • Objective-C++ Bridge: XCFramework now includes JSONFFIEngine bridge for proper MLCSwift support
  • Standalone Package: EdgeLLM can now run real LLM inference without external dependencies

Technical Details

  • XCFramework size: 17MB (compressed)
  • Includes all necessary MLC-LLM runtime libraries
  • Supports iOS 14.0+ on ARM64 devices
  • Checksum: ccbf13400898c99eaddbb9b82eac0174747fc462a8f6a020a838d919f6d04514

Installation

dependencies: [
    .package(url: "https://github.com/john-rocky/EdgeLLM", from: "0.3.0")
]

What's Next

  • Test real model inference on iOS devices
  • Add simulator support
  • Improve documentation