Skip to content

Major Release: Artifact-based Binary Distribution

Latest
Latest

Choose a tag to compare

View all tags
@krishnaveti krishnaveti released this 20 Jul 18:32
· 2 commits to master since this release
v1.0.0
3af5dc1
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

What's New

  • Automatic binary downloads - No more manual building required
  • GPU auto-detection - Automatically uses CUDA when available
  • Windows x64 support - Complete toolset with all llama.cpp utilities
  • Seamless integration - Julia artifact system

Breaking Changes

  • Removed vendors/ directory - now uses artifact-based binaries
  • Removed init_apis_not_windows!() - Windows-only for now
  • Requires using LlamaCppOutlines; init_apis!() for initialization

Installation

using Pkg
Pkg.add(url="https://github.com/krishnaveti/LlamaCppOutlines.jl")
or
] LlamaCppOutlines

**Full Changelog**: https://github.com/krishnaveti/LlamaCppOutlines.jl/compare/v0.1.1...1.0.0
Assets 4
Loading