Skip to content

v0.5.2
Compare
Choose a tag to compare
@louisgv louisgv released this 03 Jul 10:35
· 17 commits to main since this release
v0.5.2
c5ff308
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

What's Changed

  • feat: Added Nous Hermes to known models by @LLukas22 in #53
  • feat: GPU inferencing, cuda for linux/windows/mac intel, metal for mac aarch64 by @louisgv in #56
  • fix: Inference on thread view will stop when swapping between route
  • fix: Properly terminate prompt feeding when stream stopped
  • feat: Inference status text/status comment
  • fix: add CUDA setup for linux and windows by @louisgv in #59
  • fix: disable gpu toggle if no GPU is available by @louisgv in #63

NOTE: GPU inferencing is only available to Mac Metal (M1/M2) ATM, see #61

local.ai.GPU.Toggle.mp4

New Contributors

Full Changelog: v0.4.0...v0.5.2

Contributors

louisgv and LLukas22
Assets 19