Skip to content

Release v6.2.2#319

Merged
jeremyfowers merged 2 commits intomainfrom
release_622
May 2, 2025
Merged

Release v6.2.2#319
jeremyfowers merged 2 commits intomainfrom
release_622

Conversation

@jeremyfowers
Copy link
Collaborator

Server Improvements

v6.2.2 is focused on improvements for 🍋Lemonade Server users and app developers.

  • LLMs can be downloaded after Lemonade Server installation using lemonade-server pull MODEL_NAME (@jeremyfowers)
    • Users can find a list of supported LLMs here.
    • Developers can programmatically access a list of supported LLMs here.
  • New supported models:
    • 6 new AWQ OGA+CPU models, enabling performant and lightweight support for non-STX systems (@iswaryaalex)
    • Mistral-7B-v0.3-Instruct-Hybrid and Llama-3.1-8B-Instruct-Hybrid (@jeremyfowers)
  • Stop any running Lemonade Server process using lemonade-server stop (@danielholanda)
  • Lemonade Server works in offline mode (@ramkrishna2910)

Additional Improvements

  • A new Lemonade Server integration guide, for using Mindcraft to add LLM-controlled NPCs to Minecraft (@itomek)
  • Add response length to bench statistics and improve Quark installation process (@amd-pworfolk)

New Contributors

@itomek made their first contribution!

@jeremyfowers jeremyfowers self-assigned this May 2, 2025
Signed-off-by: Jeremy Fowers <80718789+jeremyfowers@users.noreply.github.com>
@jeremyfowers jeremyfowers marked this pull request as ready for review May 2, 2025 15:46
@jeremyfowers jeremyfowers merged commit db73728 into main May 2, 2025
17 checks passed
@jeremyfowers jeremyfowers deleted the release_622 branch May 2, 2025 16:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants