Skip to content

erllama 0.10.1

Choose a tag to compare

@benoitc benoitc released this 23 Aug 15:01
· 11 commits to main since this release

Fixed

  • chat/3 and chat_apply/3 hand tools to llama.cpp in the OpenAI
    shape ({"type": "function", "function": {...}}); the flat
    chat_tool() maps were rejected with chat_parse_failed.
  • erllama_chat_SUITE starts the application with its dependencies when
    run on its own.

Added

  • Load option chat_template: Jinja source replacing the template
    stored in the GGUF for chat/3 / chat_apply/3.
  • examples/agent_loop: a tool-calling agent loop on chat/3.