Skip to content

v1.1.0

Choose a tag to compare

View all tags
@pmlugato pmlugato released this 12 Aug 03:31
· 1122 commits to main since this release
v1.1.0
67e59c4
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

v1.1.0 Release Notes

Performance:

  • vLLM implemented for orders of magnitude faster inference when running open source models on GPU. Control how many GPUs to run distributed on, or how much memory to allocate to vLLM, and more, all via the configuration file
  • Better and more robust handling of chat history so A2rchi "remembers" conversations more accurately
  • Host mode option for container networking

Interfaces and Integrations:

  • Scraper to get behind CERN SSO (+ base SSO class to build other SSO scrapers on)
  • Jira interface added to store tickets from a specified URL and project into vector database
  • Redmine service integrated with Postgres and Grafana monitoring
  • Vanilla Mattermost interface has been implemented
  • Grafana monitoring upgraded, including now formatted history and context, amongst other changes

General:

  • Various bug fixes and stability improvements
  • User guide updated

Developer:

  • Improved and uniformized logging in containers
  • Templated prompts and LLM outputs now nicely organized in chain_input_output_log, stored in container volume, for studies/further debugging
Assets 2
Loading