Skip to content

0.5.0
Compare
Choose a tag to compare
@choccccy choccccy released this 05 Oct 18:04
· 260 commits to main since this release
0.5.0
f4121b9
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

What's Changed

Added

  • GGUF support in download-model.py
  • Switch to a class-based wrapper for LLM endpoints/handlers - #39
  • Add support for in-memory LLM loading via ctransformers
  • Added postgreSGL vector support to embedding_helper.py as new Class PGvectorConnection
    • PGvectorConnection is a wrapper around asyncpg, and is primarily just capable of excecuting raw SQL queries right now.
    • There are a few common SQL queries included in the class for using PGv as a vector database, but they are not yet fully tested.
    • Added a demonstration notebook which uses PGvectorConnection to do similarity search

Full Changelog: 0.4.1...0.5.0

Assets 2
Loading