Skip to content

Releases: alertavert/bertrand

Increase context size

Choose a tag to compare

@massenz massenz released this 14 Jan 07:20
df127f8

The previous chunk size of 512 tokens appeared to be too limiting for a good match on the prompt.

  • adopted the threshold on the embeddings match;
  • increased chunk size when parsing PDFs to 1,024 tokens;
  • other minor bug fixes.

The model appears to be more responsive when prompted with questions that do match the subject matter of tech articles fed in the Vector DB.

Initial Release

Initial Release Pre-release
Pre-release

Choose a tag to compare

@massenz massenz released this 07 Jan 08:09
4029c53

First iteration of application:

  • support Vector DB searches (Qdrant)
  • support Ollama running Llama 3.2 locally
  • basic UI for file upload & query
  • basic conversation management (in-memory storage)

screenshot