Skip to content

Paddler API Client

Choose a tag to compare

@github-actions github-actions released this 06 Feb 23:03
· 577 commits to main since this release

Features

  • Add paddler_client - Rust library to connect to Paddler
  • Embedding, and inference performance improvements
  • Update llama.cpp bindings to the latest version

Fixes

  • #140 (Can't load HF-Models with unknown model architecture)
  • #138 (Error when calling generate_embedding_batch with 2 or more objects)