1 Release published by 1 person

• v3.0.0

  published Jun 19, 2025

30 Pull requests merged by 8 people

• Fix Typos and Improve Clarity in GPU Acceleration Documentation

  #5688 merged Jun 19, 2025

• chore: ⬆️ Update ggml-org/whisper.cpp to ecb8f3c2b4e282d5ef416516bcbfb92821f06bf6

  #5686 merged Jun 19, 2025

• chore: ⬆️ Update ggml-org/llama.cpp to 8d947136546773f6410756f37fcc5d3e65b8135d

  #5685 merged Jun 19, 2025

• feat(backend gallery): display download progress

  #5687 merged Jun 18, 2025

• Fix Typos in Documentation and Python Comments

  #5658 merged Jun 18, 2025

• fix(backends gallery): propagate p2p settings to correctly draw menu

  #5684 merged Jun 18, 2025

• chore(ci): move also other jobs to public runner

  #5683 merged Jun 18, 2025

• chore(ci): try to use public runners also for release builds

  #5681 merged Jun 18, 2025

• chore(backends): move bark-cpp to the backend gallery

  #5682 merged Jun 18, 2025

• chore: ⬆️ Update ggml-org/llama.cpp to 860a9e4eeff3eb2e7bd1cc38f65787cc6c8177af

  #5678 merged Jun 18, 2025

• chore: ⬆️ Update ggml-org/whisper.cpp to f3ff80ea8da044e5b8833e7ba54ee174504c518d

  #5677 merged Jun 18, 2025

• chore(ci): switch to public runners for base images

  #5680 merged Jun 17, 2025

• chore(backend gallery): add description for remaining backends

  #5679 merged Jun 17, 2025

• chore(backend gallery): re-order and add description for vLLM

  #5676 merged Jun 17, 2025

• chore(deps): bump llama.cpp to 'e434e69183fd9e1031f4445002083178c331a28b

  #5665 merged Jun 17, 2025

• chore: ⬆️ Update ggml-org/whisper.cpp to 2a4d6db7d90899aff3d58d70996916968e4e0d27

  #5661 merged Jun 17, 2025

• chore(deps): bump securego/gosec from 2.22.4 to 2.22.5

  #5663 merged Jun 16, 2025

• fix: add python symlink, use absolute python env path when running backends

  #5664 merged Jun 16, 2025

• chore: Add python3 to images

  #5660 merged Jun 16, 2025

• chore(ci): use public runner for extra backends

  #5657 merged Jun 16, 2025

• chore: ⬆️ Update ggml-org/llama.cpp to 30e5b01de2a0bcddc7c063c8ef0802703a958417

  #5659 merged Jun 15, 2025

• Fix Typos and Improve Documentation Clarity

  #5648 merged Jun 15, 2025

• chore: ⬆️ Update ggml-org/llama.cpp to 3cb203c89f60483e349f841684173446ed23c28f

  #5644 merged Jun 15, 2025

• feat: Add backend gallery

  #5607 merged Jun 15, 2025

• chore: ⬆️ Update ggml-org/whisper.cpp to 705db0f728310c32bc96f4e355e2b18076932f75

  #5643 merged Jun 15, 2025

• chore: improve tests

  #5646 merged Jun 14, 2025

• Minor Documentation Updates: Clarified Comments in Python and Go Files

  #5641 merged Jun 13, 2025

• docs: Update docs metadata headers so when mentioned on slack it doesn't say hugo

  #5642 merged Jun 13, 2025

• chore: ⬆️ Update ggml-org/llama.cpp to ed52f3668e633423054a4eab61bb7efee47025ab

  #5636 merged Jun 12, 2025

• chore(model gallery): add yanfei-v2-qwen3-32b

  #5639 merged Jun 12, 2025

9 Pull requests opened by 1 person

• chore(deps): bump torch from 2.4.1 to 2.7.1 in /backend/python/exllama2 in the pip group

  #5666 opened Jun 17, 2025

• chore(deps): bump torch from 2.3.1+cxx11.abi to 2.7.1 in /backend/python/coqui in the pip group

  #5667 opened Jun 17, 2025

• chore(deps): bump torch from 2.3.1+cxx11.abi to 2.7.1 in /backend/python/common/template in the pip group

  #5668 opened Jun 17, 2025

• chore(deps): bump torch from 2.3.1+cxx11.abi to 2.7.1 in /backend/python/rerankers in the pip group

  #5669 opened Jun 17, 2025

• chore(deps): bump the pip group across 3 directories with 1 update

  #5670 opened Jun 17, 2025

• chore(deps): bump torch from 2.3.1+cxx11.abi to 2.7.1 in /backend/python/bark in the pip group

  #5671 opened Jun 17, 2025

• chore(deps): bump torch from 2.3.1+cxx11.abi to 2.7.1 in /backend/python/diffusers in the pip group

  #5672 opened Jun 17, 2025

• chore(deps): bump the pip group in /backend/python/transformers with 2 updates

  #5673 opened Jun 17, 2025

• chore(deps): bump torch from 2.7.0 to 2.7.1 in /backend/python/vllm in the pip group

  #5674 opened Jun 17, 2025

2 Issues closed by 2 people

• Can't re-enable SYCL in stablediffusion until GGML is updated upstream

  #5132 closed Jun 17, 2025

• Install backends from WebUI

  #3953 closed Jun 15, 2025

1 Issue opened by 1 person

• Downloading Model fails for some models like arch-function-7b

  #5640 opened Jun 13, 2025

6 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• Stuck in Function Call Loop

  #3882 commented on Jun 13, 2025 • 0 new comments

• panic: interface conversion: interface {} is []interface {}, not string with OpenAI compatible function defintion

  #5572 commented on Jun 17, 2025 • 0 new comments

• Add support for realtime API

  #3714 commented on Jun 17, 2025 • 0 new comments

• /usr/bin/ld: cannot find -lucd: No such file or directory

  #3770 commented on Jun 18, 2025 • 0 new comments

• chore: :arrow_up: Update PABannier/bark.cpp to `5d5be84f089ab9ea53b7a793f088d3fbf7247495`

  #4786 commented on Jun 18, 2025 • 0 new comments

• chore: :arrow_up: Update leejet/stable-diffusion.cpp to `10c6501bd05a697e014f1bee3a84e5664290c489`

  #4925 commented on Jun 18, 2025 • 0 new comments