Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(build): add arm64 core containers #2421

Merged
merged 1 commit into from
May 28, 2024
Merged

feat(build): add arm64 core containers #2421

merged 1 commit into from
May 28, 2024

Conversation

mudler
Copy link
Owner

@mudler mudler commented May 27, 2024

Description

Related to #1249

Notes for Reviewers

Signed commits

  • Yes, I signed my commits.

Copy link

netlify bot commented May 27, 2024

Deploy Preview for localai canceled.

Name Link
🔨 Latest commit f011cce
🔍 Latest deploy log https://app.netlify.com/sites/localai/deploys/665586e7be482a0008d9c244

@mudler mudler changed the title ci: add more hipblas targets,arm64 build: add more hipblas targets,arm64 May 27, 2024
@mudler mudler force-pushed the ci_tests branch 3 times, most recently from 8d2e372 to cde1f6f Compare May 27, 2024 16:33
@mudler mudler changed the title build: add more hipblas targets,arm64 feat(build): add arm64 core containers May 27, 2024
@mudler mudler force-pushed the ci_tests branch 2 times, most recently from 3d6eabf to 322f12c Compare May 27, 2024 20:10
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
@mudler mudler marked this pull request as ready for review May 28, 2024 07:37
@mudler mudler merged commit 2bbc52f into master May 28, 2024
36 checks passed
@mudler mudler deleted the ci_tests branch May 28, 2024 08:35
@mudler mudler added the enhancement New feature or request label Jun 13, 2024
truecharts-admin added a commit to truecharts/charts that referenced this pull request Jun 18, 2024
…7.0 by renovate (#23480)

This PR contains the following updates:

| Package | Update | Change |
|---|---|---|
| [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) |
minor | `v2.16.0-aio-cpu` -> `v2.17.0-aio-cpu` |
| [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) |
minor | `v2.16.0-cublas-cuda11-ffmpeg-core` ->
`v2.17.0-cublas-cuda11-ffmpeg-core` |
| [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) |
minor | `v2.16.0-cublas-cuda11-core` -> `v2.17.0-cublas-cuda11-core` |
| [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) |
minor | `v2.16.0-cublas-cuda12-ffmpeg-core` ->
`v2.17.0-cublas-cuda12-ffmpeg-core` |
| [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) |
minor | `v2.16.0-cublas-cuda12-core` -> `v2.17.0-cublas-cuda12-core` |
| [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) |
minor | `v2.16.0-ffmpeg-core` -> `v2.17.0-ffmpeg-core` |
| [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) |
minor | `v2.16.0` -> `v2.17.0` |

---

> [!WARNING]
> Some dependencies could not be looked up. Check the Dependency
Dashboard for more information.

---

### Release Notes

<details>
<summary>mudler/LocalAI (docker.io/localai/localai)</summary>

###
[`v2.17.0`](https://togithub.com/mudler/LocalAI/releases/tag/v2.17.0)

[Compare
Source](https://togithub.com/mudler/LocalAI/compare/v2.16.0...v2.17.0)

![local-ai-release-2
17-shadow](https://togithub.com/mudler/LocalAI/assets/2420543/69025f5a-96bd-4ffa-9862-6e651c71345d)
Ahoj! this new release of LocalAI comes with tons of updates, and
enhancements behind the scenes!

##### 🌟 Highlights TLDR;

-   Automatic identification of GGUF models
-   New WebUI page to talk with an LLM!
-   https://models.localai.io is live! 🚀
-   Better arm64 and Apple silicon support
-   More models to the gallery!
-   New quickstart installer script
-   Enhancements to mixed grammar support
-   Major improvements to transformers
-   Linux single binary now supports rocm, nvidia, and intel

##### 🤖 Automatic model identification for llama.cpp-based models

Just drop your GGUF files into the model folders, and let LocalAI handle
the configurations. YAML files are now reserved for those who love to
tinker with advanced setups.

##### 🔊 Talk to your LLM!

Introduced a new page that allows direct interaction with the LLM using
audio transcription and TTS capabilities. This feature is so fun - now
you can just talk with any LLM with a couple of clicks away.
![Screenshot from 2024-06-08
12-44-41](https://togithub.com/mudler/LocalAI/assets/2420543/c7926eb9-b91f-47dd-be32-68fdb10e6bc7)

##### 🍏 Apple single-binary

Experience enhanced support for the Apple ecosystem with a comprehensive
single-binary that packs all necessary libraries, ensuring LocalAI runs
smoothly on MacOS and ARM64 architectures.

##### ARM64

Expanded our support for ARM64 with new Docker images and single binary
options, ensuring better compatibility and performance on ARM-based
systems.

Note: currently we support only arm core images, for instance:
`localai/localai:master-ffmpeg-core`,
`localai/localai:latest-ffmpeg-core`,
`localai/localai:v2.17.0-ffmpeg-core`.

##### 🐞 Bug Fixes and small enhancements

We’ve ironed out several issues, including image endpoint response types
and other minor problems, boosting the stability and reliability of our
applications. It is now also possible to enable CSRF when starting
LocalAI, thanks to
[@&#8203;dave-gray101](https://togithub.com/dave-gray101).

##### 🌐 Models and Galleries

Enhanced the model gallery with new additions like Mirai Nova, Mahou,
and several updates to existing models ensuring better performance and
accuracy.

Now you can check new models also in https://models.localai.io, without
running LocalAI!

##### Installation and Setup

A new install.sh script is now available for quick and hassle-free
installations, streamlining the setup process for new users.

    curl https://localai.io/install.sh | sh

Installation can be configured with Environment variables, for example:

    curl https://localai.io/install.sh | VAR=value sh

List of the Environment Variables:

- DOCKER_INSTALL: Set to "true" to enable the installation of Docker
images.
-   USE_AIO: Set to "true" to use the all-in-one LocalAI Docker image.
-   API_KEY: Specify an API key for accessing LocalAI, if required.
-   CORE_IMAGES: Set to "true" to download core LocalAI images.
- PORT: Specifies the port on which LocalAI will run (default is 8080).
- THREADS: Number of processor threads the application should use.
Defaults to the number of logical cores minus one.
- VERSION: Specifies the version of LocalAI to install. Defaults to the
latest available version.
- MODELS_PATH: Directory path where LocalAI models are stored (default
is /usr/share/local-ai/models).

We are looking into improving the installer, and as this is a first
iteration any feedback is welcome! Open up an
[issue](https://togithub.com/mudler/LocalAI/issues/new/choose) if
something doesn't work for you!

##### Enhancements to mixed grammar support

Mixed grammar support continues receiving improvements behind the
scenes.

##### 🐍  Transformers backend enhancements

-   Temperature = 0 correctly handled as greedy search
-   Handles custom words as stop words
-   Implement KV cache
-   Phi 3 no more requires `trust_remote_code: true` flag

Shout-out to [@&#8203;fakezeta](https://togithub.com/fakezeta) for these
enhancements!

##### Install models with the CLI

Now the CLI can install models directly from the gallery. For instance:

    local-ai run <model_name_in gallery>

This command ensures the model is installed in the model folder at
startup.

##### 🐧 Linux single binary now supports rocm, nvidia, and intel

Single binaries for Linux now contain Intel, AMD GPU, and NVIDIA
support. Note that you need to install the dependencies separately in
the system to leverage these features. In upcoming releases, this
requirement will be handled by the installer script.

##### 📣 Let's Make Some Noise!

A gigantic THANK YOU to everyone who’s contributed—your feedback, bug
squashing, and feature suggestions are what make LocalAI shine. To all
our heroes out there supporting other users and sharing their expertise,
you’re the real MVPs!

Remember, LocalAI thrives on community support—not big corporate bucks.
If you love what we're building, show some love! A shoutout on social
(@&#8203;LocalAI_OSS and @&#8203;mudler_it on twitter/X), joining our
sponsors, or simply starring us on GitHub makes all the difference.

Also, if you haven't yet joined our Discord, come on over! Here's the
link: https://discord.gg/uJAeKSAGDy

Thanks a ton, and.. enjoy this release!

##### What's Changed

##### Bug fixes 🐛

- fix: gpu fetch device info by
[@&#8203;sozercan](https://togithub.com/sozercan) in
[mudler/LocalAI#2403
- fix(watcher): do not emit fatal errors by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2410
- fix: install pytorch from proper index for hipblas builds by
[@&#8203;cryptk](https://togithub.com/cryptk) in
[mudler/LocalAI#2413
- fix: pin version of setuptools for intel builds to work around
[#&#8203;2406](https://togithub.com/mudler/LocalAI/issues/2406) by
[@&#8203;cryptk](https://togithub.com/cryptk) in
[mudler/LocalAI#2414
- bugfix: CUDA acceleration not working by
[@&#8203;fakezeta](https://togithub.com/fakezeta) in
[mudler/LocalAI#2475
- fix: `pkg/downloader` should respect basePath for `file://` urls by
[@&#8203;dave-gray101](https://togithub.com/dave-gray101) in
[mudler/LocalAI#2481
- fix: chat webui response parsing by
[@&#8203;sozercan](https://togithub.com/sozercan) in
[mudler/LocalAI#2515
- fix(stream): do not break channel consumption by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2517
- fix(Makefile): enable STATIC on dist by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2569

##### Exciting New Features 🎉

- feat(images): do not install python deps in the core image by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2425
- feat(hipblas): extend default hipblas GPU_TARGETS by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2426
- feat(build): add arm64 core containers by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2421
- feat(functions): allow parallel calls with mixed/no grammars by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2432
- feat(image): support `response_type` in the OpenAI API request by
[@&#8203;prajwalnayak7](https://togithub.com/prajwalnayak7) in
[mudler/LocalAI#2347
- feat(swagger): update swagger by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2436
- feat(functions): better free string matching, allow to expect strings
after JSON by [@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2445
- build(Makefile): add back single target to build native llama-cpp by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2448
- feat(functions): allow `response_regex` to be a list by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2447
- TTS API improvements by [@&#8203;blob42](https://togithub.com/blob42)
in
[mudler/LocalAI#2308
- feat(transformers): various enhancements to the transformers backend
by [@&#8203;fakezeta](https://togithub.com/fakezeta) in
[mudler/LocalAI#2468
- feat(webui): enhance card visibility by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2473
- feat(default): use number of physical cores as default by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2483
- feat: fiber CSRF by
[@&#8203;dave-gray101](https://togithub.com/dave-gray101) in
[mudler/LocalAI#2482
- feat(amdgpu): try to build in single binary by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2485
- feat:`OpaqueErrors` to hide error information by
[@&#8203;dave-gray101](https://togithub.com/dave-gray101) in
[mudler/LocalAI#2486
- build(intel): bundle intel variants in single-binary by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2494
- feat(install): add install.sh for quick installs by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2489
- feat(llama.cpp): guess model defaults from file by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2522
- feat(ui): add page to talk with voice, transcription, and tts by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2520
- feat(arm64): enable single-binary builds by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2490
- feat(util): add util command to print GGUF informations by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2528
- feat(defaults): add defaults for Command-R models by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2529
- feat(detection): detect by template in gguf file, add qwen2, phi,
mistral and chatml by [@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2536
- feat(gallery): show available models in website, allow `local-ai
models install` to install from galleries by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2555
- feat(gallery): uniform download from CLI by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2559
- feat(guesser): identify gemma models by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2561
- feat(binary): support extracted bundled libs on darwin by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2563
- feat(darwin): embed grpc libs by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2567
- feat(build): bundle libs for arm64 and x86 linux binaries by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2572
- feat(libpath): refactor and expose functions for external library
paths by [@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2578

##### 🧠 Models

- models(gallery): add Mirai Nova by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2405
- models(gallery): add Mahou by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2411
- models(gallery): add minicpm by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2412
- models(gallery): add poppy porpoise 0.85 by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2415
- models(gallery): add alpha centauri by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2416
- models(gallery): add cream-phi-13b by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2417
- models(gallery): add stheno-mahou by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2418
- models(gallery): add iterative-dpo, fix minicpm by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2422
- models(gallery): add una-thepitbull by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2435
- models(gallery): add halu by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2434
- models(gallery): add neuraldaredevil by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2439
- models(gallery): add Codestral by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2442
- models(gallery): add mopeymule by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2449
- models(gallery): ⬆️ update checksum by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2451
- models(gallery): add anjir by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2454
- models(gallery): add llama3-11b by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2455
- models(gallery): add ultron by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2456
- models(gallery): add poppy porpoise 1.0 by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2459
- models(gallery): add Neural SOVLish Devil by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2460
- models(gallery): add all whisper variants by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2462
- models(gallery): ⬆️ update checksum by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2463
- models(gallery): add gemma-2b by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2466
- models(gallery): add fimbulvetr iqmatrix version by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2470
- models(gallery): add new poppy porpoise versions by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2471
- models(gallery): add dolphin-2.9.2-Phi-3-Medium by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2492
- models(gallery): add dolphin-2.9.2-phi-3-Medium-abliterated by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2495
- models(gallery): add nyun by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2496
- models(gallery): add phi-3-4x4b by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2497
- models(gallery): add llama-3-instruct-8b-SimPO-ExPO by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2498
- models(gallery): add Llama-3-Yggdrasil-2.0-8B by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2499
- models(gallery): add l3-8b-stheno-v3.2-iq-imatrix by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2500
- models(gallery): add llama3-8B-aifeifei-1.0-iq-imatrix by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2509
- models(gallery): add rawr_llama3\_8b-iq-imatrix by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2510
- models(gallery): add llama3-8b-feifei-1.0-iq-imatrix by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2511
- models(gallery): ⬆️ update checksum by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2519
- models(gallery): add llama3-8B-aifeifei-1.2-iq-imatrix by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2544
- models(gallery): add hathor-l3-8b-v.01-iq-imatrix by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2545
- models(gallery): add l3-aethora-15b by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2546
- models(gallery): add llama-salad-8x8b by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2547
- models(gallery): add average_normie_v3.69\_8b-iq-imatrix by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2548
- models(gallery): add duloxetine by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2549
- models(gallery): add badger-lambda-llama-3-8b by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2550
- models(gallery): add firefly-gemma-7b by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2576
- models(gallery): add dolphin-qwen by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2580
- models(gallery): add tess-v2.5-phi-3-medium-128k-14b by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2581
- models(gallery): add hathor_stable-v0.2-l3-8b by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2582
- models(gallery): add samantha-qwen2 by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2586
- models(gallery): add gemma-1.1-7b-it by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2588

##### 📖 Documentation and examples

- Update quickstart.md by [@&#8203;mudler](https://togithub.com/mudler)
in
[mudler/LocalAI#2404
- docs: fix p2p commands by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2472
- README: update sponsors list by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2476
- Add integrations by [@&#8203;reid41](https://togithub.com/reid41) in
[mudler/LocalAI#2535
- docs(gallery): lazy-load images by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2557
- Fix standard image latest Docker tags by
[@&#8203;nwithan8](https://togithub.com/nwithan8) in
[mudler/LocalAI#2574

##### 👒 Dependencies

- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2399
- ⬆️ Update docs version mudler/LocalAI by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2398
- ⬆️ Update ggerganov/whisper.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2408
- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2409
- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2419
- ⬆️ Update ggerganov/whisper.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2427
- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2428
- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2433
- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2437
- ⬆️ Update ggerganov/whisper.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2438
- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2444
- ⬆️ Update ggerganov/whisper.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2443
- ⬆️ Update ggerganov/whisper.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2452
- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2453
- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2465
- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2467
- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2477
- toil: bump grpc version by
[@&#8203;dave-gray101](https://togithub.com/dave-gray101) in
[mudler/LocalAI#2480
- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2487
- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2493
- deps(whisper): update, add libcufft-dev by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2501
- ⬆️ Update ggerganov/whisper.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2507
- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2508
- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2518
- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2524
- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2531
- chore(deps): Update Dockerfile by
[@&#8203;reneleonhardt](https://togithub.com/reneleonhardt) in
[mudler/LocalAI#2532
- ⬆️ Update ggerganov/whisper.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2539
- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2540
- ⬆️ Update ggerganov/whisper.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2552
- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2551
- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2554
- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2564
- ⬆️ Update ggerganov/whisper.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2565
- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2570
- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2575
- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2584
- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2587

##### Other Changes

- ci: fix sd release by
[@&#8203;sozercan](https://togithub.com/sozercan) in
[mudler/LocalAI#2400
- ci(grpc-cache): also arm64 by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2423
- ci: push test images when building PRs by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2424
- ci: pin build-time protoc by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2461
- feat(swagger): update swagger by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#2464
- ci: run release build on self-hosted runners by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2505
- experiment: `-j4` for `build-linux:` by
[@&#8203;dave-gray101](https://togithub.com/dave-gray101) in
[mudler/LocalAI#2514
- test: e2e /reranker endpoint by
[@&#8203;dave-gray101](https://togithub.com/dave-gray101) in
[mudler/LocalAI#2211
- ci: pack less libs inside the binary by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#2579

##### New Contributors

- [@&#8203;prajwalnayak7](https://togithub.com/prajwalnayak7) made their
first contribution in
[mudler/LocalAI#2347
- [@&#8203;reneleonhardt](https://togithub.com/reneleonhardt) made their
first contribution in
[mudler/LocalAI#2532
- [@&#8203;reid41](https://togithub.com/reid41) made their first
contribution in
[mudler/LocalAI#2535
- [@&#8203;nwithan8](https://togithub.com/nwithan8) made their first
contribution in
[mudler/LocalAI#2574

**Full Changelog**:
mudler/LocalAI@v2.16.0...v2.17.0

</details>

---

### Configuration

📅 **Schedule**: Branch creation - At any time (no schedule defined),
Automerge - At any time (no schedule defined).

🚦 **Automerge**: Enabled.

♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the
rebase/retry checkbox.

🔕 **Ignore**: Close this PR and you won't be reminded about these
updates again.

---

- [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check
this box

---

This PR has been generated by [Renovate
Bot](https://togithub.com/renovatebot/renovate).

<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzNy40MTAuMiIsInVwZGF0ZWRJblZlciI6IjM3LjQxMC4yIiwidGFyZ2V0QnJhbmNoIjoibWFzdGVyIiwibGFiZWxzIjpbImF1dG9tZXJnZSIsInVwZGF0ZS9kb2NrZXIvZ2VuZXJhbC9ub24tbWFqb3IiXX0=-->
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant