Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(llama.cpp): fix eos without cache #1852

Merged
merged 1 commit into from
Mar 18, 2024
Merged

fix(llama.cpp): fix eos without cache #1852

merged 1 commit into from
Mar 18, 2024

Conversation

mudler
Copy link
Owner

@mudler mudler commented Mar 18, 2024

Description

Backport of upstream fix

Copy link

netlify bot commented Mar 18, 2024

Deploy Preview for localai canceled.

Name Link
🔨 Latest commit ee969ca
🔍 Latest deploy log https://app.netlify.com/sites/localai/deploys/65f8709eb6aa6e0008b63288

@mudler mudler added the bug Something isn't working label Mar 18, 2024
@mudler mudler merged commit fa9e330 into master Mar 18, 2024
28 of 29 checks passed
@mudler mudler deleted the eos branch March 18, 2024 17:59
truecharts-admin added a commit to truecharts/charts that referenced this pull request Mar 19, 2024
…0.1 by renovate (#19487)

This PR contains the following updates:

| Package | Update | Change |
|---|---|---|
| [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) |
patch | `v2.10.0-cublas-cuda11-ffmpeg-core` ->
`v2.10.1-cublas-cuda11-ffmpeg-core` |
| [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) |
patch | `v2.10.0-cublas-cuda11-core` -> `v2.10.1-cublas-cuda11-core` |
| [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) |
patch | `v2.10.0-cublas-cuda12-ffmpeg-core` ->
`v2.10.1-cublas-cuda12-ffmpeg-core` |
| [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) |
patch | `v2.10.0-cublas-cuda12-core` -> `v2.10.1-cublas-cuda12-core` |
| [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) |
patch | `v2.10.0-ffmpeg-core` -> `v2.10.1-ffmpeg-core` |
| [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) |
patch | `v2.10.0` -> `v2.10.1` |

---

> [!WARNING]
> Some dependencies could not be looked up. Check the Dependency
Dashboard for more information.

---

### Release Notes

<details>
<summary>mudler/LocalAI (docker.io/localai/localai)</summary>

###
[`v2.10.1`](https://togithub.com/mudler/LocalAI/releases/tag/v2.10.1)

[Compare
Source](https://togithub.com/mudler/LocalAI/compare/v2.10.0...v2.10.1)

<!-- Release notes generated using configuration in .github/release.yml
at master -->

##### What's Changed

##### Bug fixes 🐛

- fix(llama.cpp): fix eos without cache by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#1852
- fix(config): default to debug=false if not set by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#1853
- fix(config-watcher): start only if config-directory exists by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#1854

##### Exciting New Features 🎉

- deps(whisper.cpp): update, fix cublas build by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#1846

##### Other Changes

- fixes [#&#8203;1051](https://togithub.com/mudler/LocalAI/issues/1051):
handle openai presence and request penalty parameters by
[@&#8203;blob42](https://togithub.com/blob42) in
[mudler/LocalAI#1817
- fix(make): allow to parallelize jobs by
[@&#8203;cryptk](https://togithub.com/cryptk) in
[mudler/LocalAI#1845
- fix(go-llama): use llama-cpp as default by
[@&#8203;mudler](https://togithub.com/mudler) in
[mudler/LocalAI#1849
- ⬆️ Update docs version mudler/LocalAI by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#1847
- ⬆️ Update ggerganov/llama.cpp by
[@&#8203;localai-bot](https://togithub.com/localai-bot) in
[mudler/LocalAI#1848
- test/fix: OSX Test Repair by
[@&#8203;dave-gray101](https://togithub.com/dave-gray101) in
[mudler/LocalAI#1843

**Full Changelog**:
mudler/LocalAI@v2.10.0...v2.10.1

</details>

---

### Configuration

📅 **Schedule**: Branch creation - At any time (no schedule defined),
Automerge - At any time (no schedule defined).

🚦 **Automerge**: Enabled.

♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the
rebase/retry checkbox.

🔕 **Ignore**: Close this PR and you won't be reminded about these
updates again.

---

- [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check
this box

---

This PR has been generated by [Renovate
Bot](https://togithub.com/renovatebot/renovate).

<!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzNy4yNTYuMCIsInVwZGF0ZWRJblZlciI6IjM3LjI1Ni4wIiwidGFyZ2V0QnJhbmNoIjoibWFzdGVyIn0=-->
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant