fix(single-binary): bundle ld.so #2602
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
✅ Deploy Preview for localai ready!
To edit notification comments on pull requests, go to your Netlify site configuration. |
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
truecharts-admin
added a commit
to truecharts/charts
that referenced
this pull request
Jun 19, 2024
…7.1 by renovate (#23553) This PR contains the following updates: | Package | Update | Change | |---|---|---| | [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) | patch | `v2.17.0-aio-cpu` -> `v2.17.1-aio-cpu` | | [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) | patch | `v2.17.0-aio-gpu-nvidia-cuda-11` -> `v2.17.1-aio-gpu-nvidia-cuda-11` | | [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) | patch | `v2.17.0-cublas-cuda11-ffmpeg-core` -> `v2.17.1-cublas-cuda11-ffmpeg-core` | | [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) | patch | `v2.17.0-cublas-cuda11-core` -> `v2.17.1-cublas-cuda11-core` | | [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) | patch | `v2.17.0-cublas-cuda12-ffmpeg-core` -> `v2.17.1-cublas-cuda12-ffmpeg-core` | | [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) | patch | `v2.17.0-cublas-cuda12-core` -> `v2.17.1-cublas-cuda12-core` | | [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) | patch | `v2.17.0-ffmpeg-core` -> `v2.17.1-ffmpeg-core` | | [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) | patch | `v2.17.0` -> `v2.17.1` | --- > [!WARNING] > Some dependencies could not be looked up. Check the Dependency Dashboard for more information. --- ### Release Notes <details> <summary>mudler/LocalAI (docker.io/localai/localai)</summary> ### [`v2.17.1`](https://togithub.com/mudler/LocalAI/releases/tag/v2.17.1) [Compare Source](https://togithub.com/mudler/LocalAI/compare/v2.17.0...v2.17.1) ##### Highlights This is a patch release to address issues with Linux single binary releases. It also adds support for Stable diffusion 3! ##### Stable diffusion 3 You can use Stable diffusion 3 by installing the model in the gallery (`stable-diffusion-3-medium`) or by placing this YAML file in the model folder: ```yaml backend: diffusers diffusers: cuda: true enable_parameters: negative_prompt,num_inference_steps pipeline_type: StableDiffusion3Pipeline f16: false name: sd3 parameters: model: v2ray/stable-diffusion-3-medium-diffusers step: 25 ``` You can try then generating an image: http://localhost:9091/v1/images/generations -H "Content-Type: application/json" -d '{ "prompt": "A cute baby sea otter", "model": "sd3" } Example result:  ##### What's Changed ##### Bug fixes 🐛 - fix(single-binary): bundle ld.so by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#2602 ##### Exciting New Features 🎉 - feat(sd-3): add stablediffusion 3 support by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#2591 - feat(talk): display an informative box, better colors by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#2600 ##### 📖 Documentation and examples - ⬆️ Update docs version mudler/LocalAI by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#2593 ##### 👒 Dependencies - ⬆️ Update ggerganov/llama.cpp by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#2594 ##### Other Changes - ⬆️ Update ggerganov/llama.cpp by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#2603 **Full Changelog**: mudler/LocalAI@v2.17.0...v2.17.1 </details> --- ### Configuration 📅 **Schedule**: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined). 🚦 **Automerge**: Enabled. ♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox. 🔕 **Ignore**: Close this PR and you won't be reminded about these updates again. --- - [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check this box --- This PR has been generated by [Renovate Bot](https://togithub.com/renovatebot/renovate). <!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzNy40MTMuMSIsInVwZGF0ZWRJblZlciI6IjM3LjQxMy4xIiwidGFyZ2V0QnJhbmNoIjoibWFzdGVyIiwibGFiZWxzIjpbImF1dG9tZXJnZSIsInVwZGF0ZS9kb2NrZXIvZ2VuZXJhbC9ub24tbWFqb3IiXX0=-->
truecharts-admin
added a commit
to truecharts/charts
that referenced
this pull request
Jun 22, 2024
…7.1@4d8b84a by renovate (#23568) This PR contains the following updates: | Package | Update | Change | |---|---|---| | [docker.io/localai/localai](https://togithub.com/mudler/LocalAI) | patch | `v2.17.0-aio-gpu-nvidia-cuda-12` -> `v2.17.1-aio-gpu-nvidia-cuda-12` | --- > [!WARNING] > Some dependencies could not be looked up. Check the Dependency Dashboard for more information. --- ### Release Notes <details> <summary>mudler/LocalAI (docker.io/localai/localai)</summary> ### [`v2.17.1`](https://togithub.com/mudler/LocalAI/releases/tag/v2.17.1) [Compare Source](https://togithub.com/mudler/LocalAI/compare/v2.17.0...v2.17.1) #### Highlights This is a patch release to address issues with Linux single binary releases. It also adds support for Stable diffusion 3! ##### Stable diffusion 3 You can use Stable diffusion 3 by installing the model in the gallery (`stable-diffusion-3-medium`) or by placing this YAML file in the model folder: ```yaml backend: diffusers diffusers: cuda: true enable_parameters: negative_prompt,num_inference_steps pipeline_type: StableDiffusion3Pipeline f16: false name: sd3 parameters: model: v2ray/stable-diffusion-3-medium-diffusers step: 25 ``` You can try then generating an image: http://localhost:9091/v1/images/generations -H "Content-Type: application/json" -d '{ "prompt": "A cute baby sea otter", "model": "sd3" } Example result:  #### What's Changed ##### Bug fixes 🐛 - fix(single-binary): bundle ld.so by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#2602 ##### Exciting New Features 🎉 - feat(sd-3): add stablediffusion 3 support by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#2591 - feat(talk): display an informative box, better colors by [@​mudler](https://togithub.com/mudler) in [mudler/LocalAI#2600 ##### 📖 Documentation and examples - ⬆️ Update docs version mudler/LocalAI by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#2593 ##### 👒 Dependencies - ⬆️ Update ggerganov/llama.cpp by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#2594 ##### Other Changes - ⬆️ Update ggerganov/llama.cpp by [@​localai-bot](https://togithub.com/localai-bot) in [mudler/LocalAI#2603 **Full Changelog**: mudler/LocalAI@v2.17.0...v2.17.1 </details> --- ### Configuration 📅 **Schedule**: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined). 🚦 **Automerge**: Enabled. ♻ **Rebasing**: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox. 🔕 **Ignore**: Close this PR and you won't be reminded about this update again. --- - [ ] <!-- rebase-check -->If you want to rebase/retry this PR, check this box --- This PR has been generated by [Renovate Bot](https://togithub.com/renovatebot/renovate). <!--renovate-debug:eyJjcmVhdGVkSW5WZXIiOiIzNy40MTMuMSIsInVwZGF0ZWRJblZlciI6IjM3LjQxMy4xIiwidGFyZ2V0QnJhbmNoIjoibWFzdGVyIiwibGFiZWxzIjpbImF1dG9tZXJnZSIsInVwZGF0ZS9kb2NrZXIvZ2VuZXJhbC9ub24tbWFqb3IiXX0=-->
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
This PR fixes single binary execution on linux systems by adding the
ld.sofile to the libraries.Context As we bundle libs when running in single-binary mode and we use
LD_LIBRARY_PATHto point to the .so files, we need also to run them with the associatedld.sofile to avoid hitting stack smash.Note This affects ONLY Linux builds (both arm64 and amd64)