Releases: sozercan/aikit
Releases · sozercan/aikit
v0.11.1
Notable Changes
- 💪 Multi-platform images with ARM64 support! All pre-made models include both AMD64 and ARM64 platform support.
- 📦 Support for models from OCI Artifacts. For example, use models from ollama by simply running:
docker buildx build -t my-model --load \
--build-arg="model=oci://registry.ollama.ai/library/llama3:8b" \
"https://raw.githubusercontent.com/sozercan/aikit/main/models/aikitfile.yaml"
docker run -d --rm -p 8080:8080 my-model
curl http://localhost:8080/v1/chat/completions \
-H "Content-Type: application/json" \
-d '{
"model": "llama3",
"messages": [
{
"role": "user",
"content": "Hello!"
}
]
}'
- ⎈ Helm chart security hardening with
restricted
pod security admission
Chores
- Prepare v0.11.1 release (#311) #311 (github-actions[bot])
Commits
v0.11.0
Notable Changes
- 💪 Multi-platform images with ARM64 support! All pre-made models include both AMD64 and ARM64 platform support.
- 📦 Support for models from OCI Artifacts. For example, use models from ollama by simply running:
docker buildx build -t my-model --load \
--build-arg="model=oci://registry.ollama.ai/library/llama3:8b" \
"https://raw.githubusercontent.com/sozercan/aikit/main/models/aikitfile.yaml"
docker run -d --rm -p 8080:8080 my-model
curl http://localhost:8080/v1/chat/completions \
-H "Content-Type: application/json" \
-d '{
"model": "llama3",
"messages": [
{
"role": "user",
"content": "Hello!"
}
]
}'
- ⎈ Helm chart security hardening with
restricted
pod security admission
Features
- arm64 support (#290) #290 (Sertaç Özercan)
- support for models from oci artifacts (#296) #296 (Sertaç Özercan)
- update helm pod security (#299) #299 (Sertaç Özercan)
Documentation
- supply chain security (#283) #283 (Sertaç Özercan)
- update readme links (#285) #285 (Sertaç Özercan)
- arm64 docs (#298) #298 (Sertaç Özercan)
- webui quick start (#300) #300 (Sertaç Özercan)
Continuous Integration
- fix release-pr push new version (#276) #276 (Sertaç Özercan)
Chores
- Prepare v0.10 release (#275) #275 (github-actions[bot])
- update website logo (#278) #278 (Sertaç Özercan)
- update website logo size (#279) #279 (Sertaç Özercan)
- update website logo size (#280) #280 (Sertaç Özercan)
- update demo-magic.sh (#281) #281 (Ikko Eltociear Ashimine)
- update llama3 sha256 (#284) #284 (Sertaç Özercan)
- update llama3 templates (#287) #287 (Sertaç Özercan)
- update prompt templates (#288) #288 (Sertaç Özercan)
- update codestral hash (#289) #289 (Sertaç Özercan)
- deps: Bump golang from
5c56bd4
toaec4784
(#291) #291 (dependabot[bot]) - deps: Bump the actions-all group with 3 updates (#293) #293 (dependabot[bot])
- deps: Bump github.com/containerd/containerd from 1.7.17 to 1.7.18 (#292) #292 (dependabot[bot])
- remove lobechat from helm (#282) #282 (Sertaç Özercan)
- use cdn (#295) #295 (Sertaç Özercan)
- deps: Bump braces from 3.0.2 to 3.0.3 in /website in the npm_and_yarn group across 1 directory (#301) #301 (dependabot[bot])
- update unsloth to june2024 (#302) #302 (Sertaç Özercan)
- Update dependencies (#286) #286 (Rene Leonhardt)
- deps: Bump kubectl from v1.30.1 to v1.30.2 in /charts/aikit (#304) #304 (dependabot[bot])
- deps: Bump the actions-all group with 2 updates (#306) #306 (dependabot[bot])
- deps: Bump github.com/moby/buildkit from 0.13.2 to 0.14.0 (#305) #305 (dependabot[bot])
- Prepare v0.11.0 release (#307) #307 (github-actions[bot])
v0.10.0
Notable changes
⚡️ Quick start to create custom images using models from Hugging Face 🤗 without creating an aikitfile
Example:
docker buildx build -t my-model --load \
--build-arg="model=huggingface://TheBloke/Llama-2-7B-Chat-GGUF/llama-2-7b-chat.Q4_K_M.gguf" \
"https://raw.githubusercontent.com/sozercan/aikit/main/models/aikitfile.yaml"
Features
- parse build args and handle http/git contexts (#268) #268 (Sertaç Özercan)
Bug Fixes
- unsloth custom config (#266) #266 (Sertaç Özercan)
Documentation
- update release (#255) #255 (Sertaç Özercan)
- update baseUrl due to helm chart (#259) #259 (Sertaç Özercan)
- helm repo (#260) #260 (Sertaç Özercan)
- gemma and codestral models (#262) #262 (Sertaç Özercan)
- fix broken links (#265) #265 (Sertaç Özercan)
Tests
- update args test (#270) #270 (Sertaç Özercan)
Continuous Integration
- allow helm.sh for release (#257) #257 (Sertaç Özercan)
- update model name parsing (#263) #263 (Sertaç Özercan)
- remove push event from release-pr (#271) #271 (Sertaç Özercan)
- update release-pr push logic (#273) #273 (Sertaç Özercan)
Chores
- update phi3 sha (#261) #261 (Sertaç Özercan)
- deps: Bump the actions-all group with 2 updates (#267) #267 (dependabot[bot])
- Prepare v0.10.0 release (#274) #274 (github-actions[bot])
v0.9.0
Notable Changes
- 🕵️ Auto runtime detection: AIKit will now automatically check your CPU and GPU capabilities, and automatically choose the most optimized runtime. With this change, there is no differentiation for runtimes
avx
,avx2
, andavx512
. They can still be used to skip installing thecuda
runtime libraries for slimmer images. - 💿 Pre-made models will now include CUDA libraries by default, and CUDA specific images will not be updated anymore. Thanks to auto runtime detection if a compatible GPU is not found, it will fallback to the most optimized CPU runtime.
- ⎈ Helm chart for Kubernetes is now available!
- 🚀 New pre-made models are now available:
Gemma 1.1 2B Instruct
andCodestral 22B
. - ✨ Updated LocalAI to v2.16.0.
- 🦥 Updated Unsloth to May 2024 release.
Features
- add phi3 model (#210) #210 (Sertaç Özercan)
- helm chart (#240) #240 (Sertaç Özercan)
- add codestral (#253) #253 (Sertaç Özercan)
Bug Fixes
- allow list api.scorecard.dev (#229) #229 (Sertaç Özercan)
- gpu detect (#238) #238 (Sertaç Özercan)
- release pr workflow (#243) #243 (Sertaç Özercan)
- chart appversion (#245) #245 (Sertaç Özercan)
Documentation
- doc deprecated models (#212) #212 (Sertaç Özercan)
- fix new row in table (#215) #215 (Sertaç Özercan)
- add model name (#217) #217 (Sertaç Özercan)
- new logo (#218) #218 (Sertaç Özercan)
- update helm chart (#247) #247 (Sertaç Özercan)
- helm chart (#248) #248 (Sertaç Özercan)
- update llama.cpp (#252) #252 (Sertaç Özercan)
Continuous Integration
- allow helm.sh for release (#258) #258 (Sertaç Özercan)
Chores
- deps: Bump golang from
b03f3ba
tod0902ba
(#221) #221 (dependabot[bot]) - deps: Bump github.com/containerd/containerd from 1.7.15 to 1.7.16 (#222) #222 (dependabot[bot])
- deps: Bump the actions-all group with 5 updates (#224) #224 (dependabot[bot])
- deps: Bump github.com/moby/buildkit from 0.13.1 to 0.13.2 (#223) #223 (dependabot[bot])
- deps: Bump the actions-all group with 4 updates (#226) #226 (dependabot[bot])
- deps: Bump the actions-all group with 4 updates (#228) #228 (dependabot[bot])
- deps: Bump golang from
d0902ba
to6d71b7c
(#227) #227 (dependabot[bot]) - deps: Bump golang from
6d71b7c
to5c56bd4
(#233) #233 (dependabot[bot]) - deps: Bump google.golang.org/grpc from 1.63.2 to 1.64.0 (#231) #231 (dependabot[bot])
- deps: Bump the actions-all group with 2 updates (#230) #230 (dependabot[bot])
- deps: Bump github.com/containerd/containerd from 1.7.16 to 1.7.17 (#232) #232 (dependabot[bot])
- update to localai v2.16.0 (#225) #225 (Sertaç Özercan)
- remove runtime (#237) #237 (Sertaç Özercan)
- update unsloth to may 2024 release (#239) #239 (Sertaç Özercan)
- add gemma 1.1 model (#149) #149 (Sertaç Özercan)
- deps: Bump the actions-all group with 4 updates (#251) #251 (dependabot[bot])
- Prepare v0.9.0 release (#254) #256,#254 (github-actions[bot])
Reverts
- runtime removal (#249) #249 (Sertaç Özercan)
v0.8.0
Notable Changes
- 🦙🦙🦙 LLama 3 fine tune support!
- 🦙🦙🦙 Llama 3 pre-made models are now available!
Features
- llama3 8b instruct pre-made model (#197) #197 (Sertaç Özercan)
- llama3 70b pre-built models (#200) #200 (Sertaç Özercan)
- finetune llama3 support (#207) #207 (Sertaç Özercan)
Documentation
- release process (#192) #192 (Sertaç Özercan)
- fix release (#193) #193 (Sertaç Özercan)
- update readme and quickstart with llama3 (#198) #198 (Sertaç Özercan)
Tests
- update gpu test for llama3 (#204) #204 (Sertaç Özercan)
- update gpu test for llama3 (#205) #205 (Sertaç Özercan)
- update gpu test for llama3 (#206) #206 (Sertaç Özercan)
Continuous Integration
- update self hosted update models (#201) #201 (Sertaç Özercan)
- update models - disable mixtral (#202) #202 (Sertaç Özercan)
- remove gha cache for update-models-self (#203) #203 (Sertaç Özercan)
Chores
- deps: Bump google.golang.org/grpc from 1.63.0 to 1.63.2 (#194) #194 (dependabot[bot])
- deps: Bump the actions-all group with 3 updates (#195) #195 (dependabot[bot])
- deps: Bump golang from
48b942a
tob03f3ba
(#196) #196 (dependabot[bot]) - deps: Bump the actions-all group with 3 updates (#208) #208 (dependabot[bot])
v0.7.2
Bug Fixes
- address GO-2024-2687 (#191) #191 (Sertaç Özercan)
Documentation
- update readme and website (#171) #171 (Sertaç Özercan)
- k8s finetune build (#175) #175 (Sertaç Özercan)
- finetune update (#176) #176 (Sertaç Özercan)
- add finetune demo (#177) #177 (Sertaç Özercan)
- add finetune demo (#178) #178 (Sertaç Özercan)
- add announcement bar to website (#179) #179 (Sertaç Özercan)
Chores
- deps: Bump golang from
6699d28
tod996c64
(#172) #172 (dependabot[bot]) - deps: Bump github.com/containerd/containerd from 1.7.13 to 1.7.14 (#173) #173 (dependabot[bot])
- deps: Bump the actions-all group with 5 updates (#174) #174 (dependabot[bot])
- deps: Bump webpack-dev-middleware from 5.3.3 to 5.3.4 in /website (#180) #180 (dependabot[bot])
- deps: Bump the actions-all group with 3 updates (#182) #182 (dependabot[bot])
- deps: Bump github.com/moby/buildkit from 0.13.0 to 0.13.1 (#183) #183 (dependabot[bot])
- deps: Bump express from 4.18.2 to 4.19.2 in /website (#184) #184 (dependabot[bot])
- deps: Bump the actions-all group with 1 update (#185) #185 (dependabot[bot])
- deps: Bump golang from
d996c64
to48b942a
(#186) #186 (dependabot[bot]) - deps: Bump github.com/containerd/containerd from 1.7.14 to 1.7.15 (#189) #189 (dependabot[bot])
- deps: Bump google.golang.org/grpc from 1.62.1 to 1.63.0 (#188) #188 (dependabot[bot])
- deps: Bump github/codeql-action from 3.24.9 to 3.24.10 in the actions-all group (#187) #187 (dependabot[bot])
- bump localai v2.12.3 (#190) #190 (Sertaç Özercan)
v0.7.1
Notable Changes
- 🎵 Fine Tuning support!
- 📂 Ability to use local files for creating model images for inference
Demo of fine-tuning and inference using fine-tuned model: https://www.youtube.com/watch?v=FZuVb-9i-94
Features
- add finetuning support (#162) #162 (Sertaç Özercan)
Bug Fixes
- debug and config space (#154) #154 (Sertaç Özercan)
Continuous Integration
- add retry to trivy (#150) #150 (Sertaç Özercan)
- finetune test (#151) #151 (Sertaç Özercan)
- don't fail on prune (#165) #165 (Sertaç Özercan)
- fix release ldflags (#168) #168 (Sertaç Özercan)
- fix release ldflags (#169) #169 (Sertaç Özercan)
- prerelease enable push (#170) #170 (Sertaç Özercan)
Chores
- deps: Bump the actions-all group with 5 updates (#152) #152 (dependabot[bot])
- deps: Bump github.com/moby/buildkit from 0.13.0-rc2 to 0.13.0-rc3 (#153) #153 (dependabot[bot])
- deps: Bump golang from
925fe3f
to6699d28
(#159) #159 (dependabot[bot]) - deps: Bump the actions-all group with 1 update (#158) #158 (dependabot[bot])
- deps: Bump github.com/moby/buildkit from 0.13.0-rc3 to 0.13.0 (#157) #157 (dependabot[bot])
- deps: Bump google.golang.org/grpc from 1.62.0 to 1.62.1 (#156) #156 (dependabot[bot])
- deps: Bump google.golang.org/protobuf from 1.32.0 to 1.33.0 (#161) #161 (dependabot[bot])
- deps: Bump follow-redirects from 1.15.5 to 1.15.6 in /website (#164) #164 (dependabot[bot])
- update localai to v2.10.0 (#163) #163 (Sertaç Özercan)
Documentation
- update readme (#166) #166 (Sertaç Özercan)
- fix readme links (#167) #167 (Sertaç Özercan)
v0.7.0
v0.6.2
Notable Changes
- 🆕 Update to LocalAI v2.9.0
Continuous Integration
- update egress policy (#137) #137 (Sertaç Özercan)
- update egress for hf (#138) #138 (Sertaç Özercan)
- update egress for deb (#139) #139 (Sertaç Özercan)
Chores
- deps: Bump the actions-all group with 3 updates (#135) #135 (dependabot[bot])
- deps: Bump golang from
53048e8
to874c267
(#136) #136 (dependabot[bot]) - update localai v2.8.2 (#140) #140 (Sertaç Özercan)
- bump buildkit 0.13 rc1 (#141) #141 (Sertaç Özercan)
- deps: Bump the actions-all group with 2 updates (#143) #143 (dependabot[bot])
- deps: Bump golang from
874c267
to925fe3f
(#142) #142 (dependabot[bot]) - update localai v2.9.0 (#145) #145 (Sertaç Özercan)
- deps: Bump github.com/moby/buildkit from 0.13.0-rc1 to 0.13.0-rc2 (#147) #147 (dependabot[bot])
- deps: Bump google.golang.org/grpc from 1.61.1 to 1.62.0 (#146) #146 (dependabot[bot])
- deps: Bump the actions-all group with 3 updates (#148) #148 (dependabot[bot])
v0.6.1
Notable Changes
- 🆕 Update to LocalAI v2.8.0
Documentation
- update misc (#125) #125 (Sertaç Özercan)
Continuous Integration
- fix copa patch conditionals (#118) #118 (Sertaç Özercan)
- set egress policy (#119) #119 (Sertaç Özercan)
- fix copa patched tag (#133) #133 (Sertaç Özercan)
- use trivy binary for patch images (#134) #134 (Sertaç Özercan)
Chores
- deps: Bump google.golang.org/grpc from 1.60.1 to 1.61.0 (#122) #122 (dependabot[bot])
- deps: Bump golang from
adf7ccb
to47fa179
(#120) #120 (dependabot[bot]) - deps: Bump the actions-all group with 2 updates (#121) #121 (dependabot[bot])
- deps: Bump the go_modules group across 1 directories with 1 update (#128) #128 (dependabot[bot])
- deps: Bump golang from
47fa179
toc62751a
(#129) #129 (dependabot[bot]) - deps: Bump github.com/containerd/containerd from 1.7.12 to 1.7.13 (#131) #131 (dependabot[bot])
- deps: Bump the actions-all group with 4 updates (#130) #130 (dependabot[bot])
- update localai v2.8.0 (#132) #132 (Sertaç Özercan)