Skip to content

ClaraCore v0.1.2

Choose a tag to compare

View all tags
@claraverse-space claraverse-space released this 03 Oct 07:02
· 20 commits to main since this release
v0.1.2
b23befb
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

ClaraCore v0.1.2

AI-powered model inference server with automatic setup and OpenAI-compatible API.

🚀 What's New

  • High-performance GGUF model inference
  • OpenAI-compatible API endpoints
  • Automatic backend detection (CUDA/Vulkan/ROCm/Metal/CPU)
  • Real-time setup wizard and configuration
  • Memory optimization and model management
  • Cross-platform service installation

📦 Downloads

Choose the appropriate binary for your system:

  • Linux x64: claracore-linux-amd64 (10.9 MB)
  • Linux ARM64: claracore-linux-arm64 (10.2 MB)
  • macOS Intel: claracore-darwin-amd64 (11.1 MB)
  • macOS Apple Silicon: claracore-darwin-arm64 (10.5 MB)
  • Windows x64: claracore-windows-amd64.exe (11.3 MB)

🔧 Installation

Quick Install (Recommended)

Linux/macOS:

curl -fsSL https://raw.githubusercontent.com/claraverse-space/ClaraCore/main/scripts/install.sh | bash

Windows (PowerShell as Administrator):

irm https://raw.githubusercontent.com/claraverse-space/ClaraCore/main/scripts/install.ps1 | iex

Manual Installation

  1. Download the appropriate binary for your system
  2. Make it executable (Linux/macOS): chmod +x claracore-*
  3. Run setup: ./claracore-* --models-folder /path/to/your/models
  4. Visit: http://localhost:5800/ui/setup

🛠️ Quick Start

# Basic usage
./claracore-linux-amd64 --models-folder /path/to/gguf/models

# With specific backend
./claracore-linux-amd64 --models-folder /path/to/models --backend vulkan

# Web interface
./claracore-linux-amd64
# Then visit: http://localhost:5800/ui/setup

📚 Documentation

🔍 Verification

All binaries include SHA256 checksums for verification:

  • claracore-linux-amd64: 8defb4e6021120ab0480f97d73cd9ae451c8054551e46032f42cc365d49ce6f2
  • claracore-linux-arm64: db28e6c0e6cec3ae4e56a8fb06e9d5ef381193c9099daa01df054993d7bb490b
  • claracore-darwin-amd64: 511eb1fa6687d7375c516babe735bd75edfd09311362a62c91fcb0e8d620c21c
  • claracore-darwin-arm64: 5ace1341627e46b9cf510134baee5124de21c67c7813b219d2550c9d4eaef797
  • claracore-windows-amd64.exe: 434b0a0e32fbe4d6ffeb76f92a01688ceb552bc53f53ba30e84cb13ae991a226

📊 Build Information

  • Version: v0.1.2
  • Build Time: 2025-10-03 01:32 UTC
  • Git Commit: b23befb
  • Go Version: go1.25.0

🐛 Changes

289 commits since v0.1.2:

b23befb Update README.md
02fdb58 feat: Enhance ClaraCore with improved port management and binary management features
82e4cd4 feat: Replace Windows service installation with auto-start shortcut for improved reliability
88f2d7b feat: Enhance Windows service installation and troubleshooting scripts for improved user experience
318c1a0 feat: Add version and commit information to build output and enhance setup documentation
feb1b66 feat: Add PATH fix script and update installation guidance for claracore command accessibility
3cc9af3 feat: Enhance installation documentation and add container setup guide for ClaraCore
dd05716 feat: Add troubleshooting script and enhance installation guidance for Windows security issues
bc92a10 fix: Improve Windows installation and uninstallation scripts with security handling and troubleshooting guidance
c673a3d fix: Update repository references from badboysm890 to claraverse-space in setup and installation scripts
7c2bfd7 Add installation and uninstallation scripts for ClaraCore
8c8c118 refactor: Update references from llama-swap to ClaraCore in setup and benchmark files
1d60f86 Enhance process management and configuration handling
e7658b6 Merge branch 'main' of https://github.com/badboysm890/ClaraCore
df4e9d1 feat: Implement progress tracking for model scanning and configuration generation
89aded6 Merge pull request #1 from esc247/main
a694b58 update readme
ed77bb6 chore: Update .gitignore to include model_folders.json
41acfe8 feat: Remove deprecated files and configurations
58409f3 feat: Implement self-healing configuration regeneration and enhance model management
8afe0ff feat: Implement multi-folder support and database management for model paths
660c8a5 feat: Add progress tracking for configuration generation in OnboardConfig
7859f63 feat: Add new logo assets and update site manifest
c0b5b1b Merge branch 'main' of https://github.com/badboysm890/ClaraCore
cce3834 feat: Enhance OnboardConfig with model source selection and update step navigation
ce48003 chore: Simplify .gitignore by consolidating download paths
66bd583 feat: Update GPU detection and configuration in OnboardConfig
453d532 Merge branch 'main' of https://github.com/badboysm890/ClaraCore
28b60c0 feat: Enhance build script with platform detection and dynamic output naming
cb3b327 feat: Enhance button styles and improve setup detection logic in OnboardConfig
b699d8e feat: Add comprehensive system detection API and UI integration
d00a232 style: Format code for consistency in findLlamaServer function
3dc68ab feat: Enhance llama-server executable search logic with detailed logging and improved path checks
a6ce9a1 feat: Add config file creation logic in main function
cf85879 Merge branch 'main' of https://github.com/badboysm890/ClaraCore
d7350b8 feat: Add OnboardConfig component for model setup and configuration
ecd75da Create FUNDING.yml
611f307 Refactor code structure for improved readability and maintainability
4108c9e Update header image to improve visual design
d909a65 Add real-time hardware monitoring for VRAM and RAM
21de93f Update batch sizes and add port configurations for model groups in config files
464ee6f Resolve merge conflict in README.md
259905a Refactor config generation and enhance model compatibility checks in downloader
68ad93f Enhance UI components and add Tailwind CSS configuration
923f57e Update README.md
450f42f Implement core functionality for ClaraCore with auto-setup and config watching features
b7ba41b Add comprehensive README with proper attribution
b0f8900 Complete rebranding to ClaraCore
5b36482 Transform llama-swap to ClaraCore with auto-setup features
fc3bb71 UI styling / code improvements (#307)
c36986f upstream handler support for model names with forward slash (#298)
558801d Fix nginx proxy buffering for streaming endpoints (#295)
b21dee2 Fix #288 Vite hot module reloading creating multiple SSE connections (#290)
f58c8c8 Support llama.cpp's cache_n in timings info (#287)
954e2de Remove `cmdStart` from README [skip ci]
a533aec small tweak to example config
97b17fc Add ${MODEL_ID} macro (#226)
2457840 Update README.md [skip ci]
7f55494 Update README.md [skip ci]
831a90d Add different timeout scenarios to Process.checkHealthEndpoint #276 (#278)
977f185 add /completion endpoint (#275)
52b329f Fix #277 race condition in ProcessGroup.ProxyRequest when swap=true
57803fd Support llama-server's /infill endpoint (#272)
c55d0cc Add docs for model.concurrencyLimit #263 [skip ci]
7acbaf4 Add connection status indicator in UI (#260)
fcc5ad1 UI: Allow editing of title (#246)
305e5a0 improve example config [skip ci]
04fc673 Improve Activity event handling in the UI (#254)
4662cf7 add 'unconfirmed bug' as default label in bug-report.md
5dc6b3e Add barebones but working implementation of model preload (#209, #235)
74c69f3 Add prompt processing metrics (#250)
a186318 Update Readme, Add screenshot for Activities page [skip ci]
c4e4d5e Update Readme UI Screenshot [skip ci]
7985e94 add tokens processed to ui models page
74556c3 Update bug-report.md [skip ci]
5c381e4 Add gofmt linting to ci
10569ed Fix model alias usage in upstream path (#230)
5b10b3c UI Tweaks (#228)
45ea792 Fix UI panel not saving position correctly
1bc2802 fix panels not saving sizing state
701476c Update README.md - remove contributor block [skip ci]
5c63e00 return models sorted by id in /v1/models (#222)
8be5073 Fix typo (#223) [skip ci]
6307bd3 Add support for building Linux ARM64 binary in Makefile (#221)
558a72d UI Improvements (#219)
dc42cf3 Add config monitor support for k8s configmap. (#217)
ba0a819 Update README.md (#216)
574fdfa UI improvements (#213)
5172cb2 Update docs in Readme [skip ci]
5672cb0 Update github actions for notifying homebrew build (#212)
0f58316 add /health (#211)
7905fa9 Update trigger-homebrew-update.yml [skip ci]
bbaf172 add trigger to rebuild homebrew formula (#210)
fd50932 Decouple MetricsMiddleware from downstream handlers (#206)
8c693e7 Add endpoint aliases for reranking models (#201)
8f2af26 fix stats on model page
01d4838 Fix token metrics parsing (#199)
accd652 add contributors to README [skip ci]
7472a25 Update README.md [skip ci]
cce0bc6 add guard to ensure ls-real-model-name is set in context
36e2512 UI tidy [skip ci]
9a54273 Update UI with new Activity event stream from #195
87dce5f Add metrics logging for chat completion requests (#195)
307e619 remove old eventsources from UI
6299c1b Fix High CPU (#189)
a906cd4 Strip comments before macro expansion in config (#193)
78b2bc3 add toggle to hide/show unlisted models (#187)
6a058e4 Change fsnotify to watch config directory instead of file
1921e57 Add Event Bus (#184)
c867a6c Add name and description to v1/models list (#179)
3bd1b23 fix config hot-reload on k8s (#181)
10606ab fix config hot-reload on macos (#180)
fefd149 improve log display and add a small stats table in ui (#178)
717d64e update GUI image in README [skip ci]
285191e Various UI improvements (#176)
4236cec Add Filters to Model Configuration  (#174)
756193d Load models in the UI without navigating the page (#173)
a6b2e93 Update README.md [skip ci]
9e02c22 stopCmd should use same environment as p.cmd.Env (#171, #172)
0bdbf2f fix more goreleaser deprecation warnings [skip ci]
49035e2 Append custom env vars instead of replace in Process (#171)
9963ae1 fix? deprecation warning in .goreleaser.yaml [skip-ci]
2ae48c7 add debug output for start command
54c519e update Makefile to install ui deps
3fce9ee Update README.md [skip ci]
5899ae7 Update README.md [skip ci]
591a9cd update release.yml
9a3c656 New UI (#157, #164)
75015f8 fix bug caused by macro replacement order (#166)
cc33b6c restore intel docker builds (#163)
4fa12a4 Refactor all default config values into config.go (#162)
2dc0ca0 improve llama-swap upstream process recovery and restarts (#155)
a84098d Add missing object type to /v1/models endpoint (#154)
4d02ccd Update README.md [skip ci]
dfd47ee Readme updates [skip ci]
1ac6499 Add macros to Configuration schema (#149)
25f3dc2 small doc update [skip ci]
8422e4e move some docs to the wiki [no-ci]
02ee29d increase default healthCheckTimeout to 120s
b2a891f Disable building of intel container until it's fixed upstream
8d2b568 Improve install script (#144)
fb44cf4 Fix typos (#143)
02aee4e remove noisy debug print message
f45896d add guard to avoid unnecessary logic in Process.Shutdown
f7e46a3 Add link to unload endpoint in upstream list (#140)
c260907 Add linux install and uninstall shell scripts (#139)
b83a5fa make Failed stated recoverable (#137)
6e2ff28 improve cmdStop docs [no ci]
a8b81f2 Add stopCmd for custom stopping instructions  (#136)
f9ee715 update configuration examples for multiline yaml commands #133
2d00120 Update proxymanager.go (#135)
afc9aef Fix #133 SanitizeCommand removes comments (#134)
d7b390d Add GH Action for Testing on Windows (#132)
5025c2f Add GH windows tests (not working yet)
e3a0b01 add content length test for #131
f5763a9 Fix content length being incorrect when useModelName is used (#131)
8ada72e Update issue templates
2441b38 Make checking for process killed status more robust
25f2516 Prevent StateFailed after SIGKILL (#129)
7f37bcc Improve testing around using SIGKILL (#127)
519c3a4 Change /unload to not wait for inflight requests (#125)
9dc4bcb Add a concurrency limit to Process.ProxyRequest (#123)
cb876c1 update example config
bc65270 Add config hot-reload (#106)
9548931 ci: re-enabled intel build pipeline (#121)
5c5a5da Update README.md
aa9ef59 Create .coderabbit.yaml
09e52c0 Automatic Port Numbers  (#105)
ca9063f ensure aliases are unique (#116)
21d7973 Improve content-length handling (#115)
cc450e9 fix issue where proxy is still proxying with chunked transfer-encoding (#114)
27465fe bug fix with missing early return statements fix #112
9667989 Disabling intel container build since it's been broken for weeks.
d9a1dde Truncate web logs to 100K characters (#111)
e7ab024 small locking optimization
448ccae Introduce Groups Feature (#107)
ec0348e Reduce stale time for issues
06eda7f tag all process logs with its ID (#103)
5fad24c Make checkHealthTimeout Interruptable during startup (#102)
8404244 Moderate security update for golang/x/net -> v0.38.0
712cd01 fix confusing INFO message [no ci]
1f7aa35 Update header image
b138d6c fix starhistory in README
fb7c808 add timing for Process start, stop, total request time (#91)
a7e640b add aider example
593604d Show proxy and upstream logs in separate columns in logs UI
b8f888f Logging Improvements (#88)
192b2ae Remove no longer needed test
b7f8cb5 Limit Access-Control-Allow-Origin to OPTIONS preflight requests #85
a23da6e Sanitize CORS headers (#85)
4c3aa40 add graceful process termination on windows (#82)
84e2c07 Refactor wildcard out of CORS headers (#81)
680af28 Allow very permissive CORS headers (#77)
d94db42 fix bug checking incorrect error
93cd83c add override for windows (#76)
5565fca add some badges to README
d625ab8 Refactor process state management (#70) (#73)
a3f82c1 tidy up config examples in README
5c97299 Add support for sending a custom model name to upstream (#69) (#71)
671c1a5 update deps
52c0196 clean up feature list in readme
3201a68 Add /v1/audio/transcriptions support (#41)
3ac94ad Adds an endpoint '/running'  (#61)
60355bf fix some potentially confusing Process.start() comment
9b2ed24 Improve Continuous integration and fix concurrency bugs (#66)
eeb7229 add first version of CI for go
eabfe70 add GH action to close inactive issues
29cd988 better container build logic when upstream containers do not exist
b3d331d Properly strip profile name slug from models fixes (#62)
62275e0 add examples to restart on config change #59
8891605 add /unload to docs
082d5d0 Add /unload endpoint (#58) to unload all currently running models
5333893 increase health check to a minimum of 5 seconds
af65334 Update README.md w/ starhistory graph
1e25b44 add workflow_dispatch to release action
0815bb4 Add windows to goreleaser #54
7187cfe add Windows build support to Makefile (#54)
24089d2 remove "no musa container" note from README
ebabe55 Delete untagged packages after build and push (#55)
41a3382 deletion of untagged containers happen after build-and-push
7e3353e add action step to remove untagged containers
4ed58fb update container build action
f5a2be6 revert package src until new ggml-org has them
f5e6ec3 fix package src in containerfile
3f462da switch package source from ggerganov to ggml-org
48bd766 Update README.md
8d319da improve README organization (i think...)
be7c502 improve docs
92336f0 more container build fixes
ed2a50d fix bug in build-container.sh
0acfdb9 update workflow to build `cpu` and disable `musa`
96a8ea0 add cpu docker container build
f20f2c9 add docs and container build improvements #43
7a97c38 enable parallel container built #46
4885132 more permissions futzing
8b46a0b grant package:write to container workflow #46
1b6736e rename workflow for containers
ddc1ce0 fix container file name #46
11d024b just build cuda while debugging
43e23c1 add check for GITHUB_TOKEN #46
f9c8e76 add execute bit on build-container.sh
d7e1bb9 add GITHUB_TOKEN to container build env
ab93460 first container code (#52)
13d4552 Add FreeBSD/amd64 to auto built releases (#51)
6667e30 Update README.md
7ac446e Update README.md
eab9795 remove panic() when cmd or process is nil
09bdd86 Improve shutdown behaviour (#47) (#49)
85cd74a Improve process start and stop reliability (#38)
314d2f2 remove cmd_stop configuration and functionality from PR #40 (#44)
fad25f3 Use client request context in proxy request (#43)
2c3e3e2 Support OPTIONS requests (#42)
baeb0c4 Add cmd_stop configuration to better support docker (#35)
2833517 Improve handling of process that do not handle SIGTERM (#38)
abdc2bf Fix panic when requesting non-members of profiles
c3b8347 Update README.md
3c8e727 Update README.md
3a1e9f8 support TTS /v1/audio/speech (#36)
72c883f Update README.md
1b04d03 Update README.md
2e45f56 Update README.md
c97b80b Update README.md
ae3ef9b Refactor UI (#33)
db6715b update golang.org/x/net -> v0.33.0 for dependabot
da5d9e8 fix HTTP logging so true path is printed
84b667c improve logging and error reporting for troubleshooting
2965710 add more OpenAI API supported in README
9c88604 support v1/rerank endpoint
9b4e3f3 rename proxy handler
6fe37c3 support /v1/embeddings (#4)
7f45493 Update README.md
891f6a5 Add /upstream endpoint (#30)
7183f6b fix bad logging due to wrong []byte used #28
d89bfeb add .DS_Store to .gitignore
9a0c6be Improve stop exceptions (#28) (#29)
d6ca535 tweak release tagging so it is not based on number of commits
27302c0 change llama-swap to use goreleaser default ldflag values
d4e22cc Fix security vulnerability with golang.org/x/crypto
4c94927 Move release to Makefile out of goreleaser
a955a4a create tag to release
22d3f1a Change versioning to use git commits counts instead of semver
e244325 update readme
5fbd53c delay TTL check until after all requests are complete (#25)
97dae50 update readme
cb978f7 add web interface to /logs
387f0ef use new timings data in server response in run-benchmark.sh
18c1346 Add Access-Control-Allow-Origin CORS header to /v1/models endpoint
da2326b add example: optimizing code generation
da46545 fix profile example in README

🤝 Support

Full Changelog: ...v0.1.2

Assets 8
Loading