Skip to content

Conversation

@mudler
Copy link
Owner

@mudler mudler commented Nov 20, 2025

Description

This PR adds support to configure LocalAI settings during runtime. This includes a new page which can be accessed from Setting -> System, which allows to:

  • start and stop watchdogs (which happen effect immediately)
  • start and stop the p2p layer (which takes effect as well immediately)
  • configure model and backend galleries (immediate effect)
  • CORS/CSRF settings (this require restart)
  • Default context, thread, precision and debug mode
  • manage api keys
Screenshot 2025-11-20 at 17-39-10 LocalAI - Settings

Notes for Reviewers

Signed commits

  • Yes, I signed my commits.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
@netlify
Copy link

netlify bot commented Nov 20, 2025

Deploy Preview for localai ready!

Name Link
🔨 Latest commit 3c2fb3e
🔍 Latest deploy log https://app.netlify.com/projects/localai/deploys/691f7f622da24a0008e5a7c9
😎 Deploy Preview https://deploy-preview-7320--localai.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

}
return nil
}

Check failure

Code scanning / gosec

Potential file inclusion via variable Error

Potential file inclusion via variable
// The file watcher handler will handle runtime changes properly by comparing with startupAppConfig.
func loadRuntimeSettingsFromFile(options *config.ApplicationConfig) {
settingsFile := filepath.Join(options.DynamicConfigsDir, "runtime_settings.json")
fileContent, err := os.ReadFile(settingsFile)

Check failure

Code scanning / gosec

Potential file inclusion via variable Error

Potential file inclusion via variable
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
@mudler mudler merged commit 2dd4229 into master Nov 20, 2025
28 of 30 checks passed
@mudler mudler deleted the feat/settings branch November 20, 2025 21:37
@mudler mudler added the enhancement New feature or request label Nov 22, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants