Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ollama ignore GIN_MODE environment variable? #320503

Closed
drupol opened this issue Jun 17, 2024 · 0 comments · Fixed by #320526
Closed

ollama ignore GIN_MODE environment variable? #320503

drupol opened this issue Jun 17, 2024 · 0 comments · Fixed by #320526
Labels
0.kind: bug Something is broken

Comments

@drupol
Copy link
Contributor

drupol commented Jun 17, 2024

Current ollama version (0.1.43) ignore the GIN_MODE environment variable:

$ GIN_MODE=release ollama serve
2024/06/17 12:15:01 routes.go:1011: INFO server config env="map[OLLAMA_DEBUG:false OLLAMA_FLASH_ATTENTION:false OLLAMA_HOST: OLLAMA_KEEP_ALIVE: OLLAMA_LLM_LIBRARY: OLLAMA_MAX_LOADED_MODELS:1 OLLAMA_MAX_QUEUE:512 OLLAMA_MAX_VRAM:0 OLLAMA_MODELS: OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://*] OLLAMA_RUNNERS_DIR: OLLAMA_TMPDIR:]"
time=2024-06-17T12:15:01.041+02:00 level=INFO source=images.go:740 msg="total blobs: 0"
time=2024-06-17T12:15:01.041+02:00 level=INFO source=images.go:747 msg="total unused blobs removed: 0"
[GIN-debug] [WARNING] Creating an Engine instance with the Logger and Recovery middleware already attached.

[GIN-debug] [WARNING] Running in "debug" mode. Switch to "release" mode in production.
 - using env:   export GIN_MODE=release
 - using code:  gin.SetMode(gin.ReleaseMode)

Other related issues: https://gitlab.archlinux.org/archlinux/packaging/packages/ollama/-/issues/5

CC @abysssol


Add a 👍 reaction to issues you find important.

@drupol drupol added the 0.kind: bug Something is broken label Jun 17, 2024
@drupol drupol mentioned this issue Jun 17, 2024
13 tasks
@drupol drupol closed this as completed in 58e03a2 Jun 17, 2024
wegank pushed a commit to RaitoBezarius/nixpkgs that referenced this issue Jun 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
0.kind: bug Something is broken
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant