Skip to content

Local AI Deployment container error on Kubernetes #4935

Closed as not planned
Closed as not planned
@kkr2320

Description

@kkr2320

LocalAI version:
local-ai:latest-cpu

Environment, CPU architecture, OS, and Version:
OpenShift[Kubernetes] , CPU , X86_64

Describe the bug
When deploying in Openshift[kubernetes] , getting an error with container creation

Generated from kubelet on ip-10-111-60-167.ec2.internal
Error: container create failed: time="2025-03-03T19:48:00Z" level=error msg="runc create failed: unable to start container process: error during container init: error running hook #0: error running hook: exit status 1, stdout: , stderr: nvidia-container-cli.real: requirement error: invalid expression\n"

I have tried to deploy older versions , aio versions and all getting same error. The only version worked is ffmpeg , but getting error HTTP 500 - rpc error ..

I want to host only Embedding and Re-Ranking models ..

What would be right version for this architecture. ?
How to overcome this error ?
Can LocalAI run on OpenShift[Kubernetes] ?

To Reproduce
Deploy LocalAI on Kubernetes

Expected behavior
Container runing

Logs

Additional context

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions