Description
LocalAI version:
local-ai:latest-cpu
Environment, CPU architecture, OS, and Version:
OpenShift[Kubernetes] , CPU , X86_64
Describe the bug
When deploying in Openshift[kubernetes] , getting an error with container creation
Generated from kubelet on ip-10-111-60-167.ec2.internal
Error: container create failed: time="2025-03-03T19:48:00Z" level=error msg="runc create failed: unable to start container process: error during container init: error running hook #0: error running hook: exit status 1, stdout: , stderr: nvidia-container-cli.real: requirement error: invalid expression\n"
I have tried to deploy older versions , aio versions and all getting same error. The only version worked is ffmpeg , but getting error HTTP 500 - rpc error ..
I want to host only Embedding and Re-Ranking models ..
What would be right version for this architecture. ?
How to overcome this error ?
Can LocalAI run on OpenShift[Kubernetes] ?
To Reproduce
Deploy LocalAI on Kubernetes
Expected behavior
Container runing
Logs
Additional context