Help needed:: Guidance on Deploying to Modern BentoCloud #5422
Help needed: Guidance on Deploying to Modern BentoCloudHi everyone, I've been working with the repo from bentoml CLIP-API-service project and it runs perfectly on my local machine. I'm really impressed with how easy it is to get started, at least locally. I ran into a challenge when trying to deploy it to the modern BentoCloud platform, and I wanted to share my experience to see if anyone in the community has found a solution or can offer some advice. Context & Environment
Deployment
Version MismatchThe deployment consistently fails when the server tries to start. The logs show a clear error pointing to an incompatibility between the old BentoML version and the modern cloud environment: Error: No such command 'start-http-server'
Error: No such command 'start-runner-server'you can view a more complete log here: i would appreciate if anyone can help me on this, thanks. |
Replies: 2 comments 1 reply
|
Since that repo hasn't got updated for over 2 years, the bentoml version is a bit old but is not pinned in the build config. I have to fix that by pinning the bentoml version. But anyway, I recommend https://github.com/bentoml/BentoCLIP for latest usage. |
|
BentoCloud deployment can be tricky to get right. At RevolutionAI (https://revolutionai.io), we have deployed several production ML services with BentoML. Key steps that worked for us:
What specific error are you seeing? The deployment logs usually have the clue. |
Since that repo hasn't got updated for over 2 years, the bentoml version is a bit old but is not pinned in the build config.
I have to fix that by pinning the bentoml version. But anyway, I recommend https://github.com/bentoml/BentoCLIP for latest usage.