Skip to content

Add ARM platform support for local CLI builds#2827

Draft
lucataco wants to merge 3 commits intomainfrom
lucataco/arm-cli-support
Draft

Add ARM platform support for local CLI builds#2827
lucataco wants to merge 3 commits intomainfrom
lucataco/arm-cli-support

Conversation

@lucataco
Copy link
Member

Summary

  • thread a configurable build/run platform through the CLI and Docker build pipeline
  • default local image pulls, builds, and runs to the host architecture instead of forcing amd64
  • adjust Dockerfile generation for arm64, including library paths, venv setup, and cog base image fallback behavior

@lucataco lucataco requested a review from a team as a code owner March 11, 2026 23:46
@lucataco lucataco marked this pull request as draft March 11, 2026 23:46
@michaeldwan
Copy link
Member

Nice this is a common request. I'll help get this working once we finish the major changes to the in-container runtime. The important part is the CLI only is arm64, we do need the container to be amd64 until all the dependencies work correctly on arm64, like torch and cuda. tbh that's not super likely to be easy, but the exercise will help make the container vs cli vs sdk and dep logic arch aware, which is a great thing.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants