Support multi-arch docker images

Got a request over telegram to support multi architecture docker images.

I don't know much about how they work yet though. So gotta find out how to build them, and how to test them?
Here's the docs:
https://docs.docker.com/build/building/multi-platform/