feat: minimal deployment docker image

[tikikun]

super small docker image for nitro

[0xSage]

What's the impact of this? What would devs/users be able to do?

[hiro-v]

@0xSage
The initial thought for this one is similar to llama.cpp
However after some rounds of integration, I realized that this one might not be needed as we have release (nitro binary along with external deps. packaged to run).
User can just use that instead for better performance.

This is also needed as the guideline for user to pack nitro to deploy to cloud native services (i.e Kubernetes, Slurm, etc)

[hiro-v]

From what I can understand, we do not need to distribute the docker for this (dev/ release)
Nitro will always release just the binaries

[101100]

Providing a docker image would allow people to create a docker-compose.yml file that has Nitro and an application that uses the API, such as SillyTavern. The minimal size of Nitro makes it great for this type of use. Other people can create a docker image easily, but it is nice when it is provided by an official source so it is known to be up-to-date.