feat: add multi-deployment routing and num_replicas support#13

alez007 merged 1 commit intomainalez007/modelship:mainfrom

feat/multi-deployment-routingalez007/modelship:feat/multi-deployment-routingCopy head branch name to clipboard