It can be confusing for users see here
Instead we should support adding the api-key using the --api-key flag. In addition we can update the current flag to be caleld --optillm-api-key to make it clear that it is to be used to auth clients to the proxy.
It can be confusing for users see here
Instead we should support adding the api-key using the
--api-keyflag. In addition we can update the current flag to be caleld--optillm-api-keyto make it clear that it is to be used to auth clients to the proxy.