-
Notifications
You must be signed in to change notification settings - Fork 239
Closed
Labels
questionFurther information is requestedFurther information is requested
Description
Currently, there seems to be redundancy in how the optillm_base_url and openai_base_url are shown in the docs:
In the README, openai_base_url is shown as:
openai_base_url = "http://localhost:8000/v1"
But this actually looks like the Optillm URL, not the original OpenAI API URL.
At the same time, the original OpenAI base_url seems hidden when showing how to set openai_api_key.
Nowadays, most libraries and repos show clear instructions about setting an OpenAI-compatible URL (e.g., when using local LLM servers). It would be helpful if the README followed the same convention.
Metadata
Metadata
Assignees
Labels
questionFurther information is requestedFurther information is requested