Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable setting all options via ENV vars #466

Closed
wants to merge 4 commits into from

Conversation

vartec
Copy link

@vartec vartec commented Apr 20, 2024

Allow setting all options via environment variables using LLM as the default prefix.

Note that for groups (subcommands) the prefix includes group name; LLM_{group:upper}.

Example:

$ LLM_CHAT_MODEL_ID=mistral-7b-instruct-v0 llm chat 
Chatting with mistral-7b-instruct-v0
⋮
$ llm chat
Chatting with gpt-3.5-turbo
⋮
$ export LLM_CHAT_MODEL_ID=mistral-7b-instruct-v0
$ llm chat
Chatting with mistral-7b-instruct-v0
⋮

@vartec vartec changed the title Enable to setting all options via ENV vars Enable setting all options via ENV vars Apr 20, 2024
@vartec vartec closed this Sep 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant