Skip to content

Configuration Options Explained

fingerthief edited this page May 12, 2024 · 6 revisions

Settings Configuration Options Explained

The settings dialog allows you to customize the behavior of our application to suit your needs. Below is a breakdown of each setting:

Open AI Formatted APIs Config

Note

Settings values are saved automatically as soon as you click away from the edited value.

Parameters Reference

For more information on the available parameters, see the Open Router API documentation.

Settings

General Config

Setting Description
Key Enter your API key for the service you are using, if applicable. Some services do not require an API key for locally hosted API endpoints.
Model Name The name of the model you are using, if applicable. (e.g., meta-llama/llama-3-70b-instruct)
API Endpoint The base URL of the API endpoint being used to interact with the model. (e.g., http://192.168.120.6:1234 for locally hosted or https://openrouter.ai/api for a different service)
Temperature Influences the variety in the model's responses. Lower values lead to more predictable and typical responses, while higher values encourage more diverse and less common responses. At 0, the model always gives the same response for a given input.
Max Tokens Set the maximum number of tokens to be generated by the AI model. A higher value will result in longer responses, but may also increase the risk of generating irrelevant or unnecessary text.
Repetition Penalty Helps to reduce the repetition of tokens from the input. A higher value makes the model less likely to repeat tokens, but too high a value can make the output less coherent (often with run-on sentences that lack small words). Token penalty scales based on original token's probability.
Top P Limits the model's choices to a percentage of likely tokens: only the top tokens whose probabilities add up to P. A lower value makes the model's responses more predictable, while the default setting allows for a full range of token choices.
System Prompt Allows the user to give the AI a prompt to adhere to if desired.

GPT Config

Setting Description
Key Enter your OpenAI API key to enable GPT functionality.
Slider Value Adjust the tone of the GPT responses to be more serious or creative. Moving the slider to the left will result in more serious responses, while moving it to the right will result in more creative responses.

DALL-E Config

Setting Description
Image Count Select the number of images to generate for each prompt.
Image Resolution Choose the resolution of the generated images.

Claude Config

Setting Description
Key Enter your Claude API key to enable Claude functionality.
Slider Value Adjust the tone of the Claude responses to be more serious or creative. Moving the slider to the left will result in more serious responses, while moving it to the right will result in more creative responses.