-
-
Notifications
You must be signed in to change notification settings - Fork 0
Agents and Providers
TagForge uses "Agents" to connect to various AI providers. This guide explains how to set up your preferred model.
Here you can configure connections to different AI services.
| Provider | Best For | Requirement |
|---|---|---|
| Google Gemini | High-performance, multimodal reasoning. | Google AI Studio API Key |
| OpenRouter | Access to OpenAI (GPT-4), Anthropic (Claude), etc. | OpenRouter Key | | Hugging Face | Massive library of open-source models. | User Access Token | | LM Studio | Local inference server. | Local Only (Running app required) | | Ollama | Local command-line inference. | Local Only (Installed service required) |
Different providers handle output lengths differently. You can precisely control these limits using the Max Tokens Slider in the Agent Manager.
- Range: 128 to 32,768 tokens.
- Default: 4,096 tokens (optimal for most workflows).
- Per-Agent: Settings are saved individually for each agent configuration.
| Provider | Recommended Max Tokens | Why? |
|---|---|---|
| Google Gemini | 8192+ | Stable at extremely high output lengths. |
| OpenRouter | 4096 | Balanced for high-end cloud models. |
| Ollama / LM Studio | 4096 | Best for local VRAM and speed. |
| Hugging Face | 2048 | Avoids timeouts on free-tier inference. |
(Google Gemini, OpenRouter, Hugging Face)
- Select the provider.
- Paste your API Key into the field.
- Click Fetch Models to verify the key and get the latest model list.
- If successful, the dropdown will populate with available models.
- Select a Model from the dropdown.
Note
Zero-Trust Encryption: Your API keys are secured using a machine-specific, hardware-salted obfuscation layer. This ensures that your credentials are protected cross-platform (Windows, Linux, and macOS) and cannot be utilized on a different device.
- Ensure Ollama is installed.
- Open a terminal and run
ollama serve. - In TagForge, select Ollama and click Fetch Models.
- Open LM Studio.
- Go to the Local Server tab.
- Load a model into memory.
- Start the server (usually on port
1234). - In TagForge, select LM Studio and click Fetch Models.
Use the Test Connection button to verify your connection.
- Green Notification: Success! The API is reachable.
- Red Notification: Connection failed.
Warning
Troubleshooting Failures:
- 401 Unauthorized: Your API Key is invalid.
- 429 Too Many Requests: You have run out of credits or hit the rate limit.
- Connection Refused: For local providers, ensure the server is actually running.