Repository navigation
|
apakah menggunakan Cloud API lebih baik dari pada llm soalnnya PC saya tidak kuat untuk di install LLM. |
Replies: 1 comment
|
Yes—if your PC cannot run a local model comfortably, a cloud API is a practical option. Odysseus supports external API models, so the model itself does not need to run on your PC. For example, you can add OpenRouter as a model endpoint in Odysseus:
You still run Odysseus locally, but inference happens on the provider's servers. The trade-offs are an internet connection, provider pricing/rate limits, and sending the model's input to that provider. Cloud is not automatically better in every case, but it avoids the local model's RAM/VRAM requirements. References: "Odysseus" (https://github.com/odysseus-dev/odysseus), "OpenRouter setup" (https://openrouter.ai/docs/quickstart). AI-assisted reply; checked against the current documentation and source, without a live connection test. |
Yes—if your PC cannot run a local model comfortably, a cloud API is a practical option. Odysseus supports external API models, so the model itself does not need to run on your PC.
For example, you can add OpenRouter as a model endpoint in Odysseus:
You still run Odysseus locally, but inference happens on the provider's servers. The trade-offs are an internet connection, provider pricing/rate limits, and sending the model's input to that provider.
Cloud is not automatically better in every case, but it avoids the local mo…