It is quite difficult to guess and override the default gpt in the properties. I prefer Ollama for experimentation and testing.
The following should be at least a comment on the application.properties to enable devs to choose other llms:
embabel.models.defaultEmbeddingModel=nomic-embed-text:latest
embabel.models.llms.best=llama3.1:8b
embabel.models.llms.cheapest=llama3.1:8b
embabel.models.embeddingServices.best=nomic-embed-text:latest
embabel.models.embeddingServices.cheapest=nomic-embed-text:latest
embabel.agent-platform.ranking.llm=llama3.1:8b```
It is quite difficult to guess and override the default gpt in the properties. I prefer Ollama for experimentation and testing.
The following should be at least a comment on the application.properties to enable devs to choose other llms: