Сonnection testing error with Ollama

[kolovr14]

When running the configuration test, an error occurs: Error unmarshal: invalid character '<' looking for beginning of value.

[asdek]

Hello @kolovr14,

This looks like an issue on the LLM side - I faced something similar when the context size was too low. Please check out the guide with supported models.

Btw, the latency is way too high... I think it won't work well :(

[kolovr14]

I use llama318b

[asdek]

it's just for testing Ollama connectivity, not for production use...

according to my tests, all models under 32B aren't suitable for Automation mode, though gpt-oss-20b can work for Assistant mode

[kolovr14]

I got it. Thank you. I'll try it. No specific settings are required for gpt-oss-20b, please let me know

[asdek]

I used vLLM to run it, probably it should work on Ollama too.
vLLM version was 0.10.1+gptoss, now you can use something newer

[asdek]

Closes #102