Grok-1 Tool Support

[ngoiyaeric]

Current open source Grok does not support function calling.
https://x.ai/blog/grok-os
Do you guys have any backend for loading open source language models into your stack, something like ollama or llocal.

[alt-glitch]

Yes, we can add support for other models hosted through ollama/replicate etc.

As for tool calls, it is possible to set/add a flag like add_function_to_prompt = True which would then prompt the model to use the function calling spec and return the JSON of the tool call.