[Feature] Add Free LLM Providers

[DFanso]

Add a free open/free LLM provider or providers

[Muneer320]

Hi! I'd like to work on this issue.

I suggest adding Groq as the primary free provider option

Main Reasons:

• Completely free tier with ~14,400 requests/day
• Very fast inference
• Supports Llama 3.2, Mixtral models
• API structure similar to existing OpenAI implementation (minimal code changes)

Additional options to consider:

• Ollama - Fully local/offline option (completely free, privacy-focused)
• Mistral AI - Free tier with Mistral-7B

I can implement Groq support following the existing provider pattern in the codebase, with proper error handling and documentation.

Could you assign this issue to me? I'm ready to start working on it.

[DFanso]

wow that's great @Muneer320 you can work on this

[DFanso]

ref #30