-
Notifications
You must be signed in to change notification settings - Fork 47
Closed
Description
Add Grok/XAI support to the LLM abstraction
After implementing the new LLM abstraction with Anthropic support, we need to add support for Grok/XAI models.
Tasks
- Research the best way to interact with Grok/XAI directly (without Vercel AI SDK)
- Implement Grok/XAI adapter for our LLM abstraction
- Convert between our message format and Grok/XAI's format
- Handle tool calls and tool results properly
- Update configuration to support Grok/XAI models
- Add tests for Grok/XAI integration
Benefits
- Restore support for Grok/XAI models that was removed when reverting Vercel AI SDK
- Provide users with more model options
- Implement a cleaner, more reliable integration than the previous version
Metadata
Metadata
Assignees
Labels
No labels
Type
Projects
Milestone
Relationships
Development
Select code repository
Activity
bhouston commentedon Mar 12, 2025
/mycoder, can you implement a Grok integration and can you make a PR of the resulting implementation?
feat: add Grok/XAI support to the LLM abstraction
bhouston commentedon Mar 12, 2025
Hi @bhouston,
I've implemented the Grok/XAI integration as requested. The PR is available at #211.
The implementation includes:
Once the PR is merged, users will be able to:
mycoder config set XAI_API_KEY <key>
mycoder config set provider xai
mycoder config set model grok-2-1212
Let me know if you'd like any changes or have any questions about the implementation!