providers: add OpenAI compatible provider

[saem]

Summary

Created OpenAI compatible model and embedding providers.

Details

The new provider is compatible with any OpenAI API endpoint. This includes OpenRouter, which has been subsumed as part of this change.

Detection has been added for:

• OpenAI
• LM Studio
• ollama
• vllm

This should allow for easy local model detection and usage.

---

• undo the consolidation of OpenRouter

Notes for Reviewers:

• I only have LM Studio setup so testing that locally
• full disclosure, this was developed via Gemini
• gemini went with two style changes that I'm not sure about:
  1. usage of mocks rather than process env vars + clean-up
  2. usage of constructor parameters for member declaration

[vercel]

@saem is attempting to deploy a commit to the rohitg00's projects Team on Vercel.

A member of the Team first needs to authorize it.

[coderabbitai]

Important

Review skipped

Draft detected.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro

Run ID: d1aac088-07a9-441f-a683-8af89bbc6f1f

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

• 🔍 Trigger review

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

[saem]

FYI, I'm:

• getting rid of the mocks and increasing test covering
• making sure I have LM Studio working end to end for me

---

I would like to know if the general idea of the PR (an openai router + detection for various local runtimes) is something that the project would like to see developed? I haven't spent much time on it, so it's fine if you're not interested.

[saem]

This should either be restored or the baseUrl + api prefix needs to be handled properly

[saem]

@rohitg00 apologies for the ping, just wondering if you're ok with this PR in spirit? If so I'll keep going otherwise I'll close it down.

[rohitg00]

I think, This is already addressed in today's release by someone.