-
Notifications
You must be signed in to change notification settings - Fork 3.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
.Net Enable Usage of Custom Compatible Chat Message API Endpoints with OpenAI Connector + Examples #4753
.Net Enable Usage of Custom Compatible Chat Message API Endpoints with OpenAI Connector + Examples #4753
Conversation
I have never used LM-studio, but what this has common with the openai implementation? |
I assume this is temporary and having someone implement their own handlers and extension methods and whatnot isn't actually our answer for this, right? |
As stated in the Connectors ADR, while the biggest benefit of LM Studio is mimicking OpenAI's Endpoints and Contracts no specific Connector for this platform is needed, unless we have a specific requirement that the OpenAI connector isn't enough for consuming LM Studio Http APIs, we will suggest using the OpenAI's Connector. We will add an extra configuration option for the OpenAI connectors that won't require to manually define an Handler for it and investigate if the usage of the Endpoint configuration would alone suffice for this. |
@RogerBarreto, we should have a better 1st class story for connecting to popular local deployment channels like LLM Studio and Ollama, but in the meantime, I think your sample would be valuable for people who need to customize the OpenAI API endpoint. Could you update this PR to make it more "generic" (i.e., title the Kernel Syntax Example "custom OpenAI endpoint") so we can get this merged in? |
…nto features/lmstudio-examples
dotnet/src/Connectors/Connectors.OpenAI/CompatibilitySuppressions.xml
Outdated
Show resolved
Hide resolved
dotnet/src/Connectors/Connectors.OpenAI/Core/AzureSdk/OpenAIClientCore.cs
Outdated
Show resolved
Hide resolved
dotnet/src/InternalUtilities/src/Schema/JsonSchemaMapper.ReflectionHelpers.cs
Outdated
Show resolved
Hide resolved
dotnet/samples/KernelSyntaxExamples/Example88_CustomMessageAPIEndpoint.cs
Show resolved
Hide resolved
…h OpenAI Connector + Examples (microsoft#4753) ### Motivation and Context - Allow usage of custom Message API (OpenAI ChatCompletion Standard) compliant endpoints with the OpenAI Connector. - Refactoring of OpenAI Models and Classes Structure - Adding Examples on using the current changes against `LMStudio`, `Ollama` and `LocalAI` Message APIs. --------- Co-authored-by: Mark Wallace <127216156+markwallace-microsoft@users.noreply.github.com>
Motivation and Context
Resolves #5353
LMStudio
,Ollama
andLocalAI
Message APIs.