Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for Spring Cloud Bindings #499

Closed
ThomasVitale opened this issue Mar 23, 2024 · 0 comments
Closed

Support for Spring Cloud Bindings #499

ThomasVitale opened this issue Mar 23, 2024 · 0 comments

Comments

@ThomasVitale
Copy link
Contributor

ThomasVitale commented Mar 23, 2024

The Service Binding API is a Kubernetes specification to automatically bind backing services to applications. In the Spring ecosystem, the Spring Cloud Bindings library provides convenient auto-configuration for out-of-the-box bindings to several backing services that Spring Boot supports.

It would be great to add a Cloud Bindings module to the Spring AI project with auto-configuration to automatically bind applications to model providers and vector stores provided by a Kubernetes-based platform. For example, Tanzu Application Platform could benefit from this new module since Service Bindings are used to bind backing services to Tanzu workloads already.

This is an example of a Service Binding Secret for an Ollama integration:

apiVersion: v1
kind: Secret
metadata:
    name: ollama
type: servicebinding.io/ollama
stringData:
    uri: "https:/ollama.llm.svc.cluster.local"

The auto-configuration in the new Cloud Bindings module would convert that information into:

spring.ai.ollama.base-url=https:/ollama.llm.svc.cluster.local

Here's a draft solution for a couple of model providers and vector stores to showcase how the new module would look like: #500. If it's of interest, I'd be happy to continue working on this and introduce support for more model providers and vector stores.

ThomasVitale added a commit to ThomasVitale/spring-ai that referenced this issue Mar 23, 2024
Fixes spring-projectsgh-499

Signed-off-by: Thomas Vitale <ThomasVitale@users.noreply.github.com>
bmoussaud pushed a commit to bmoussaud/spring-ai that referenced this issue May 27, 2024
Fixes spring-projectsgh-499

Signed-off-by: Thomas Vitale <ThomasVitale@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant