Skip to content

Spring AI example testing against NVIDIA NIM provided by Testcontainers

Notifications You must be signed in to change notification settings

eddumelendez/spring-ai-nvidia

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Spring AI NVIDIA

Spring AI example tested against NVIDIA NIM container provided by Testcontainers.

  1. Create an NVIDIA account and generate NGC_API_KEY. Follow the following steps https://docs.nvidia.com/nim/large-language-models/latest/getting-started.html#option-2-from-ngc
  2. Run the application
./mvnw spring-boot:test-run
  1. Watch NVIDIA container logs
docker logs -f $(docker ps --format "{{.ID}}" --filter ancestor="nvcr.io/nim/meta/llama3-8b-instruct:1.0.0")
  1. Perform a request against the Spring app
http :8080/chat

About

Spring AI example testing against NVIDIA NIM provided by Testcontainers

Topics

Resources

Stars

Watchers

Forks

Sponsor this project

 

Languages