Spring AI example tested against NVIDIA NIM container provided by Testcontainers.
- Create an NVIDIA account and generate
NGC_API_KEY
. Follow the following steps https://docs.nvidia.com/nim/large-language-models/latest/getting-started.html#option-2-from-ngc - Run the application
./mvnw spring-boot:test-run
- Watch NVIDIA container logs
docker logs -f $(docker ps --format "{{.ID}}" --filter ancestor="nvcr.io/nim/meta/llama3-8b-instruct:1.0.0")
- Perform a request against the Spring app
http :8080/chat