The API for AI Verse connecting with Java API. It uses Spring Boot REST API and server-side-events stream for real time data.
- Install Ollama
- Download gemma:2b
- Download orca-mini:3b
- Have Ollama running
- Ollama REST API runs on http://localhost:11434
- Run the application
- Swagger will be running on http://localhost:8080/swagger-ui/index.html
POST postStreamChat
endpoint is for sending the request.GET streamChatEvents
endpoint returns the server-side-events stream to be subscribed by the frontend.
- Follow the Setup section in AI Verse connecting with Java API
- No cancellation when it is generating response.
- The endpoint returning the server-side-events stream is global, it is not client or http request specific.