-
Notifications
You must be signed in to change notification settings - Fork 1.8k
Open
Labels
Description
Test the AOT support for the implemented models and adjust the AOT hints if needed.
- OpenAI - https://github.com/tzolov/spring-ai-aot-tests/tree/main/openai-aot-demo
- Azure OpenAI - https://github.com/tzolov/spring-ai-aot-tests/tree/main/azure-openai-aot-demo
- Amazon Bedrok
- Llama2 - https://github.com/tzolov/spring-ai-aot-tests/tree/main/bedrock-llama2-aot-demo
- Cohere - https://github.com/tzolov/spring-ai-aot-tests/tree/main/bedrock-cohere-aot-demo
- Titan - https://github.com/tzolov/spring-ai-aot-tests/tree/main/bedrock-titan-aot-demo
- Anthropic - https://github.com/tzolov/spring-ai-aot-tests/tree/main/bedrock-anthropic-aot-demo
- Anthropic3 - https://github.com/tzolov/spring-ai-aot-tests/tree/main/bedrock-anthropic3-aot-demo
- Jurassic2 - https://github.com/tzolov/spring-ai-aot-tests/tree/main/bedrock-jurassic2-aot-demo
- Google Vertex AI
- Google Vertex AI PaLM2 - https://github.com/tzolov/spring-ai-aot-tests/tree/main/vertexai-palm2-aot-demo
- Google Vertex AI Gemini - https://github.com/tzolov/spring-ai-aot-tests/tree/main/vertexai-gemini-aot-demo
- Ollama - https://github.com/tzolov/spring-ai-aot-tests/tree/main/ollama-aot-demo
- Transformers Embedding - https://github.com/tzolov/spring-ai-aot-tests/tree/main/transformers-onnx-aot-demo
GraalVM blocker issue: [GR-52267] Can't compile with Onnxruntime library, conflict with svm-enterprise.jar oracle/graal#8431 - PostgresML
- StabilityAI
- Mistral AI - https://github.com/tzolov/spring-ai-aot-tests/tree/main/mistralai-aot-demo
- Anthropic3 - https://github.com/tzolov/spring-ai-aot-tests/tree/main/anthropic-aot-demo