Skip to content

FoundryLocal with Qwen and Phi models

Pre-release
Pre-release

Choose a tag to compare

@thangchung thangchung released this 31 Dec 09:13
· 49 commits to main since this release
feat: Implement core entities and services for Semantic Cache API

- Added ConversationEntry, MetricsLog, UserPreference, and UserProfile entities.
- Created AgentMemoryService for managing user context and conversation history.
- Developed ChatService for handling chat interactions with caching and personalization.
- Introduced SemanticCacheService for semantic caching with Redis support.
- Implemented VectorSimilarityService for calculating cosine similarity between embeddings.
- Set up application configuration, including PostgreSQL and Redis integration.
- Added health checks and OpenTelemetry support for monitoring.
- Created integration tests for user retrieval, cache entries, and metrics.