Release 1.7.2
We're excited to announce the release of data-primals-engine version 1.7.2!
This is a significant update focused on bringing scalability, robustness, and an even smarter developer experience to the platform. With the introduction of horizontal scaling through clustering and a more streamlined AI provider integration, this release is all about making your applications more powerful and resilient.
✨ Major New Features: Horizontal Scaling with Clustering
The highlight of this release is the introduction of built-in support for clustering.
You can now run multiple instances of data-primals-engine in a distributed environment to handle increased load and ensure high availability.
- Master-Replica Architecture: Data is sharded by user, with a deterministically assigned master node for writes and multiple replicas for reads. This architecture ensures data locality and enhances read scalability.
- Last-Write-Wins (LWW) Replication: We've implemented a robust LWW replication strategy based on UTC timestamps. This model ensures eventual consistency across all nodes without requiring complex clock synchronization. It resolves conflicts predictably and guarantees that the latest data always prevails, providing a single source of truth.
- Flexible Topology: Our design avoids the need for a "quorum" or an odd number of nodes, giving you complete flexibility to scale your cluster from two to as many nodes as you need.
🚀 Enhancements & Fixes
Smarter AI Provider Integration
- Simplified Configuration: The engine now automatically discovers the first available AI provider by scanning for corresponding environment variables (e.g., OPENAI_API_KEY, GOOGLE_API_KEY). This makes setup faster and more intuitive.
- Default Model Support: AI providers now have default models configured, reducing the amount of setup required to get started with AI features.Security and Stability
- Major Security Updates: We've updated key dependencies, including Vite, markdown-it, and react-router, to patch vulnerabilities and keep the engine secure.
- Worker Path Fixes: Resolved an issue with worker source paths, improving reliability and build consistency when using the engine as a library.
- UI Consistency: Fixed several inconsistencies in the client-side data layout interface for a smoother and more predictable user experience.
We encourage everyone to update to version 1.7.2 to take advantage of these new features and improvements. As always, your feedback is invaluable to us. Check out the documentation for more details and happy coding