v0.10.0

Major Changes

• Side Inputs support to be able to broadcast slow updated data or configuration automatically without needing to load it during each message processing; see the detail in the proposal.
• Support join vertex and cycle (for retrying) topologies in the pipeline spec for more complex use cases.
• SDK changes for easier user-defined functions implementation.
• Deprecated cooldownSeconds for auto-scaling; use scaleUpCooldownSeconds and scaleDownCooldownSeconds instead.
• Added Vertex template to pipeline spec for common specs (such as metadata, resources, etc.) of the vertices in the same pipeline.
• UI improvements.

🚨 Breaking Change 🚨

SDKs updated to version 0.5.0 with significant changes to the signature and structure. The servers for each operation have been separated, and all types have been moved to specific packages. For example, the types required for writing map UDFs are now available in the mapper package, and similar changes have been made for other operations. Please update your SDKs accordingly.

⚠️ Note: Version 0.10.0 will only work for SDKs with a version greater than or equal to 0.5.0.

Check out our v0.10 release blog.

Pull Requests

v0.9.0...v0.10.0

Contributors

@KeranYang
@vigith
@yhl25
@juliev0
@chromevoid
@dpadhiar
@veds-g
@whynowy
@kohlisid
@xdevxy

Installation

kubectl create namespace numaflow-system
kubectl apply -n numaflow-system -f https://github.com/numaproj/numaflow/releases/download/v0.10.0/install.yaml