v1.5.0

Major Features 🔥

• Introducing Serving
• Accumulator
• Contextual Debugging

Recommend SDK

• Please use 0.9 and above. Refer Compatibility Matrix
• Contextual debugging only available for MonoVertex

🚨 Breaking Change 🚨

• None

Experimental 🚀

• Async data movement in Numaflow backed by Rust

What's Changed

• feat: add sdk infomation metrics by @whynowy in #2208
• feat: use sidecar for ud containers [Breaking k8s < v1.29] by @whynowy in #2230
• feat: Built-in Pulsar source by @BulkBeing in #2237
• feat: Asynchronous Streaming for Source and Sink in Numaflow Core by @yhl25 in #2251
• feat: counter metrics visualizer for pipeline by @adarsh0728 in #2238
• feat: Introducing Tracker to track completeness of the Message by @yhl25 in #2264
• feat: Asynchronous Map Implementation for Pipeline by @yhl25 in #2295
• feat: Added support for kafka OAuth authentication by @SzymonZebrowski in #2257
• feat: contextual flow for metrics by @veds-g in #2345
• feat: rows/page dropbox. Fixes #1764 by @SaniyaKalamkar in #2337
• feat: adaptive lookback for monovertex by @kohlisid in #2373
• feat: add sqs source by @cosmic-chichu in #2355
• feat: Accumulator by @yhl25 in #2475
• feat: validating webhook for MonoVertex by @whynowy in #2497
• feat: surface application errors by @adarsh0728 in #2499
• feat: errors tab for application errors by @veds-g in #2473
• feat: [experimental] start golang vs. rust image based on env (#2537) by @vigith in #2538
• feat: persist error in case of partial/no responses from udf by @adarsh0728 in #2539
• feat: Builtin serve sink by @BulkBeing in #2551
• feat: Support for pending count with Adaptive lookback by @RohanAshar in #2486
• feat: Improves Serving Latency and Throughput by @yhl25 in #2564

Installation

kubectl create namespace numaflow-system

# Install numaflow controller and UI
kubectl apply -n numaflow-system -f https://github.com/numaproj/numaflow/releases/download/v1.5.0/install.yaml

# Install validating webhook (Optional)
kubectl apply -n numaflow-system -f https://github.com/numaproj/numaflow/releases/download/v1.5.0/validating-webhook-install.yaml

New Contributors

• @SzymonZebrowski made their first contribution in #2257
• @SaniyaKalamkar made their first contribution in #2337
• @jacque1ine made their first contribution in #2360
• @sesame0224 made their first contribution in #2457
• @t-wata made their first contribution in #2466
• @ccpeng made their first contribution in #2504
• @borkox made their first contribution in #2526

Full Changelog: v1.4.6...v1.5.0