Skip to content

Apache Storm 3.0.0

Latest

Choose a tag to compare

@reiabreu reiabreu released this 22 Jul 22:27

What's Changed

πŸš€ New Features

  • Removed all uses of Clojure, version 3.0.0-SNAPSHOT by @jnioche in #8537
  • build: introduce aggregator modules and unify pom display names by @rzo1 in #8541
  • storm-submit-tools: modernize Java code, no API surface changes by @rzo1 in #8582
  • Bump Java to 21, update docs for Storm 3.x and javadoc.io migration by @rzo1 in #8594
  • Introduce jitter metric based on RFC 1889 Appendix A by @GGraziadei in #8586
  • Zstd compression for thrift serialization (storm cluster state) by @GGraziadei in #8653
  • Make storm more windows friendly by @sigee in #8699
  • Fix checkstyle violations (#8585 - Phase 3 - Part 1) by @sigee in #8702
  • Docker compose local (dev) distributed Storm cluster with full observability and network simulation by @GGraziadei in #8706
  • Add tuple compression for inter-worker communication by @GGraziadei in #8707
  • Optimize ZooKeeper read requests and remove redundant checks by @GGraziadei in #8714
  • EvenScheduler: opt-in round-robin rebalance onto returning idle supervisors by @mwkang in #8778
  • Skip stale worker heartbeats from orphaned worker directories by @mwkang in #8789
  • Isolation Scheduler Hosts Sorting | Add secondary sort (No of free slots) and tertiary sort (Hostname) by @meetjain74 in #8709
  • Add AIMD based dynamic producer batch sizing to JCQueue by @GGraziadei in #8796
  • scheduler: replace reflection with @VisibleForTesting in IsolationSchedulerTest by @reiabreu in #8811
  • Improve RELEASING.md accuracy and completeness by @reiabreu in #8813
  • Add jitter control loop and JitterAwareStreamGrouping by @GGraziadei in #8593
  • ci: add ASF allowlist check for GitHub Actions (Dependabot guard) by @rzo1 in #8817
  • build: run ASF allowlist check on every PR so the required check reports by @rzo1 in #8887
  • Bump Java baseline to 25 on master by @reiabreu in #8893
  • Decouple the control plane from the data plane on receive queues by @GGraziadei in #8892
  • Reduce binary distribution size: unbundle optional Hadoop/Kafka deps + de-duplicate shared jars by @rzo1 in #8819

πŸ› Bug Fixes

  • fix(topology_lag): Kafka Topology Lag breaking when no offsets are commited for topic/partition by @DiogoP98 in #8589
  • Remove shuffle post sorting assignable hosts in Isolation Scheduler by @meetjain74 in #8705
  • Fix Y2038 worker heartbeat overflow by migrating timestamps to i64 by @dpol1 in #8788
  • Fix late tuple stream serialization in windowed bolts by @dpol1 in #8790
  • Fix double max.free.per.topology cap in EvenScheduler idle rebalance by @mwkang in #8798
  • Filter worker heartbeats by per-topology timeout by @mwkang in #8800
  • Fix NPE in WorkerState.transferLocalBatch causing worker crashes by @dpol1 in #8896
  • Fix worker launch: add lib-common to the supervisor's worker classpath and restore the lib-worker drop-in directory by @reiabreu in #8905

πŸ“¦ Dependency Upgrades

  • build: replace storm-maven-plugins with git-commit-id-maven-plugin by @rzo1 in #8540
  • Bump cytoscape from 3.33.2 to 3.33.3 in /storm-webapp by @dependabot[bot] in #8578
  • Bump terser-webpack-plugin from 5.4.0 to 5.5.0 in /storm-webapp by @dependabot[bot] in #8577
  • Bump cypress from 15.13.0 to 15.14.2 in /storm-webapp by @dependabot[bot] in #8576
  • Bump datatables.net from 2.3.7 to 2.3.8 in /storm-webapp by @dependabot[bot] in #8575
  • Bump mockito.version from 5.14.2 to 5.23.0 in /examples by @dependabot[bot] in #8569
  • Bump io.github.git-commit-id:git-commit-id-maven-plugin from 9.0.1 to 10.0.0 in /examples by @dependabot[bot] in #8567
  • Bump activemq.version from 6.2.4 to 6.2.5 by @dependabot[bot] in #8543
  • Bump com.fasterxml.jackson:jackson-bom from 2.21.2 to 2.21.3 by @dependabot[bot] in #8548
  • Bump commons-codec:commons-codec from 1.21.0 to 1.22.0 by @dependabot[bot] in #8549
  • Bump org.apache.maven:maven-resolver-provider from 3.9.14 to 3.9.15 by @dependabot[bot] in #8551
  • Bump org.yaml:snakeyaml from 2.2 to 2.6 in /examples by @dependabot[bot] in #8560
  • Bump spring.version from 7.0.6 to 7.0.7 by @dependabot[bot] in #8550
  • Bump joda-time:joda-time from 2.14.1 to 2.14.2 by @dependabot[bot] in #8546
  • Bump activemq.version from 6.2.4 to 6.2.5 in /examples by @dependabot[bot] in #8557
  • Bump commons-codec:commons-codec from 1.21.0 to 1.22.0 in /examples by @dependabot[bot] in #8556
  • Bump netty-tcnative.version from 2.0.75.Final to 2.0.77.Final by @dependabot[bot] in #8554
  • Bump prometheus.client.version from 1.5.1 to 1.6.1 by @dependabot[bot] in #8544
  • Bump com.google.code.gson:gson from 2.13.2 to 2.14.0 by @dependabot[bot] in #8547
  • Bump commons-io:commons-io from 2.21.0 to 2.22.0 by @dependabot[bot] in #8545
  • Bump com.fasterxml.jackson:jackson-bom from 2.21.2 to 2.21.3 in /examples by @dependabot[bot] in #8559
  • Bump commons-io:commons-io from 2.21.0 to 2.22.0 in /examples by @dependabot[bot] in #8564
  • Bump spring.version from 7.0.6 to 7.0.7 in /examples by @dependabot[bot] in #8558
  • Bump io.github.git-commit-id:git-commit-id-maven-plugin from 9.0.1 to 10.0.0 by @dependabot[bot] in #8555
  • Bump com.fasterxml.jackson.core:jackson-databind from 2.21.2 to 2.21.3 by @dependabot[bot] in #8552
  • Bump com.google.code.gson:gson from 2.13.2 to 2.14.0 in /examples by @dependabot[bot] in #8566
  • Bump datatables.net-bs5 from 2.3.7 to 2.3.8 in /storm-webapp by @dependabot[bot] in #8574
  • Bump datatables.net-dt from 2.3.7 to 2.3.8 in /storm-webapp by @dependabot[bot] in #8572
  • Bump start-server-and-test from 3.0.0 to 3.0.2 in /storm-webapp by @dependabot[bot] in #8571
  • Bump redis.clients:jedis from 7.4.1 to 7.5.0 by @dependabot[bot] in #8553
  • Bump webpack from 5.105.4 to 5.106.2 in /storm-webapp by @dependabot[bot] in #8573
  • Remove dead dependencyManagement entries and unused version properties by @rzo1 in #8580
  • Bump fast-uri from 3.1.0 to 3.1.2 in /storm-webapp by @dependabot[bot] in #8592
  • Bump org.apache.thrift:libthrift from 0.22.0 to 0.23.0 by @dependabot[bot] in #8638
  • Bump org.apache.logging.log4j:log4j-bom from 2.25.4 to 2.26.0 by @dependabot[bot] in #8634
  • Bump io.netty:netty-bom from 4.2.12.Final to 4.2.13.Final in /examples by @dependabot[bot] in #8633
  • Bump com.github.ben-manes.caffeine:caffeine from 3.2.3 to 3.2.4 by @dependabot[bot] in #8629
  • Bump org.apache:apache from 37 to 38 by @dependabot[bot] in #8625
  • Bump com.github.ben-manes.caffeine:caffeine from 3.2.3 to 3.2.4 in /examples by @dependabot[bot] in #8623
  • Bump org.apache:apache from 37 to 38 in /examples by @dependabot[bot] in #8618
  • Bump io.netty:netty-bom from 4.2.12.Final to 4.2.13.Final by @dependabot[bot] in #8616
  • Bump com.puppycrawl.tools:checkstyle from 8.2 to 13.4.2 in /examples by @dependabot[bot] in #8615
  • Bump terser-webpack-plugin from 5.5.0 to 5.6.0 in /storm-webapp by @dependabot[bot] in #8612
  • Bump jetty.version from 12.1.8 to 12.1.9 in /examples by @dependabot[bot] in #8611
  • Bump vis-data from 8.0.3 to 8.0.4 in /storm-webapp by @dependabot[bot] in #8608
  • Bump org.apache.thrift:libthrift from 0.22.0 to 0.23.0 in /examples by @dependabot[bot] in #8597
  • Bump start-server-and-test from 3.0.2 to 3.0.4 in /storm-webapp by @dependabot[bot] in #8605
  • Bump vis-network from 10.0.2 to 10.0.3 in /storm-webapp by @dependabot[bot] in #8600
  • Bump org.apache.logging.log4j:log4j-bom from 2.25.4 to 2.26.0 in /examples by @dependabot[bot] in #8598
  • Bump jetty.version from 12.1.8 to 12.1.9 by @dependabot[bot] in #8603
  • Bump systeminformation from 5.31.4 to 5.31.6 in /storm-webapp by @dependabot[bot] in #8654
  • Bump vis-network from 10.0.3 to 10.1.0 in /storm-webapp by @dependabot[bot] in #8656
  • Bump org.apache.maven:maven-resolver-provider from 3.9.15 to 3.9.16 by @dependabot[bot] in #8664
  • Bump cypress from 15.14.2 to 15.15.0 in /storm-webapp by @dependabot[bot] in #8659
  • Bump org.apache.commons:commons-configuration2 from 2.14.0 to 2.15.0 by @dependabot[bot] in #8671
  • Bump js-cookie from 3.0.5 to 3.0.7 in /storm-webapp by @dependabot[bot] in #8661
  • Bump slf4j.version from 2.0.17 to 2.0.18 by @dependabot[bot] in #8667
  • Bump slf4j.version from 2.0.17 to 2.0.18 in /examples by @dependabot[bot] in #8669
  • Bump cytoscape-dagre from 2.5.0 to 3.0.0 in /storm-webapp by @dependabot[bot] in #8657
  • Bump org.apache.commons:commons-configuration2 from 2.14.0 to 2.15.0 in /examples by @dependabot[bot] in #8668
  • Bump org.ow2.asm:asm from 9.9.1 to 9.10 in /examples by @dependabot[bot] in #8674
  • Bump org.ow2.asm:asm from 9.9.1 to 9.10 by @dependabot[bot] in #8676
  • Bump start-server-and-test from 3.0.4 to 3.0.5 in /storm-webapp by @dependabot[bot] in #8658
  • Bump tmp from 0.2.5 to 0.2.7 in /storm-webapp by @dependabot[bot] in #8711
  • Bump qs and @cypress/request in /storm-webapp by @dependabot[bot] in #8713
  • Bump io.netty:netty-bom from 4.2.13.Final to 4.2.14.Final in /examples by @dependabot[bot] in #8742
  • Bump activemq.version from 6.2.5 to 6.2.6 by @dependabot[bot] in #8715
  • Bump org.apache.commons:commons-configuration2 from 2.15.0 to 2.15.1 in /examples by @dependabot[bot] in #8738
  • Bump activemq.version from 6.2.5 to 6.2.6 in /examples by @dependabot[bot] in #8733
  • Bump org.apache.maven.plugins:maven-surefire-report-plugin from 3.5.5 to 3.5.6 by @dependabot[bot] in #8716
  • Bump webpack-cli from 7.0.2 to 7.0.3 in /storm-webapp by @dependabot[bot] in #8751
  • Bump terser-webpack-plugin from 5.6.0 to 5.6.1 in /storm-webapp by @dependabot[bot] in #8750
  • Bump js-yaml from 4.1.1 to 4.2.0 in /storm-webapp by @dependabot[bot] in #8748
  • Bump cytoscape from 3.33.3 to 3.33.4 in /storm-webapp by @dependabot[bot] in #8746
  • Bump com.puppycrawl.tools:checkstyle from 13.4.2 to 13.5.0 in /examples by @dependabot[bot] in #8741
  • Bump org.apache.kafka:kafka-clients from 4.2.0 to 4.3.0 in /examples by @dependabot[bot] in #8740
  • Bump com.github.luben:zstd-jni from 1.5.7-8 to 1.5.7-9 in /examples by @dependabot[bot] in #8739
  • Bump org.junit:junit-bom from 6.0.3 to 6.1.0 in /examples by @dependabot[bot] in #8737
  • Bump org.ow2.asm:asm from 9.10 to 9.10.1 in /examples by @dependabot[bot] in #8736
  • Bump org.apache.maven.plugins:maven-surefire-report-plugin from 3.5.5 to 3.5.6 in /examples by @dependabot[bot] in #8734
  • Bump metrics.version from 4.2.38 to 4.2.39 in /examples by @dependabot[bot] in #8732
  • Bump com.fasterxml.woodstox:woodstox-core from 7.1.1 to 7.2.0 in /examples by @dependabot[bot] in #8731
  • Bump com.fasterxml.woodstox:woodstox-core from 7.1.1 to 7.2.0 by @dependabot[bot] in #8730
  • Bump org.ow2.asm:asm from 9.10 to 9.10.1 by @dependabot[bot] in #8729
  • Bump io.netty:netty-bom from 4.2.13.Final to 4.2.14.Final by @dependabot[bot] in #8728
  • Bump storm.kafka.client.version from 4.2.0 to 4.3.0 by @dependabot[bot] in #8726
  • Bump org.apache.commons:commons-configuration2 from 2.15.0 to 2.15.1 by @dependabot[bot] in #8725
  • Bump org.apache.maven.plugins:maven-dependency-plugin from 3.10.0 to 3.11.0 by @dependabot[bot] in #8724
  • Bump org.junit:junit-bom from 6.0.3 to 6.1.0 by @dependabot[bot] in #8721
  • Bump com.github.luben:zstd-jni from 1.5.7-8 to 1.5.7-9 by @dependabot[bot] in #8720
  • Bump redis.clients:jedis from 7.5.0 to 7.5.2 by @dependabot[bot] in #8719
  • Bump metrics.version from 4.2.38 to 4.2.39 by @dependabot[bot] in #8718
  • Bump dropwizard.version from 5.0.1 to 5.0.2 by @dependabot[bot] in #8717
  • Bump cypress from 15.15.0 to 15.16.0 in /storm-webapp by @dependabot[bot] in #8749
  • Bump js-cookie from 3.0.7 to 3.0.8 in /storm-webapp by @dependabot[bot] in #8747
  • Bump webpack from 5.106.2 to 5.107.2 in /storm-webapp by @dependabot[bot] in #8745
  • Bump surefire.version from 3.5.5 to 3.5.6 in /examples by @dependabot[bot] in #8735
  • Bump com.fasterxml.jackson.core:jackson-databind from 2.21.3 to 2.22.0 by @dependabot[bot] in #8723
  • Bump surefire.version from 3.5.5 to 3.5.6 by @dependabot[bot] in #8722
  • Bump actions/setup-java from 5.2.0 to 5.3.0 by @dependabot[bot] in #8791
  • Bump form-data from 4.0.5 to 4.0.6 in /storm-webapp by @dependabot[bot] in #8793
  • build(deps): bump actions/checkout from 6.0.3 to 7.0.0 by @dependabot[bot] in #8794
  • build(deps): bump burnett01/rsync-deployments from 8.0.5 to 9.0.0 by @dependabot[bot] in #8801
  • build(deps): bump actions/cache from 5.0.5 to 6.0.0 by @dependabot[bot] in #8802
  • build(deps): bump actions/setup-python from 6.2.0 to 6.3.0 by @dependabot[bot] in #8803
  • build(deps): bump actions/setup-java from 5.3.0 to 5.4.0 by @dependabot[bot] in #8808
  • build(deps): bump actions/cache from 6.0.0 to 6.1.0 by @dependabot[bot] in #8814
  • build(deps-dev): bump webpack from 5.107.2 to 5.108.3 in /storm-webapp by @dependabot[bot] in #8854
  • build(deps): bump activemq.version from 6.2.6 to 6.2.7 by @dependabot[bot] in #8827
  • build(deps): bump cytoscape from 3.33.4 to 3.34.0 in /storm-webapp by @dependabot[bot] in #8856
  • build(deps-dev): bump cypress from 15.16.0 to 15.18.0 in /storm-webapp by @dependabot[bot] in #8853
  • build(deps): bump com.puppycrawl.tools:checkstyle from 13.5.0 to 13.7.0 in /examples by @dependabot[bot] in #8851
  • build(deps): bump com.github.luben:zstd-jni from 1.5.7-9 to 1.5.7-11 in /examples by @dependabot[bot] in #8850
  • build(deps): bump org.apache:apache from 38 to 39 in /examples by @dependabot[bot] in #8849
  • build(deps): bump org.apache.kafka:kafka-clients from 4.3.0 to 4.3.1 in /examples by @dependabot[bot] in #8848
  • build(deps): bump org.junit:junit-bom from 6.1.0 to 6.1.1 in /examples by @dependabot[bot] in #8847
  • build(deps): bump com.fasterxml.woodstox:woodstox-core from 7.2.0 to 7.2.1 in /examples by @dependabot[bot] in #8846
  • build(deps): bump jetty.version from 12.1.9 to 12.1.10 in /examples by @dependabot[bot] in #8845
  • build(deps): bump com.google.errorprone:error_prone_annotations from 2.49.0 to 2.50.0 in /examples by @dependabot[bot] in #8844
  • build(deps): bump activemq.version from 6.2.6 to 6.2.7 in /examples by @dependabot[bot] in #8843
  • build(deps): bump byte-buddy.version from 1.18.8 to 1.18.10 in /examples by @dependabot[bot] in #8842
  • build(deps-dev): bump org.jacoco:jacoco-maven-plugin from 0.8.14 to 0.8.15 by @dependabot[bot] in #8841
  • build(deps): bump io.netty:netty-bom from 4.2.14.Final to 4.2.15.Final in /examples by @dependabot[bot] in #8840
  • build(deps): bump io.netty:netty-bom from 4.2.14.Final to 4.2.15.Final by @dependabot[bot] in #8839
  • build(deps): bump cytoscape-dagre from 3.0.0 to 4.0.0 in /storm-webapp by @dependabot[bot] in #8858
  • build(deps-dev): bump start-server-and-test from 3.0.5 to 3.0.11 in /storm-webapp by @dependabot[bot] in #8857
  • build(deps): bump com.fasterxml.woodstox:woodstox-core from 7.2.0 to 7.2.1 by @dependabot[bot] in #8838
  • build(deps): bump spring.version from 7.0.7 to 7.0.8 in /examples by @dependabot[bot] in #8837
  • build(deps): bump com.zaxxer:HikariCP from 7.0.2 to 7.1.0 in /examples by @dependabot[bot] in #8836
  • build(deps): bump prometheus.client.version from 1.6.1 to 1.8.0 by @dependabot[bot] in #8820
  • build(deps): bump jetty.version from 12.1.9 to 12.1.10 by @dependabot[bot] in #8822
  • build(deps): bump org.apache:apache from 38 to 39 by @dependabot[bot] in #8823
  • build(deps): bump spring.version from 7.0.7 to 7.0.8 by @dependabot[bot] in #8824
  • build(deps): bump commons-logging:commons-logging from 1.3.6 to 1.4.0 by @dependabot[bot] in #8825
  • build(deps): bump org.junit:junit-bom from 6.1.0 to 6.1.1 by @dependabot[bot] in #8826
  • build(deps): bump org.apache.hbase:hbase-client from 2.6.5-hadoop3 to 2.6.6-hadoop3 by @dependabot[bot] in #8828
  • build(deps): bump byte-buddy.version from 1.18.8 to 1.18.10 by @dependabot[bot] in #8829
  • build(deps-dev): bump com.github.eirslett:frontend-maven-plugin from 2.0.0 to 2.0.1 by @dependabot[bot] in #8830
  • build(deps): bump com.google.errorprone:error_prone_annotations from 2.49.0 to 2.50.0 by @dependabot[bot] in #8831
  • build(deps): bump com.zaxxer:HikariCP from 7.0.2 to 7.1.0 by @dependabot[bot] in #8832
  • build(deps): bump storm.kafka.client.version from 4.3.0 to 4.3.1 by @dependabot[bot] in #8833
  • build(deps): bump commons-logging:commons-logging from 1.3.6 to 1.4.0 in /examples by @dependabot[bot] in #8834
  • build(deps): bump com.github.luben:zstd-jni from 1.5.7-9 to 1.5.7-11 by @dependabot[bot] in #8835
  • build(deps-dev): bump webpack-cli from 7.0.3 to 7.1.0 in /storm-webapp by @dependabot[bot] in #8852
  • build(deps): bump netty-tcnative.version from 2.0.77.Final to 2.0.80.Final by @dependabot[bot] in #8821
  • build(deps): bump js-yaml from 4.2.0 to 5.2.0 in /storm-webapp by @dependabot[bot] in #8855
  • build(deps): bump actions/setup-java from 5.4.0 to 5.5.0 by @dependabot[bot] in #8894
  • build(deps): bump actions/setup-node from 6.4.0 to 7.0.0 by @dependabot[bot] in #8898
  • build(deps-dev): bump systeminformation from 5.31.6 to 5.31.17 in /storm-webapp by @dependabot[bot] in #8900

πŸ“– Documentation

  • docs: drop stale Clojure references after Clojure removal by @rzo1 in #8539
  • Fix outdated code references in message passing documentation by @Saurabh16-s in #8584
  • [STORM-3962] Update integration page for Kafka links by @Saurabh16-s in #8587
  • Update checkstyle and Modernize config (#8585 - Phase 1, Phase 2) by @sigee in #8700

New Contributors

Full Changelog: v2.8.9...v3.0.0