nightly

Automated nightly release, will be updated every day at 20:00 UTC

1.6.4-rc1

What's Changed

• feat(zerozone): disable append permit limiting by default (#3187) by @Gezi-lzq in #3188
• fix(zerozone): support old record magic0-1 by @superhx in #3190
• fix: allow automq.zone.cidr.blocks to be set via static server.property by @superhx in #3191
• feat(zerozone): make automq.zone.cidr.blocks non-sensitive by @superhx in #3193
• feat(release): release 1.6.4-rc1 by @superhx in #3195

Full Changelog: 1.6.4-rc0...1.6.4-rc1

1.6.4-rc0

What's Changed

• fix(zerozone): adapt to record magic 0-1 by @superhx in #3178
• feat(release): bump version to 1.6.4-rc0 by @superhx in #3180

Full Changelog: 1.6.3...1.6.4-rc0

1.6.3

What's Changed

• fix(s3wal): improve next() logic to handle pre-fetched records by @superhx in #3087
• feat(wal): expose wal uri & refactor BootstrapWal by @superhx in #3090
• feat(core): configurable iceberg snapshot expiration (#3077) by @Gezi-lzq in #3092
• test(coordinator): enhance commit status machine tests (#3089) by @Gezi-lzq in #3093
• fix(proto): enhance map field type resolution (#3094) by @Gezi-lzq in #3095
• fix(wal): revert the recovery modification in #3090 by @superhx in #3096
• feat(zerozone): optimize wal replaying via network transfer by @superhx in #3100
• fix(s3stream): fix array bounds check in ByteBufAlloc (#3102) by @superhx in #3103
• refactor(StreamRecordBatch): replace constructor with static factory method for improved clarity by @superhx in #3110
• chore(zerozone): set the request timeout to 30s by @superhx in #3118
• fix(zerozone): notify the listeners in appendAsFollower by @superhx in #3121
• feat(eventloop): add ref count to eventloop by @superhx in #3125
• chore(telemetry): delay retry after clean failure by @superhx in #3140
• chore: update automq version to 1.6.3-rc0 in configuration files by @Gezi-lzq in #3143
• fix(metrics): enhance updatePartitionBytesIn to support custom count … by @1sonofqiu in #3148
• feat(zerozone): dual mapping by @superhx in #3149
• fix(s3wal): update s3 wal upload interval default value (#3065) by @superhx in #3068
• fix(connect): do not print stack when s3 error by @woshigaopp in #3155
• fix(strimzi): fix qemu version in CI by @Rancho-7 in #3157
• feat(coordinator): add listener support for group load/unload events by @1sonofqiu in #3158
• perf(zerozone): optimize snapshot read cache memory fragmentation by @superhx in #3159
• perf(zerozone): isolate the ObjectRouterChannel's alloc by @superhx in #3161
• fix(e2e): change runner by @woshigaopp in #3164
• fix(e2e): change runner by @woshigaopp in #3167
• feat(router): implement RouterPermitLimiter for managing append permits (#3166) by @Gezi-lzq in #3168
• fix(perf): cherry pick fix backlog benchmark exits immediately due to time mismatch by @johnluoyx in #3173

Full Changelog: 1.6.2...1.6.3

1.6.3-rc0

What's Changed

• fix(s3wal): improve next() logic to handle pre-fetched records by @superhx in #3087
• feat(wal): expose wal uri & refactor BootstrapWal by @superhx in #3090
• feat(core): configurable iceberg snapshot expiration (#3077) by @Gezi-lzq in #3092
• test(coordinator): enhance commit status machine tests (#3089) by @Gezi-lzq in #3093
• fix(proto): enhance map field type resolution (#3094) by @Gezi-lzq in #3095
• fix(wal): revert the recovery modification in #3090 by @superhx in #3096
• feat(zerozone): optimize wal replaying via network transfer by @superhx in #3100
• fix(s3stream): fix array bounds check in ByteBufAlloc (#3102) by @superhx in #3103
• refactor(StreamRecordBatch): replace constructor with static factory method for improved clarity by @superhx in #3110
• chore(zerozone): set the request timeout to 30s by @superhx in #3118
• fix(zerozone): notify the listeners in appendAsFollower by @superhx in #3121
• feat(eventloop): add ref count to eventloop by @superhx in #3125
• chore(telemetry): delay retry after clean failure by @superhx in #3140
• chore: update automq version to 1.6.3-rc0 in configuration files by @Gezi-lzq in #3143

Full Changelog: 1.6.2...1.6.3-rc0

1.6.2

What's Changed

• feat(core): Replace fixed parameters with environment variables (#3075) by @superhx in #3078
• perf(zerozone): smooth the commit by @superhx in #3079
• fix(zerozone): snapshot miss the segment rolling by @superhx in #3081
• fix(logcache): fix logcacheblock leak by @superhx in #3085
• chore(version): release 1.6.2 by @superhx in #3084

Full Changelog: 1.6.1...1.6.2

1.6.1

What's Changed

• feat(logcache): limit max block count (#2982) by @superhx in #2983
• fix(zerozone2): fix the upgrade from v1 to v2 by @superhx in #2985
• perf(s3stream): compute compaction delay using min timestamp instead of sorting (#2984) by @Gezi-lzq in #2989
• feat(timestamp): enhance RecordBinder to support TIMESTAMP and TIME types in union handling (#2981) by @Gezi-lzq in #2988
• perf(zerozone2): smooth wal upload by @superhx in #2993
• perf(s3stream): parallel append & optimize logcache init by @superhx in #2995
• perf(s3stream): optimize logcache merge by @superhx in #2997
• perf(s3stream): optimize limiter lock range (#2998) by @superhx in #2999
• fix(wal): filter inner trim record for range get by @superhx in #3001
• feat(zerozone2): add overload protection (#3002) by @superhx in #3003
• fix(wal): fix leak caused by #3000 by @superhx in #3008
• feat(connect): support connect openTelemetry and log for 1.6 by @woshigaopp in #2961
• chore(metrics): move queue time record to AsyncNetworkBandwidthLimiter by @superhx in #3011
• fix(core): auto add ops metrcis by @woshigaopp in #3013
• perf(s3stream): async heavy log cache operation by @superhx in #3017
• fix(binder): enhance RecordBinder and TypeAdapter to support STRUCT type conversion (#3005) by @Gezi-lzq in #3023
• fix(logcache): guard cache free with writeLock by @superhx in #3022
• fix(schema): streamline schema change handling and enhance test coverage (#3019) by @Gezi-lzq in #3024
• feat(protobuf): enhance Protobuf data handling with LogicalMap support and enhance test coverage (#3020) by @Gezi-lzq in #3025
• chore(release): release 1.6.1-rc0 by @Gezi-lzq in #3026
• fix(network): fix potential ByteBuf LEAK in fetch by @superhx in #3028
• fix(benchmark): fix compression so it works even when not batching by @superhx in #3030
• fix(RecordAssembler): optimize field creation using Accessor (#3031) by @Gezi-lzq in #3032
• feat(s3stream): auto adjust walUploadThreshold by @superhx in #3035
• fix(metrics): inject offset metric register for txn commit (#3038) by @1sonofqiu in #3039
• fix(e2e): fix e2e 1.6 by @woshigaopp in #3042
• feat(failover): don't failover the recovering node by @superhx in #3044
• fix(failover): refresh failover task when the epoch bump by @superhx in #3048
• revert(wal): revert wal change in #3049 by @superhx in #3051
• fix(core): fix e2e by @woshigaopp in #3050
• fix(metastream): compaction may drop certain keys by @superhx in #3055
• fix(s3wal): handle hollow after trim by @superhx in #3057
• revert(s3wal): handle hollow after trim by @superhx in #3059
• feat(s3stream): S3 API timeout can be configured via the path parameter by @superhx in #3062
• fix(s3stream): may trim more data than expected by @superhx in #3063
• fix(zerozone2): bump the commitEpoch when there is no inflight requests by @superhx in #3066
• chore(version): release 1.6.1 by @Gezi-lzq in #3070

Full Changelog: 1.6.0...1.6.1

1.6.1-rc0

What's Changed

• feat(logcache): limit max block count (#2982) by @superhx in #2983
• fix(zerozone2): fix the upgrade from v1 to v2 by @superhx in #2985
• perf(s3stream): compute compaction delay using min timestamp instead of sorting (#2984) by @Gezi-lzq in #2989
• feat(timestamp): enhance RecordBinder to support TIMESTAMP and TIME types in union handling (#2981) by @Gezi-lzq in #2988
• perf(zerozone2): smooth wal upload by @superhx in #2993
• perf(s3stream): parallel append & optimize logcache init by @superhx in #2995
• perf(s3stream): optimize logcache merge by @superhx in #2997
• perf(s3stream): optimize limiter lock range (#2998) by @superhx in #2999
• fix(wal): filter inner trim record for range get by @superhx in #3001
• feat(zerozone2): add overload protection (#3002) by @superhx in #3003
• fix(wal): fix leak caused by #3000 by @superhx in #3008
• feat(connect): support connect openTelemetry and log for 1.6 by @woshigaopp in #2961
• chore(metrics): move queue time record to AsyncNetworkBandwidthLimiter by @superhx in #3011
• fix(core): auto add ops metrcis by @woshigaopp in #3013
• perf(s3stream): async heavy log cache operation by @superhx in #3017
• fix(binder): enhance RecordBinder and TypeAdapter to support STRUCT type conversion (#3005) by @Gezi-lzq in #3023
• fix(logcache): guard cache free with writeLock by @superhx in #3022
• fix(schema): streamline schema change handling and enhance test coverage (#3019) by @Gezi-lzq in #3024
• feat(protobuf): enhance Protobuf data handling with LogicalMap support and enhance test coverage (#3020) by @Gezi-lzq in #3025
• chore(release): release 1.6.1-rc0 by @Gezi-lzq in #3026

Full Changelog: 1.6.0...1.6.1-rc0

1.6.0

What's Changed

• fix(e2e): cherry pick to fix e2e by @woshigaopp in #2756
• feat(zerozone2): add zero zone v2 support by @superhx in #2767
• feat(all): cherry-pick by @superhx in #2774
• chore(metrics): optimize metrics name mapping in S3MetricsExporter (#2775) by @Gezi-lzq in #2776
• fix(core): fix lock object error when implementing singleton pattern by @superhx in #2779
• fix(zerozone2): fix failover bug caused by #2764 by @superhx in #2781
• chore(config): dynamic change config based on heap size by @superhx in #2783
• chore(metrics): unify object wal metrics by @superhx in #2785
• refactor(zerozone2): make wal provider more extensible (#2787) by @superhx in #2788
• feat(zerozone2): force route to local by @superhx in #2790
• chore(zerozone2): rename channelOffset targetNodeId to attributes by @superhx in #2794
• chore(e2e): accelerate e2e by @superhx in #2800
• feat(java): set min java version to 17 by @superhx in #2804
• fix(zerozone2): fix potential WAL reset overflow BUG by @superhx in #2806
• perf(zerozone2): optimize the wal batch upload strategy by @superhx in #2810
• chore(workflows): add publish maven package workflow by @superhx in #2813
• fix(workflow): set the gradle version by @superhx in #2815
• feat: enhanced table topic conversion function by @Gezi-lzq in #2818
• chore(config): update default commit interval to 1 minute for table topic (#2819) by @Gezi-lzq in #2820
• feat(reassign): optimize partition reassignment to avoid client fast retry by @superhx in #2822
• feat(release): release 1.6.0-rc0 by @superhx in #2823
• feat(nfs-wal): initial implementation of nfs wal by @allenzhu in #2824
• feat(strimzi): add docker build workflow for strimzi by @Rancho-7 in #2826
• feat(docker): kafka docker image adapt by @1sonofqiu in #2830
• fix(converter): update subject and message name retrieval in ConverterFactory and WorkerConfig (#2831) by @Gezi-lzq in #2832
• fix(config): add support for latest schema subject and message name configuration in TopicConfig and WorkerConfig (#2834) by @Gezi-lzq in #2835
• fix(zerozone2): partition open conflict by @superhx in #2837
• fix(config): remove exception for invalid list string in TableTopicConfigValidator (#2836) by @Gezi-lzq in #2839
• fix(s3stream): fix buf leak when recover fail by @superhx in #2842
• feat: add tabletopic e2e case (#2827) by @Gezi-lzq in #2840
• fix(log): fix potential fetch NPE when the partition is closing by @superhx in #2847
• fix(zerozone2): adapt to txn by @superhx in #2851
• fix(metrics): fix percentile metrics (#2849) by @allenzhu in #2852
• fix(zerozone2): fix reset bug cause skip by @superhx in #2854
• feat(metrics): enhance metrics for benchmark (#2856) by @allenzhu in #2857
• fix(zerozone2): await subscriber close by @superhx in #2859
• feat(metrics): enhance metrics for benchmark (#2860) by @allenzhu in #2861
• fix(zerozone2): fix the expired offsetForLeaderEpoch by @superhx in #2864
• feat: enhance schema handling and optimize record processing (#2855) by @Gezi-lzq in #2862
• fix(zerozone2): close snapshotReadPartitionsManager by @superhx in #2867
• fix(metrics): set the interval for the lazy-created histogram by @superhx in #2869
• chore(s3stream): remove useless wal code by @superhx in #2871
• feat(wal): simple direct channel wrapper by @superhx in #2874
• feat(converter): support union types for list and map conversions in AvroValueAdapter (#2872) by @Gezi-lzq in #2878
• feat(perf): add Avro and Protobuf performance test cases and related configurations (#2873) by @Gezi-lzq in #2879
• fix(partition): handle null partition spec in commit response (#2877) by @Gezi-lzq in #2880
• feat(metrics): integrate new metrics for table delay, fields per second, and event loop busy ratio (#2876) by @Gezi-lzq in #2881
• feat(metadata): add retain and release methods for improved image management (#2882) by @Gezi-lzq in #2884
• fix(wal): limit bulk upload delay by @superhx in #2887
• fix(wal): try drain all waiting upload bulks by @superhx in #2889
• fix(zerozone2): gracefully await subscriber close by @superhx in #2895
• feat(tests): add Protobuf ConverterTest for comprehensive Protobuf conversion validation (#2885) by @Gezi-lzq in #2891
• fix(s3stream): fix potential merge read fail by @superhx in #2897
• fix(issue2902): change Verification.waitingRequests to unbounded queue to fix the deadlock by @superhx in #2904
• feat(benchmark): enhance BenchmarkResult to track duration in nanoseconds and add field count metrics (#2898) by @Gezi-lzq in #2901
• fix(zerozone2): guard snapshot by lock by @superhx in #2908
• fix(zerozone2): fix txn record overwrite by mistake by @superhx in #2906
• chore(zerozone2): clean up s3stream metrics by @superhx in #2910
• fix(zerozone2): fix epoch missing update when there isn't new record by @superhx in #2912
• fix(log): elastic log supports truncate by @superhx in #2914
• feat(avro): simplify union handling in AvroValueAdapter and add support for nested union types (#2916) by @Gezi-lzq in #2918
• fix: ensure S3 endpoint is not required for table topic since AWS client can guess it most of the time (#2915) by @Gezi-lzq in #2917
• feat(release): release 1.6.0-rc1 by @Gezi-lzq in #2919
• fix(zerozone2): fix the snapshot to avoid consuming abort txn record by @superhx in #2921
• fix(zerozone2): support lazy stream by @superhx in #2923
• feat(all): cherry pick from main by @superhx in #2927
• fix(zerozone2): reset replayer when reset subscriber by @superhx in #2930
• feat(zerozone2): return NOT_LEADER_OR_FOLLOWER to stale produce by @superhx in #2932
• feat(security): enhance ClientUtils to include listener-specific security settings (#2933) by @Gezi-lzq in #2935
• fix(zerozone2): fix bug caused by #2929 by @superhx in #2937
• fix(zerozone2): release after append & better snapshot replay by @superhx in #2939
• feat(release): release 1.6.0-rc2 by @Gezi-lzq in #2941
• fix(zerozone2): fix duplicated release by @superhx in #2943
• chore(zerozone2): isolate the record encode allocator by @superhx in #2945
• fix(zerozone2): fail the recover when decode fail by @superhx in #2947
• perf(s3stream): optimize the doRangeRead GC issue caused by #2764 by @superhx in #2949
• fix(zerzone2): fix commited epoch not bump when there is gracefully shutdown node by @superhx in #2952
• feat(zerozone2): response retryable error when route out get UNKNOWN_SERVER_ERROR by @superhx in #2954
• feat(failover): remove the controller limitation by @superhx in #2956
• chore(zerozone2): schedule logging proxy mapping by @superhx in #2958
• feat(zerozone2): async start RouterChannel and ConfirmWAL by @superhx in #2960
• feat(zerozone2): fast acks=0 by @superhx in #2964
• feat(core): add iceberg-nessie dependency for enhanced functionality (#2967) by @Gezi-lzq in #2968
• feat(table-coordinator): handle exceptions during snapshot expiration (#2969) by @Gezi-lzq in #2970
• chore(zerozone2): d...

1.6.0-rc2

What's Changed

• fix(zerozone2): fix the snapshot to avoid consuming abort txn record by @superhx in #2921
• fix(zerozone2): support lazy stream by @superhx in #2923
• feat(all): cherry pick from main by @superhx in #2927
• fix(zerozone2): reset replayer when reset subscriber by @superhx in #2930
• feat(zerozone2): return NOT_LEADER_OR_FOLLOWER to stale produce by @superhx in #2932
• feat(security): enhance ClientUtils to include listener-specific security settings (#2933) by @Gezi-lzq in #2935
• fix(zerozone2): fix bug caused by #2929 by @superhx in #2937
• fix(zerozone2): release after append & better snapshot replay by @superhx in #2939
• feat(release): release 1.6.0-rc2 by @Gezi-lzq in #2941

Full Changelog: 1.6.0-rc1...1.6.0-rc2