feat(agg): support paimon Java config aggregation.remove-record-on-delete

[duanyyyyyyy]

Purpose

Support Java version aggregation.remove-record-on-delete config

Linked issue: close #xxx

Tests

API and Format

support aggregation.remove-record-on-delete options

Documentation

In C++ version

Status AggregateMergeFunction::Add(KeyValue&& kv) {
    if (remove_record_on_delete_ && kv.value_kind == RowKind::Delete()) {
        current_delete_row_ = true;
        row_ = std::make_unique<GenericRow>(getters_.size());
        for (size_t i = 0; i < getters_.size(); i++) {
            row_->SetField(i, getters_[i](*(kv.value)));
        }
        row_->AddDataHolder(std::move(kv.value));
        latest_kv_ = std::move(kv);
        return Status::OK();   
    }
    current_delete_row_ = false;
}

for Java

public void add(KeyValue kv) {
    latestKv = kv;
    currentDeleteRow = removeRecordOnDelete && kv.valueKind() == RowKind.DELETE;
    if (currentDeleteRow) {
        row = new GenericRow(getters.length);
        initRow(row, kv.value());
        return;            
    }
}

Generative AI tooling

[CLAassistant]

All committers have signed the CLA.

[Copilot]

Pull request overview

Adds support for the aggregation.remove-record-on-delete table option so the aggregation merge engine can output DELETE records (instead of treating them purely as retractions), aligning behavior with the Java configuration.

Changes:

• Introduce new option constant aggregation.remove-record-on-delete and parse/store it in CoreOptions.
• Plumb the option into AggregateMergeFunction and adjust merge/output logic to return RowKind::Delete() when applicable.
• Add unit tests covering delete behavior with and without the new option.

Reviewed changes

Copilot reviewed 7 out of 7 changed files in this pull request and generated 2 comments.

Show a summary per file

File	Description
src/paimon/core/mergetree/compact/aggregate/aggregate_merge_function.cpp	Implements delete-short-circuit behavior when the new option is enabled and outputs DELETE via GetResult().
src/paimon/core/mergetree/compact/aggregate/aggregate_merge_function.h	Adds/initializes new merge-function state (remove_record_on_delete_, current_delete_row_).
src/paimon/core/mergetree/compact/aggregate/aggregate_merge_function_test.cpp	Adds tests for delete handling with/without aggregation.remove-record-on-delete.
src/paimon/core/core_options.h	Declares CoreOptions::AggregationRemoveRecordOnDelete().
src/paimon/core/core_options.cpp	Parses and stores the new option in CoreOptions.
include/paimon/defs.h	Declares the new option key in Options.
src/paimon/common/defs.cpp	Defines the new option key string literal.

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.