Skip to content

[SUPPORT]--source-ordering-field should be deprecated to honor precombine field #12002

@bithw1

Description

@bithw1

I am using Hudi 0.15, I find that ORDERING_FIELD has been deprecated with PRECOMBINE_FIELD_NAME,

  /** @deprecated Use {@link HoodieWriteConfig#PRECOMBINE_FIELD_NAME} and its methods instead */
  @Deprecated
  public static final ConfigProperty<String> ORDERING_FIELD = ConfigProperty
      .key(PAYLOAD_ORDERING_FIELD_PROP_KEY)
      .defaultValue("ts")
      .markAdvanced()
      .withDocumentation("Table column/field name to order records that have the same key, before "
          + "merging and writing to storage.");

but HoodieStreamer still use --source-ordering-field as parameter, I think HoodieStreamer should also deprecate --source-ordering-field and introduce a new parameter to honor precombine field to make concept consistent

    @Parameter(names = {"--source-ordering-field"}, description = "Field within source record to decide how"
        + " to break ties between records with same key in input data. Default: 'ts' holding unix timestamp of record")
    public String sourceOrderingField = "ts";

Metadata

Metadata

Assignees

No one assigned

    Labels

    type:refactorCode refactoring and cleanup

    Type

    No type

    Projects

    Status

    ✅ Done

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions