[hotfix][docs][Update datagen.md]Change the type of the "fields.#.null-rate" option in the DataGen SQL Connector to Float #27447

JavaLeb · 2026-01-20T01:36:08Z

Change the type of the "fields.#.null-rate" option in the DataGen SQL Connector to Float.

What is the purpose of the change

(For example: This pull request makes task deployment go through the blob server, rather than through RPC. That way we avoid re-transferring them on each deployment (during recovery).)

Brief change log

(for example:)

The TaskInfo is stored in the blob store on job creation time as a persistent artifact
Deployments RPC transmits only the blob storage reference
TaskManagers retrieve the TaskInfo from the blob cache

Verifying this change

Please make sure both new and modified tests in this PR follow the conventions for tests defined in our code quality guide.

(Please pick either of the following options)

This change is a trivial rework / code cleanup without any test coverage.

(or)

This change is already covered by existing tests, such as (please describe tests).

(or)

This change added tests and can be verified as follows:

(example:)

Added integration tests for end-to-end deployment with large payloads (100MB)
Extended integration test for recovery after master (JobManager) failure
Added test that validates that TaskInfo is transferred only once across recoveries
Manually verified the change by running a 4 node cluster with 2 JobManagers and 4 TaskManagers, a stateful streaming program, and killing one JobManager and two TaskManagers during the execution, verifying that recovery happens correctly.

Does this pull request potentially affect one of the following parts:

Dependencies (does it add or upgrade a dependency): (yes / no)
The public API, i.e., is any changed class annotated with @Public(Evolving): (yes / no)
The serializers: (yes / no / don't know)
The runtime per-record code paths (performance sensitive): (yes / no / don't know)
Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: (yes / no / don't know)
The S3 file system connector: (yes / no / don't know)

Documentation

Does this pull request introduce a new feature? (yes / no)
If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)

…tOfUpsertKeys (apache#27204) (apache#27215)

…m Kafka

…7232)

…tion logic in DefaultScheduler (apache#27234) - Introduce ResourceRequestPreMappings to compute the resource matching relationships when allocating all slots in bulk for balanced scheduling of streaming jobs in the default scheduler. - Introduce the test cases for ResourceRequestPreMappings. - Adapt the calculation logic of the TasksBalancedRequestSlotMatchingStrategy for bulk slot allocation using ResourceRequestPreMappings, in order to prevent job scheduling timeouts caused by untimely updates to the relationships between all requests and resources in load-balancing scenarios - Introduce TasksBalancedRequestSlotMatchingStrategyTest for enhancing the TasksBalancedRequestSlotMatchingStrategy testing. (cherry picked from commit b6f0eb6)

* [FLINK-38611][doc] Add doc for delta join (cherry picked from commit bcd8d7f) * [FLINK-38625][doc] Fix broken anchor links about the table options in Performance Tuning page (cherry picked from commit 1029df0)

…heduling. (apache#27241) (cherry picked from commit 7de3392)

…ZED TABLE` to doc

…inference in limited validator scope

…pache#27246)

…t count in DeltaJoinCache (apache#27253)

Co-authored-by: raoraoxiong <xiongraorao@gmail.com> Co-authored-by: Yun Tang <myasuka@live.com> This closes apache#27186

…onFunction & AsyncFunction work when taking the recursive field of composite type as input This closes apache#27259.

--------- Co-authored-by: Dian Fu <dianfu@apache.org>

… physical rules Co-authored-by: Stepan Stepanishchev <116617250+SteveStevenpoor@users.noreply.github.com>

… invoked under `SELECT` fails with `StackOverflow`

…e#27304)

…27311)

… self This closes apache#27331.

This closes apache#27363.

…anner

The "stable version" link in the warning banner for unreleased/out-of-date docs now redirects to the equivalent page in the stable docs instead of always redirecting to the homepage.

All documentation pages now include a canonical link tag pointing to the stable version (flink-docs-stable). This prevents search engines from indexing duplicate content across master, release, and stable versions, consolidating SEO value on the stable docs where users should land.

(cherry picked from commit 5da177d)

…countering a 404 (cherry picked from commit 1047406)

Change the type of the "fields.#.null-rate" option in the DataGen SQL Connector to Float

flinkbot · 2026-01-20T01:41:52Z

CI report:

0280f6b Azure: SUCCESS

Bot commands

The @flinkbot bot supports the following commands:

@flinkbot run azure re-run the last Azure build

davidradl · 2026-01-20T09:08:27Z

.../src/test/java/org/apache/flink/table/planner/plan/rules/logical/AsyncCalcSplitRuleTest.java

I am a bit confused. This change was for a change to datagen as per the PR title. It looks like you have expanded this hotfix to include other documentation - is this to bring it up to date with the version 2 stream? This seems a lot for a hot fix. You have also included a lot of code - I am not sure why . It would be better to separate out these changes and have Jiras for the non-trivial changes.

JavaLeb · 2026-01-20T09:45:10Z

I merely revised the document and did not make any changes to the code.
This change is for the Chinese version.
sorry, I don't know what to do, I just want to submit the revised the chinese version of the document.

JavaLeb · 2026-01-20T10:07:31Z

I will make a revision and close the current PR, then reopen a new one.

Hang Ruan and others added 30 commits November 10, 2025 10:41

Update for 2.2.0

81f86ae

[FLINK-38640][table-planner] Fix NPE in DeltaJoinUtil#isFilterOnOneSe…

b408850

…tOfUpsertKeys (apache#27204) (apache#27215)

[hotfix] [docs] Ververica URL and Product Name has been updated

6e89776

[hotfix][examples] Add Python examples on how to read binary data fro…

f9ad1b1

…m Kafka

[FLINK-38436][doc] Add vector search doc (apache#27216)

1bca9b9

[FLINK-38436][doc] Add Chinese version of vector search doc (apache#2…

d421622

…7232)

[FLINK-38611][doc] Add doc for delta join (apache#27225)

71fb419

* [FLINK-38611][doc] Add doc for delta join (cherry picked from commit bcd8d7f) * [FLINK-38625][doc] Fix broken anchor links about the table options in Performance Tuning page (cherry picked from commit 1029df0)

[FLINK-33392][docs] Add the documentation pages for balanced tasks sc…

30b5b97

…heduling. (apache#27241) (cherry picked from commit 7de3392)

[hotfix][docs] Add SHOW MATERIALIZED TABLES, `SHOW CREATE MATERIALI…

ca9f7b7

…ZED TABLE` to doc

[FLINK-38682][table-planner] Support unknown -> RAW cast during type …

f621ab6

…inference in limited validator scope

[FLINK-38686][doc] Add model table api documentation (apache#27243) (a…

434c800

…pache#27246)

[FLINK-38695][table-planner] Fix wrong metric about left cache reques…

ef31ad4

…t count in DeltaJoinCache (apache#27253)

[FLINK-36746][core] Fix the deadlock bug in SerializedThrowable

4fd5bea

Co-authored-by: raoraoxiong <xiongraorao@gmail.com> Co-authored-by: Yun Tang <myasuka@live.com> This closes apache#27186

[FLINK-38709][table][python] Fix ScalarFunctionSplitter to allow Pyth…

e666847

…onFunction & AsyncFunction work when taking the recursive field of composite type as input This closes apache#27259.

[FLINK-38700][python] Fix kubernetes pyflink application test

bf9cc5d

--------- Co-authored-by: Dian Fu <dianfu@apache.org>

[BP-2.2][FLINK-38711][build] Set maven-shade-plugin logs to DEBUG

2910d72

[hotfix] Fix flink-model-openai NOTICE for jtokkit

fefb741

[FLINK-38576][table] Align commonJoinKey in MultiJoin for logical and…

e4c197d

… physical rules Co-authored-by: Stepan Stepanishchev <116617250+SteveStevenpoor@users.noreply.github.com>

[FLINK-38750][table] Validation of queries with functions erroneously…

ad47717

… invoked under `SELECT` fails with `StackOverflow`

[FLINK-38084][doc] Add download doc for model providers (apache#27296)

3f79fac

[FLINK-38767][table] Fix vector search execnode transform name (apach…

3546641

…e#27304)

[FLINK-38773][table] Fix batch vector search excnode context (apache#…

8de272c

…27311)

[FLINK-38797][python] Fixed CsvSchemaBuilder.set_null_value to return…

eb65369

… self This closes apache#27331.

[FLINK-38824][table] Fix incorrect default values for primitive types

932aa43

This closes apache#27363.

[FLINK-38703][runtime] Update slot manager metrics in thread-safety m…

0f27e47

…anner

[FLINK-38914][docs] Preserve page path when linking to stable version

8647457

The "stable version" link in the warning banner for unreleased/out-of-date docs now redirects to the equivalent page in the stable docs instead of always redirecting to the homepage.

[FLINK-38925][docs] Update Matomo URL to the right domain

0a83669

(cherry picked from commit 5da177d)

[FLINK-38924][docs] Redirect users to documentation home page when en…

00c6e94

…countering a 404 (cherry picked from commit 1047406)

Update datagen.md

0280f6b

Change the type of the "fields.#.null-rate" option in the DataGen SQL Connector to Float

JavaLeb mentioned this pull request Jan 20, 2026

[hotfix][docs][Update datagen.md]Change the type of the "fields.#.null-rate" option in the DataGen SQL Connector to Float #27436

Closed

davidradl reviewed Jan 20, 2026

View reviewed changes

JavaLeb closed this Jan 20, 2026

JavaLeb reopened this Jan 20, 2026

JavaLeb closed this Jan 20, 2026

JavaLeb deleted the patch-3 branch January 20, 2026 13:08

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[hotfix][docs][Update datagen.md]Change the type of the "fields.#.null-rate" option in the DataGen SQL Connector to Float #27447

[hotfix][docs][Update datagen.md]Change the type of the "fields.#.null-rate" option in the DataGen SQL Connector to Float #27447

Uh oh!

JavaLeb commented Jan 20, 2026

Uh oh!

flinkbot commented Jan 20, 2026 •

edited

Loading

Uh oh!

davidradl Jan 20, 2026

Uh oh!

JavaLeb commented Jan 20, 2026

Uh oh!

JavaLeb commented Jan 20, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

17 participants

[hotfix][docs][Update datagen.md]Change the type of the "fields.#.null-rate" option in the DataGen SQL Connector to Float #27447

[hotfix][docs][Update datagen.md]Change the type of the "fields.#.null-rate" option in the DataGen SQL Connector to Float #27447

Uh oh!

Conversation

JavaLeb commented Jan 20, 2026

What is the purpose of the change

Brief change log

Verifying this change

Does this pull request potentially affect one of the following parts:

Documentation

Uh oh!

flinkbot commented Jan 20, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

CI report:

Uh oh!

davidradl Jan 20, 2026

Choose a reason for hiding this comment

Uh oh!

JavaLeb commented Jan 20, 2026

Uh oh!

JavaLeb commented Jan 20, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

17 participants

flinkbot commented Jan 20, 2026 •

edited

Loading