[FLINK-22752] More robust state configurations in base flink-conf.yaml #257
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR intends to add a few configurations to the base
flink-conf.yaml
:MIrroring changes to official released Docker images
The changes here will be mirrored to our official released Docker images via this PR on
apache/flink-statefun-docker
: apache/flink-statefun-docker#14Verifying the changes
The new configuration has been set in the
flink-conf.yaml
we use in the E2E tests as well. After doing that, I can see logs such as:13:23:41,274 INFO org.apache.flink.statefun.e2e.smoke.SmokeRunner - 2021-08-16 05:23:41,278 INFO org.apache.flink.contrib.streaming.state.restore.RocksDBIncrementalRestoreOperation [] - Finished restoring from state handle: IncrementalLocalKeyedStateHandle{metaDataState=File State: file:/local/state/recovery/ ......
and
13:23:41,198 INFO org.apache.flink.statefun.e2e.smoke.SmokeRunner - 2021-08-16 05:23:41,202 INFO org.apache.flink.contrib.streaming.state.RocksDBKeyedStateBackendBuilder [] - Finished building RocksDB keyed state-backend at /local/state/rocksdb/ ......
which confirms that local recovery is working.
Also, other configurations have been picked up as well as confirmed by the logs.