Skip to content

Improve DData remember entities logging and consistency#2799

Merged
He-Pin merged 1 commit intoapache:mainfrom
He-Pin:port-ddata-logging-fix
Mar 28, 2026
Merged

Improve DData remember entities logging and consistency#2799
He-Pin merged 1 commit intoapache:mainfrom
He-Pin:port-ddata-logging-fix

Conversation

@He-Pin
Copy link
Copy Markdown
Member

@He-Pin He-Pin commented Mar 28, 2026

Motivation

DData remember entities logging was inconsistent and some important state transitions were logged at wrong levels.

Modification

Improved logging for DData remember entities operations to use appropriate log levels and include relevant context information.

Result

Better observability for distributed data remember entities operations.

References

Multiple improvements to DData remember entities stores:

- DDataRememberEntitiesShardStore: Retry reads up to 15 times (across
  all 5 keys) before giving up, logging at warning level initially and
  escalating to error only on final failure. Previously failed immediately
  on first GetFailure.
- DDataRememberEntitiesCoordinatorStore: Already retried indefinitely,
  but now waits until 5 failures before escalating from warning to error
  level logging.
- All log messages now clearly indicate whether they originate from the
  coordinator store or shard store (prefix: 'Remember entities
  coordinator/shard store').
- Change consistency levels from ReadMajority/WriteMajority to
  ReadMajorityPlus/WriteMajorityPlus, using coordinatorStateReadMajorityPlus
  and coordinatorStateWriteMajorityPlus settings, with ReadAll/WriteAll
  fallback when configured as Int.MaxValue.

Upstream: akka/akka-core@440fdfdcc2
Cherry-picked from akka/akka-core v2.8.0, which is now Apache licensed.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@He-Pin He-Pin marked this pull request as ready for review March 28, 2026 07:05
@He-Pin He-Pin added this to the 2.0.0-M2 milestone Mar 28, 2026
Copy link
Copy Markdown
Member

@pjfanning pjfanning left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@He-Pin He-Pin merged commit 1d35ccc into apache:main Mar 28, 2026
9 checks passed
@He-Pin He-Pin deleted the port-ddata-logging-fix branch March 28, 2026 09:00
@Philippus
Copy link
Copy Markdown
Member

Philippus commented Mar 28, 2026

The PR description is a bit off, this change does more than change the logging, it also adds retries.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants