[Backport 2.x] [Segment Replication] Fix bug where replica shows stale doc count during engine reset. (#9495)

[mch2]

Manual backport of (#9495).

[github-actions]

Compatibility status:

Checks if related components are compatible with change 1a7df60

Incompatible components

Incompatible components: [https://github.com/opensearch-project/cross-cluster-replication.git, https://github.com/opensearch-project/performance-analyzer.git]

Skipped components

Compatible components

Compatible components: [https://github.com/opensearch-project/security.git, https://github.com/opensearch-project/alerting.git, https://github.com/opensearch-project/index-management.git, https://github.com/opensearch-project/anomaly-detection.git, https://github.com/opensearch-project/asynchronous-search.git, https://github.com/opensearch-project/sql.git, https://github.com/opensearch-project/observability.git, https://github.com/opensearch-project/job-scheduler.git, https://github.com/opensearch-project/common-utils.git, https://github.com/opensearch-project/reporting.git, https://github.com/opensearch-project/k-nn.git, https://github.com/opensearch-project/geospatial.git, https://github.com/opensearch-project/ml-commons.git, https://github.com/opensearch-project/notifications.git, https://github.com/opensearch-project/neural-search.git, https://github.com/opensearch-project/performance-analyzer-rca.git, https://github.com/opensearch-project/security-analytics.git]

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/23672/
• CommitID: 1a7df60
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

[github-actions]

Gradle Check (Jenkins) Run Completed with:

• RESULT: UNSTABLE ❕
• TEST FAILURES:

      1 org.opensearch.index.translog.RemoteFSTranslogTests.testMetadataFileDeletion

• URL: https://build.ci.opensearch.org/job/gradle-check/23689/
• CommitID: 1a7df60
  Please review all flaky tests that succeeded after retry and create an issue if one does not already exist to track the flaky failure.

[codecov]

Codecov Report

Merging #9595 (1a7df60) into 2.x (7a03a66) will increase coverage by 0.01%.
Report is 7 commits behind head on 2.x.
The diff coverage is 69.75%.

@@             Coverage Diff              @@
##                2.x    #9595      +/-   ##
============================================
+ Coverage     70.77%   70.79%   +0.01%     
- Complexity    57617    57679      +62     
============================================
  Files          4768     4769       +1     
  Lines        272372   272568     +196     
  Branches      40117    40128      +11     
============================================
+ Hits         192784   192951     +167     
+ Misses        63113    63107       -6     
- Partials      16475    16510      +35     

Files Changed	Coverage Δ
...ons/matrix/stats/MatrixStatsAggregatorFactory.java	69.23% <0.00%> (-5.77%)	⬇️
...s/bucket/geogrid/GeoHashGridAggregatorFactory.java	85.71% <0.00%> (-4.29%)	⬇️
...s/bucket/geogrid/GeoTileGridAggregatorFactory.java	85.71% <0.00%> (-4.29%)	⬇️
...gregations/metrics/GeoBoundsAggregatorFactory.java	81.81% <0.00%> (-8.19%)	⬇️
...h/join/aggregations/ChildrenAggregatorFactory.java	60.00% <0.00%> (-4.29%)	⬇️
...rch/join/aggregations/ParentAggregatorFactory.java	60.00% <0.00%> (-4.29%)	⬇️
...rg/opensearch/common/settings/ClusterSettings.java	93.18% <ø> (ø)
...rc/main/java/org/opensearch/index/IndexModule.java	82.35% <ø> (ø)
...et/adjacency/AdjacencyMatrixAggregatorFactory.java	46.15% <0.00%> (-3.85%)	⬇️
.../bucket/composite/CompositeAggregationFactory.java	85.71% <0.00%> (-14.29%)	⬇️
... and 57 more

... and 430 files with indirect coverage changes

[mch2]

Gradle Check (Jenkins) Run Completed with:

• RESULT: FAILURE ❌
• URL: https://build.ci.opensearch.org/job/gradle-check/23672/
• CommitID: 1a7df60
  Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green.
  Is the failure a flaky test unrelated to your change?

#9580