Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Automation: main-next integrate #17516

Merged
merged 6 commits into from Sep 27, 2023
Merged

Automation: main-next integrate #17516

merged 6 commits into from Sep 27, 2023

Conversation

msfluid-bot
Copy link
Collaborator

main-next integrate PR

The aim of this pull request is to sync main and next branch. If this PR is assigned to you, you need to do the following:

  1. Acknowledge the pull request by adding a comment -- "Actively working on it".
  2. If there are no CI failures, add the "msftbot: merge-next" label to the PR and one of the people with merge permissions will merge it in.
  3. If there are CI failures, check out the main-next-5eeb22c branch and make code changes to fix the failures.
  • You can ignore any failures in the Real service e2e test and Stress test pipelines. These pipelines are not required to pass to merge changes.
  1. Do NOT rebase or squash the main-next-5eeb22c branch: its history must be preserved. Always amend the HEAD commit using the following git commands:
  • git commit --amend -m "Automation: main-next integrate"
  • git push --force-with-lease

markfields and others added 6 commits September 26, 2023 22:06
…s DataProcessingError (#17442)

When a consumer of FF uses `mixinSummaryHandler` to run additional code
before summarization, they introduce risk to the Summarization system
where that code could throw and cause summarization to fail. These
failures are completely outside the control of FF, but can be
catastrophic for a container since persistent failure to summarize can
lead to effective document corruption (e.g. ODSP blocks all changes once
there are 10k unsummarized ops).

So we want to classify these errors as DataProcessingErrors with the
codepath `mixinSummaryHandler` mentioned so we and our partners can have
immediate insight when these errors arise. Currently, a premier 1P
partner is facing a large number of these errors and we are trying to
clarify the telemetry signal to be more actionable.
## Description

`forceReadonly` does not work as expected. Doing something like:

```
container.forceReadonly?.(true);
containerMap.set("key1", "1");
containerMap.set("key2", "2");
loaded.forceReadonly?.(false);
<<synchronize>>
```

will cause assert `0x173`, as clearing the readonly flag will not
trigger a new connection but will call the readonly event handler on the
deltamanager, which calls replayPendingStates without a new connection.

We have noticed thousands of hits in our telemetry about this..

The root cause is the redudant `readonly` event handler in the container
runtime, causing the pendig state manager to be called twice. We're
already doing that when the connection state changes.
## Description

`ddsOpProcessing` and `ddsEventCallbacks` are very noisy in the stress
tests, although already sampled. Using the feature gate, we should
publish only 10% of the existing volume (we're already sampling them
1/1000).
Results of running `pnpm run policy-check:asserts` on the main branch.
@msfluid-bot
Copy link
Collaborator Author

@fluid-example/bundle-size-tests: -320 Bytes
Metric NameBaseline SizeCompare SizeSize Diff
aqueduct.js 444.06 KB 443.9 KB -162 Bytes
connectionState.js 680 Bytes 680 Bytes No change
containerRuntime.js 237.19 KB 237.04 KB -162 Bytes
loader.js 148.13 KB 148.13 KB +4 Bytes
map.js 46.46 KB 46.46 KB No change
matrix.js 140.24 KB 140.24 KB No change
odspDriver.js 90.2 KB 90.2 KB No change
odspPrefetchSnapshot.js 41.87 KB 41.87 KB No change
sharedString.js 161.04 KB 161.04 KB No change
sharedTree2.js 255.73 KB 255.73 KB No change
Total Size 1.67 MB 1.67 MB -320 Bytes

Baseline commit: 8220392

Generated by 🚫 dangerJS against 871b349

@tylerbutler tylerbutler merged commit 871b349 into next Sep 27, 2023
38 checks passed
@tylerbutler tylerbutler deleted the main-next-5eeb22c branch September 27, 2023 22:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
base: next PRs targeted against next branch main-next-integrate merge-ok
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants