MessageLintReports get() and getAll() async, with no reactivity, to reduce excessive resource consumption

[jldec]

partial fix for #2327 (memory consumption still limits scale)
resolves #2073

https://www.loom.com/share/3cf3c51d2f644886948c1267fa73f176

remove reactive map and make lint reports api async

MessageLintReportsQueryApi is simplified to make it non-reactive (no subscriptions), and the lint-report-specific ReactiveMap is replaced with a vanilla Map. (This change replaces the additional includedMessageIds api from the first experiment.)

Reasoning 💡
Lint reports don't require their own separate reactive map over all messages. It should be possible to maintain an up-to-date model of lint reports in memory, and build reactive (auto-updating) UIs with lint reports, both using only the messages reactive interface to watch for changes.

This would the first step toward removing granular (per message) reactivity from the sdk core.

status:

• async lint reports get() and getAll()
• remove lint reports reactivity
• load-test changes
  • find scalability limit at 4GB node heap size:
    limit = ~10000 messages with translation into 36 languages
• fix tests
• code changes in fink and sherlock to test UX improvement at feature parity
  • fix off-by-one total lint errors value in fink
  • fix empty message list on reload with lint reports filter
• changesets

first experiment - new api IncludedMessageIds (abandoned)

First attempt to fix the issue replaced subscription to getAll() with a subscription to includedMessageIds. This new api returns just the message IDs which have lint reports, instead of returning all lint reports in every event, making it much lighter. The change was implemented in d7ae5c1 but does not fully resolve the issue.

https://www.loom.com/share/358ae27b6dda403aa4c013a2ac0b723b
The loom show the out of memory failure when translating 4500 messages with
project.query.messageLintReports.includedMessageIds.subscribe in the load test.

[changeset-bot]

🦋 Changeset detected

Latest commit: b5fef9f

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 26 packages

Name	Type
@inlang/sdk	Minor
@inlang/badge	Patch
@inlang/cli	Patch
@inlang/editor	Patch
@inlang/github-lint-action	Patch
vs-code-extension	Patch
@inlang/sdk-load-test	Patch
@inlang/rpc	Patch
@inlang/settings-component	Patch
@inlang/telemetry	Patch
@inlang/website	Patch
@inlang/cross-sell-ninja	Patch
@inlang/plugin-i18next	Patch
@inlang/plugin-json	Patch
@inlang/plugin-m-function-matcher	Patch
@inlang/plugin-next-intl	Patch
@inlang/plugin-t-function-matcher	Patch
@inlang/paraglide-js-adapter-unplugin	Patch
@inlang/server	Patch
@lix-js/server	Patch
@inlang/paraglide-js-adapter-rollup	Patch
@inlang/paraglide-js-adapter-vite	Patch
@inlang/paraglide-js-adapter-webpack	Patch
@inlang/paraglide-js-adapter-astro	Patch
@inlang/paraglide-js-adapter-sveltekit	Patch
@inlang/paraglide-js-adapter-sveltekit-example	Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

[github-actions]

🥷 Ninja i18n – 🎉 Translations have been successfully updated

[NiklasBuchfink]

I found a bug when loading the Fink with a lint rule filter selected:
https://www.loom.com/share/84bc0df455bf45f48435a6f2f6a38ac4

It is not something SDK-related and more about Finks application state, so let me know, if I should fix this.

[jldec]

Added @felixhaeberle to reveiw the sherlock fix.
https://github.com/opral/monorepo/pull/2378/files#diff-d70c61d977625ed10ef52c85005752b7c647b2663317340f46087c1330d2c479

[felixhaeberle]

lgtm 👍

[jldec]

It is not something SDK-related and more about Finks application state, so let me know, if I should fix this.

@NiklasBuchfink I have pushed a fix for this
(surprisingly) the signal produced by createResource only updates itself on the tick after the awaited fetch resolves, so I had to workaround this.