Upgrade yarn to the latest version

[valerybugakov]

Problem statement

We use an old version of yarn which has a lot of security issues and bad perf.

Success criteria

We upgraded to the latest version of yarn.

Implementation details

Follow the official migration guide here

1. Make sure to migrate all deprecated flags to the new format. Find all mentions of yarn in the codebase and check if they need to be updated to use a new flag. (e.g., renamed --frozen-lockfile into --immutable)
2. Install upgrade-interactive and workspace-tools plugins.
3. Use node-modules nodeLinker to minimize changes required for the upgrade.
4. As a follow-up PR, we will try to migrate to the pnpm linker.

If you're stuck on a problem, dm @valerybugakov to discuss it.

Time estimate

• The implementation should take 16 hours at maximum. Ping the reviewer in the spec pull request if time-consuming changes are required.

[sourcegraph-bot-2]

Heads up @taylorsperry @jasongornall - the "team/frontend-platform" label was applied to this issue.

[gitstart-app]

Here is the GitStart Ticket for this issue: https://app.gitstart.com/clients/sourcegraph/tickets/SG-39284