Skip to content

[No QA] Paralellize typecheck - #99743

Merged
mountiny merged 7 commits into
Expensify:mainfrom
software-mansion-labs:feat/parallelize-typecheck
Sep 3, 2026
Merged

[No QA] Paralellize typecheck#99743
mountiny merged 7 commits into
Expensify:mainfrom
software-mansion-labs:feat/parallelize-typecheck

Conversation

@jmusial

@jmusial jmusial commented Aug 28, 2026

Copy link
Copy Markdown
Contributor

Explanation of Change

Run the four typecheck projects concurrently instead of sequentially in scripts/typecheck.ts, cutting full typecheck wall time by ~30% (16.4s → 11.4s cold, 1.45s → 1.05s warm) with per-project output grouping preserved.

Details in proposal linked below.

[No QA] because it only affects dev tooling

Fixed Issues

$ #99889
PROPOSAL:
https://expensify.slack.com/archives/C08CZDJFJ77/p1788162565862549

Tests

  1. Run npm run typecheck in the console
  2. Command completes and user can see it's output

Offline tests

N/A

QA Steps

N/A

PR Author Checklist

  • I linked the correct issue in the ### Fixed Issues section above
  • I wrote clear testing steps that cover the changes made in this PR
    • I added steps for local testing in the Tests section
    • I added steps for the expected offline behavior in the Offline steps section
    • I added steps for Staging and/or Production testing in the QA steps section
    • I added steps to cover failure scenarios (i.e. verify an input displays the correct error message if the entered data is not correct)
    • I turned off my network connection and tested it while offline to ensure it matches the expected behavior (i.e. verify the default avatar icon is displayed if app is offline)
    • I tested this PR with a High Traffic account against the staging or production API to ensure there are no regressions (e.g. long loading states that impact usability).
  • I included screenshots or videos for tests on all platforms
  • I ran the tests on all platforms & verified they passed on:
    • Android: Native
    • Android: mWeb Chrome
    • iOS: Native
    • iOS: mWeb Safari
    • MacOS: Chrome / Safari
  • I verified there are no console errors (if there's a console error not related to the PR, report it or open an issue for it to be fixed)
  • I followed proper code patterns (see Reviewing the code)
    • I verified that comments were added to code that is not self explanatory
    • I verified that any new or modified comments were clear, correct English, and explained "why" the code was doing something instead of only explaining "what" the code was doing.
    • I verified any copy / text that was added to the app is grammatically correct in English. It adheres to proper capitalization guidelines (note: only the first word of header/labels should be capitalized), and is either coming verbatim from figma or has been approved by marketing (in order to get marketing approval, ask the Bug Zero team member to add the Waiting for copy label to the issue)
  • If a new code pattern is added I verified it was agreed to be used by multiple Expensify engineers
  • I followed the guidelines as stated in the Review Guidelines
  • I tested other components that can be impacted by my changes (i.e. if the PR modifies a shared library or component like Avatar, I verified the components using Avatar are working as expected)
  • If a new CSS style is added I verified that:
    • A similar style doesn't already exist
    • The style can't be created with an existing StyleUtils function (i.e. StyleUtils.getBackgroundAndBorderStyle(theme.componentBG))
  • If new assets were added or existing ones were modified, I verified that:
    • The assets are optimized and compressed (for SVG files, run npm run compress-svg)
    • The assets load correctly across all supported platforms.
  • If the PR modifies code that runs when editing or sending messages, I tested and verified there is no unexpected behavior for all supported markdown - URLs, single line code, code blocks, quotes, headings, bold, strikethrough, and italic.
  • If the PR modifies a generic component, I tested and verified that those changes do not break usages of that component in the rest of the App (i.e. if a shared library or component like Avatar is modified, I verified that Avatar is working as expected in all cases)
  • If the PR modifies a component related to any of the existing Storybook stories, I tested and verified all stories for that component are still working as expected.
  • If the PR modifies a component or page that can be accessed by a direct deeplink, I verified that the code functions as expected when the deeplink is used - from a logged in and logged out account.
  • If the PR modifies the UI (e.g. new buttons, new UI components, changing the padding/spacing/sizing, moving components, etc) or modifies the form input styles:
    • I verified that all the inputs inside a form are aligned with each other.
    • I added Design label and/or tagged @Expensify/design so the design team can review the changes.
  • I added unit tests for any new feature or bug fix in this PR to help automatically prevent regressions in this user flow.
  • If the main branch was merged into this PR after a review, I tested again and verified the outcome was still expected according to the Test steps.

Screenshots/Videos

N/A

@jmusial

jmusial commented Sep 1, 2026

Copy link
Copy Markdown
Contributor Author

@codex review

@chatgpt-codex-connector

Copy link
Copy Markdown

Codex Review: Didn't find any major issues. Already looking forward to the next diff.

Reviewed commit: e08bd3e696

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

@jmusial jmusial changed the title Paralellize typecheck [No QA] Paralellize typecheck Sep 1, 2026
@jmusial
jmusial marked this pull request as ready for review September 2, 2026 07:42
@jmusial
jmusial requested a review from a team as a code owner September 2, 2026 07:42
@melvin-bot
melvin-bot Bot requested review from abzokhattab and removed request for a team September 2, 2026 07:42
@melvin-bot

melvin-bot Bot commented Sep 2, 2026

Copy link
Copy Markdown

@abzokhattab Please copy/paste the Reviewer Checklist from here into a new comment on this PR and complete it. If you have the K2 extension, you can simply click: [this button]

@abzokhattab

Copy link
Copy Markdown
Contributor

Looks like it broke tests .. weird .. is it already broken on main?

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 2b6948d6ee

ℹ️ About Codex in GitHub

Codex has been enabled to automatically review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

When you sign up for Codex through ChatGPT, Codex can also answer questions or update the PR, like "@codex address that feedback".

Comment thread .github/actions/javascript/isDeployChecklistLocked/index.js Outdated
@jmusial
jmusial force-pushed the feat/parallelize-typecheck branch from 2b6948d to e08bd3e Compare September 2, 2026 07:57
@jmusial
jmusial force-pushed the feat/parallelize-typecheck branch from ce677a5 to 8e0df3c Compare September 2, 2026 08:05
@jmusial

jmusial commented Sep 2, 2026

Copy link
Copy Markdown
Contributor Author

Looks like it broke tests .. weird .. is it already broken on main?

Yeah broken on main. Someone put current date in the test and it worked yesterday, but not today xd

@abzokhattab

Copy link
Copy Markdown
Contributor

@MelvinBot review

@abzokhattab

abzokhattab commented Sep 2, 2026

Copy link
Copy Markdown
Contributor

Reviewer Checklist

  • I have verified the author checklist is complete (all boxes are checked off).
  • I verified the correct issue is linked in the ### Fixed Issues section above
  • I verified testing steps are clear and they cover the changes made in this PR
    • I verified the steps for local testing are in the Tests section
    • I verified the steps for Staging and/or Production testing are in the QA steps section
    • I verified the steps cover any possible failure scenarios (i.e. verify an input displays the correct error message if the entered data is not correct)
    • I turned off my network connection and tested it while offline to ensure it matches the expected behavior (i.e. verify the default avatar icon is displayed if app is offline)
  • I checked that screenshots or videos are included for tests on all platforms
  • I included screenshots or videos for tests on all platforms
  • I verified that the composer does not automatically focus or open the keyboard on mobile unless explicitly intended. This includes checking that returning the app from the background does not unexpectedly open the keyboard.
  • I verified tests pass on all platforms & I tested again on:
    • Android: HybridApp
    • Android: mWeb Chrome
    • iOS: HybridApp
    • iOS: mWeb Safari
    • MacOS: Chrome / Safari
  • If there are any errors in the console that are unrelated to this PR, I either fixed them (preferred) or linked to where I reported them in Slack
  • I verified proper code patterns were followed (see Reviewing the code)
    • I verified that comments were added to code that is not self explanatory
    • I verified that any new or modified comments were clear, correct English, and explained "why" the code was doing something instead of only explaining "what" the code was doing.
    • I verified any copy / text that was added to the app is grammatically correct in English. It adheres to proper capitalization guidelines (note: only the first word of header/labels should be capitalized), and is either coming verbatim from figma or has been approved by marketing (in order to get marketing approval, ask the Bug Zero team member to add the Waiting for copy label to the issue)
  • If a new code pattern is added I verified it was agreed to be used by multiple Expensify engineers
  • I verified that this PR follows the guidelines as stated in the Review Guidelines
  • I verified other components that can be impacted by these changes have been tested, and I retested again (i.e. if the PR modifies a shared library or component like Avatar, I verified the components using Avatar have been tested & I retested again)
  • If a new component is created I verified that:
    • A similar component doesn't exist in the codebase
    • All props are defined accurately
    • The component has a clear name that is non-ambiguous and the purpose of the component can be inferred from the name alone
    • The only data being stored in the state is data necessary for rendering and nothing else
    • The component has the minimum amount of code necessary for its purpose, and it is broken down into smaller components in order to separate concerns and functions
  • If a new CSS style is added I verified that:
    • A similar style doesn't already exist
    • The style can't be created with an existing StyleUtils function (i.e. StyleUtils.getBackgroundAndBorderStyle(theme.componentBG)
  • If the PR modifies code that runs when editing or sending messages, I tested and verified there is no unexpected behavior for all supported markdown - URLs, single line code, code blocks, quotes, headings, bold, strikethrough, and italic.
  • If the PR modifies a generic component, I tested and verified that those changes do not break usages of that component in the rest of the App (i.e. if a shared library or component like Avatar is modified, I verified that Avatar is working as expected in all cases)
  • If the PR modifies a component related to any of the existing Storybook stories, I tested and verified all stories for that component are still working as expected.
  • If the PR modifies a component or page that can be accessed by a direct deeplink, I verified that the code functions as expected when the deeplink is used - from a logged in and logged out account.
  • If the PR modifies the UI (e.g. new buttons, new UI components, changing the padding/spacing/sizing, moving components, etc) or modifies the form input styles:
    • I verified that all the inputs inside a form are aligned with each other.
    • I added Design label and/or tagged @Expensify/design so the design team can review the changes.
  • For any bug fix or new feature in this PR, I verified that sufficient unit tests are included to prevent regressions in this flow.
  • If the main branch was merged into this PR after a review, I tested again and verified the outcome was still expected according to the Test steps.
  • I have checked off every checkbox in the PR reviewer checklist, including those that don't apply to this PR.

Screenshots/Videos

Android: HybridApp
Android: mWeb Chrome
iOS: HybridApp
iOS: mWeb Safari
MacOS: Chrome / Safari image

@MelvinBot

Copy link
Copy Markdown
Contributor

Review: no blocking issues

The change is correct. One suggestion worth applying, plus a calibration note on the perf claim.

Suggestion: don't withhold all output until the last project finishes

scripts/typecheck.ts:38-49 awaits Promise.all before printing anything, so the console stays silent for the whole run and then dumps everything at once. On a cold run that's ~16s of nothing, and the Type checking <x>... header now prints after the work rather than before it.

Awaiting the already-started promises in order gives identical concurrency but starts printing as soon as project 1 lands, still grouped and still in a stable order:

const running = projects.map(async (project) => {
    // ...unchanged...
    return {tsconfig, result};
});

const failed: string[] = [];
for (const promise of running) {
    const {tsconfig, result} = await promise;
    console.log(`\nType checking ${tsconfig}...`);
    // ...unchanged...
}

The CI gain is closer to ~10%, not 30%

CI runs on blacksmith-4vcpu-ubuntu-2404, and tsgo already parallelizes internally, so four concurrent compilers contend for the same 4 vCPUs. Measured Type check with TypeScript step durations:

Duration
This PR (runs 33606904648, 33606284878) 27s, 30s
Recent main-based PRs (33611143973, 33606988258, 33610619246) 32s, 31s, 33s

Still a real win, just smaller than the local numbers in the description — worth a tweak to the PR body so nobody is surprised later.

The failing check is pre-existing

test (job 3) fails on tests/unit/NextStepUtilsTest.ts › scheduled submit enabled › monthly on the 2nd — a date-dependent assertion, nothing to do with scripts/typecheck.ts. jmusial's answer to abzokhattab is correct.

Also: the P1 inline comment from Codex on .github/actions/javascript/isDeployChecklistLocked/index.js is stale — that file is no longer in the diff (only scripts/typecheck.ts is). Safe to resolve.

What I checked and found clean
  • Output orderingPromise.all resolves in input order, so the reporting loop still reports projects in DEFAULT_PROJECTS order regardless of completion order.
  • .tsbuildinfo collisions — each project derives its own path from its tsconfig path, and the four resolve to distinct files (tsconfig.ts7.tsbuildinfo, tsconfig.bun.ts7.tsbuildinfo, tsconfig.node.ts7.tsbuildinfo, server/victory-chart-renderer/tsconfig.ts7.tsbuildinfo). No concurrent writers to the same file.
  • Project references — none of the four tsconfigs use references/composite, and the run is -p --noEmit, so there's no shared build output for the concurrent runs to race on.
  • Fail-behavior.nothrow() keeps a type error from rejecting the Promise.all, so "check every project even after one fails" still holds, and the failed[]/process.exit(1) aggregation is unchanged.
  • Diagnostic formatting — adding .quiet() does not cost you colors or --pretty code frames. Bun's $ already buffers through a pipe by default ("the shell will write to the current process's stdout and stderr, as well as buffering that output"), so tsc saw a non-TTY before this PR too.

Nit, very low severity: if $ ever throws for a reason .nothrow() doesn't cover (e.g. the tsc bin is missing after a bad install), Promise.all rejects immediately while the other compilers keep running, and the script dies with an unhandled rejection plus orphaned children. Promise.allSettled would tidy that up, but it only fires on a broken node_modules.


view run

@abzokhattab abzokhattab left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM .. no issues found

@melvin-bot
melvin-bot Bot requested a review from mountiny September 2, 2026 13:23
mountiny
mountiny previously approved these changes Sep 3, 2026
Comment thread scripts/typecheck.ts Outdated
Co-authored-by: Vit Horacek <36083550+mountiny@users.noreply.github.com>
@mountiny
mountiny merged commit c574010 into Expensify:main Sep 3, 2026
35 of 36 checks passed
@OSBotify

OSBotify commented Sep 3, 2026

Copy link
Copy Markdown
Contributor

✋ This PR was not deployed to staging yet because QA is ongoing. It will be automatically deployed to staging after the next production release.

@OSBotify

OSBotify commented Sep 3, 2026

Copy link
Copy Markdown
Contributor

🚀 Deployed to staging by https://github.com/mountiny in version: 9.4.70-0 🚀

platform result
🕸 web 🕸 success ✅
🤖 android 🤖 success ✅
🍎 iOS 🍎 success ✅

@OSBotify

OSBotify commented Sep 4, 2026

Copy link
Copy Markdown
Contributor

🚀 Deployed to staging by https://github.com/mountiny in version: 9.4.72-0 🚀

platform result
🕸 web 🕸 success ✅
🤖 android 🤖 success ✅
🍎 iOS 🍎 success ✅

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants