Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rewrite TSServer Crawler/Fuzzer #50456

Closed
DanielRosenwasser opened this issue Aug 25, 2022 · 1 comment
Closed

Rewrite TSServer Crawler/Fuzzer #50456

DanielRosenwasser opened this issue Aug 25, 2022 · 1 comment
Assignees
Labels
Domain: TSServer Issues related to the TSServer Infrastructure Issue relates to TypeScript team infrastructure

Comments

@DanielRosenwasser
Copy link
Member

We have a (currently) private fuzzer/crawler which simply opens projects on GitHub, runs some language server operations on a project, and finds crashes. This helps pinpoint stability issues in TypeScript and the server so that we can improve reliability.

It has helped catch many issues over the years, but we believe that there are some opportunities to improve it:

  1. Now that we have a better idea of the primary functionality, we would benefit from a rewrite - possibly where we can leverage other infrastructure
  2. The crawler continues to ping about the same issue over and over again. This is okay, and helpful for knowing what issues we've continued to encounter, but maybe a better approach is to have reports of new issues that have been introduced that don't repro in the last stable version of the language service (similar to the new errors detector we run weekly/on-demand)
@DanielRosenwasser DanielRosenwasser added Infrastructure Issue relates to TypeScript team infrastructure Domain: TSServer Issues related to the TSServer labels Aug 25, 2022
@DanielRosenwasser DanielRosenwasser added this to the TypeScript 4.9.0 milestone Aug 25, 2022
@amcasey
Copy link
Member

amcasey commented Sep 16, 2022

The language service exerciser now lives in https://github.com/microsoft/typescript-error-deltas and produces bugs like #50764. It can be invoked on PRs with @typescript-bot user test tsserver or @typescript-bot test tsserver top100. There will be additional refinements, but it's usable and useful now.

@amcasey amcasey closed this as completed Sep 16, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Domain: TSServer Issues related to the TSServer Infrastructure Issue relates to TypeScript team infrastructure
Projects
None yet
Development

No branches or pull requests

2 participants