Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Watch mode show limited error message for 'invalid task configuration' #8006

Closed
1 task done
weyert opened this issue Apr 19, 2024 · 23 comments
Closed
1 task done

Watch mode show limited error message for 'invalid task configuration' #8006

weyert opened this issue Apr 19, 2024 · 23 comments
Labels
kind: bug Something isn't working owned-by: turborepo

Comments

@weyert
Copy link
Contributor

weyert commented Apr 19, 2024

Verify canary release

  • I verified that the issue exists in the latest Turborepo canary release.

Link to code that reproduces this issue

n/a

What package manager are you using / does the bug impact?

pnpm

What operating system are you using?

Mac

Which canary version will you have in your reproduction?

1.13.3-canary.3

Describe the Bug

When I run turbo run dev I am getting a different error message then when I run turbo watch dev. The version of shown when using run-command is more helpful

Expected Behavior

When running turbo run dev I am currently getting:

pnpm exec turbo run dev
  × invalid task configuration

Error:   × You have 20 persistent tasks but `turbo` is configured for concurrency of 10. Set --concurrency to at least 21

while when running turbo watch dev only a part of the above message is outputted by the command, see:

pnpm exec turbo watch dev
  × invalid task configuration

To Reproduce

You should be able to reproduce by trying to lowering the turbo watch dev --concurrency=1

Additional context

No response

@weyert weyert added kind: bug Something isn't working needs: triage New issues get this label. Remove it after triage owned-by: turborepo labels Apr 19, 2024
@weyert
Copy link
Contributor Author

weyert commented Apr 20, 2024

I am also seem to get the following message when not trying to run persistent tasks:

  × failed to connect to daemon
  ╰─▶ server is unavailable: channel lagged by 2046

By running the command: pnpm exec turbo watch build --filter={packages/\*}

If I run turbo daemon restart and then turbo daemon logs, followed by the above command pnpm exec turbo watch build --filter={packages/\*} in a new terminal window I still get the same error:

  × failed to connect to daemon
  ╰─▶ server is unavailable: channel lagged by 1981

In the terminal that is running turbo daemon logs I am seeing the following warnings an done error log entry:

2024-04-20T08:49:50.423565Z  WARN turborepo_lib::package_changes_watcher: file event lagged
2024-04-20T08:49:50.457638Z  WARN turborepo_lib::package_changes_watcher: file event lagged
2024-04-20T08:49:50.494673Z  WARN turborepo_lib::package_changes_watcher: file event lagged
2024-04-20T08:49:50.498104Z  WARN turborepo_lib::package_changes_watcher: file event lagged
2024-04-20T08:49:50.507074Z  WARN turborepo_lib::package_changes_watcher: file event lagged
2024-04-20T08:49:50.569677Z  WARN turborepo_lib::package_changes_watcher: file event lagged
2024-04-20T08:49:50.585059Z  WARN turborepo_lib::package_changes_watcher: file event lagged
2024-04-20T08:49:50.645740Z  WARN turborepo_lib::package_changes_watcher: file event lagged
2024-04-20T08:49:50.690569Z  WARN turborepo_lib::package_changes_watcher: file event lagged
2024-04-20T08:52:23.675779Z  INFO turborepo_lib::daemon::server: triggering shutdown
2024-04-20T08:53:03.843134Z  WARN turborepo_lib::package_changes_watcher: file event lagged
2024-04-20T08:53:03.876655Z  WARN turborepo_lib::package_changes_watcher: file event lagged

Not sure why turborepo_lib::daemon::server: triggering shutdown would occur. The logs doesn't suggest it's being restarted

@weyert
Copy link
Contributor Author

weyert commented Apr 20, 2024

Looks like the error goes away when you only watch a few packages (3-4) but fails when you try to watch all your packages (60)

@weyert
Copy link
Contributor Author

weyert commented Apr 20, 2024

Also looks like turbo run build now has much higher cpu usages than before. I will double check this tomorrow but it's >=70% or two turbo processes both sharing ~30-35%

I think it might be mainly the process that gets started as:

 4023   ??  Rs     6:36.31 /xxx/node_modules/.pnpm/turbo-darwin-arm64@1.13.3-canary.3/node_modules/turbo-darwin-arm64/bin/turbo --skip-infer daemon

I also have a lot of git processes that I did not initiate as far as I am aware off:

 3825   ??  S     32:29.85 /opt/homebrew/opt/git/libexec/git-core/git fsmonitor--daemon run --detach --ipc-threads=8
81767   ??  R      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81778   ??  R      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81779   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81780   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81781   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81784   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81789   ??  R      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81793   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81794   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81795   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81797   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81798   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81799   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81800   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81801   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81802   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81803   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81804   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81805   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81806   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81807   ??  R      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81808   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81809   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81810   ??  R      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81834   ??  R      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81835   ??  R      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81836   ??  R      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81837   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81838   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81839   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81840   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81841   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81842   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81843   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81844   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81845   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81846   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81847   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81848   ??  R      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81849   ??  R      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81850   ??  R      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81851   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81852   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81853   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81854   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81855   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81856   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81862   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81892   ??  R      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81893   ??  R      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81894   ??  R      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81896   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81897   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81898   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81899   ??  R      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81900   ??  R      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81902   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81904   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81905   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81910   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81911   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81913   ??  R      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81916   ??  R      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81920   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81921   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81962   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81963   ??  R      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81964   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81965   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81969   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81971   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81972   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81973   ??  R      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81976   ??  R      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81977   ??  R      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81978   ??  R      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81979   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81980   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81981   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81982   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81983   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81984   ??  R      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81985   ??  R      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
81987   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82020   ??  R      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82021   ??  R      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82022   ??  R      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82023   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82024   ??  R      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82027   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82029   ??  S      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82030   ??  R      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82036   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82040   ??  R      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82041   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82042   ??  R      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82045   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82050   ??  R      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82052   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82053   ??  R      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82054   ??  R      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82056   ??  R      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82057   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82059   ??  R      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82060   ??  R      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82061   ??  R      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82064   ??  R      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82068   ??  R      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82069   ??  R      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82070   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82071   ??  R      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82072   ??  R      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82073   ??  R      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82075   ??  R      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82076   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82077   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82080   ??  R      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82082   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82088   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82089   ??  R      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82090   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82091   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82094   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82095   ??  R      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82097   ??  R      0:00.03 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82098   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82099   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82100   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82101   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82102   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82103   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82104   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82105   ??  R      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82106   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82107   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82108   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82109   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82110   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82111   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82112   ??  R      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82113   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82114   ??  R      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82115   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82116   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82117   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82118   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82119   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82120   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82121   ??  R      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82122   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82123   ??  R      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82131   ??  R      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82132   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82133   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82134   ??  R      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82135   ??  R      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82136   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82137   ??  R      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82169   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82170   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82171   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82172   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82173   ??  R      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82174   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82175   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82176   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82177   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82178   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82179   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82180   ??  S      0:00.02 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82181   ??  R      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82182   ??  R      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82183   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82184   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82185   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82186   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82187   ??  R      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82188   ??  R      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82189   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82190   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82191   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82192   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82193   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82194   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82195   ??  R      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82196   ??  R      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82197   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82198   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82199   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82219   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82220   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82221   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82222   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82223   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82224   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82225   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82226   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82227   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82228   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82229   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82230   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82231   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82232   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82233   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82234   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82235   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82236   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82237   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82330   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82331   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82332   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82333   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82334   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82335   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82336   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82337   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82338   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82339   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82340   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82341   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82342   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82343   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82344   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82345   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82346   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82347   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82348   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82349   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82350   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82351   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82352   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82353   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82354   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82355   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82356   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82357   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82358   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82359   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82360   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82361   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82362   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82363   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82364   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82365   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82366   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82367   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82368   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82369   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82370   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82371   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82372   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82373   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82374   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82375   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82376   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82377   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82378   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82379   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82380   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82381   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82382   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82383   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82384   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82385   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82386   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82387   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82388   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82389   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82390   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82391   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82392   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82393   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82394   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82395   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82396   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82397   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82398   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82399   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82400   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82401   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82402   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82403   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82404   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82405   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82406   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82407   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82408   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82409   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82410   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82411   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82412   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82413   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82414   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82415   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82416   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82417   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82459   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82460   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82461   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82462   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82463   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82464   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82465   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82467   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82468   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82469   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82470   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82471   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82472   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82473   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82474   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82475   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82476   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82477   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82478   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82479   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82480   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82481   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82482   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82483   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82484   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82485   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82486   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82487   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82488   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82489   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82490   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82491   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82492   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82493   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82494   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82495   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82496   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82497   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82498   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82499   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82500   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82501   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82549   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82550   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82551   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82552   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82553   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82554   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82555   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82556   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82557   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82558   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82578   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82579   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82580   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82582   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82583   ??  R      0:00.01 /opt/homebrew/bin/git ls-tree -r -z HEAD
82591   ??  R      0:00.01 /opt/homebrew/bin/git ls-tree -r -z HEAD
82597   ??  R      0:00.01 /opt/homebrew/bin/git ls-tree -r -z HEAD
82608   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82609   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82613   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82614   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82615   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82616   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82617   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82618   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82619   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82620   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82621   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82624   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82625   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82626   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82627   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82628   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82630   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82631   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82632   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82633   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82634   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82635   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82636   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82637   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82638   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82639   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82640   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82642   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82643   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82645   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82646   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82647   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82648   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82649   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82650   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82651   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82652   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82653   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82654   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82655   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82656   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82657   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82658   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82659   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82660   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82661   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82665   ??  S      0:00.01 /opt/homebrew/bin/git ls-tree -r -z HEAD
82669   ??  S      0:00.01 /opt/homebrew/bin/git ls-tree -r -z HEAD
82670   ??  S      0:00.01 /opt/homebrew/bin/git ls-tree -r -z HEAD
82671   ??  S      0:00.01 /opt/homebrew/bin/git ls-tree -r -z HEAD
82672   ??  S      0:00.01 /opt/homebrew/bin/git ls-tree -r -z HEAD
82673   ??  S      0:00.01 /opt/homebrew/bin/git ls-tree -r -z HEAD
82674   ??  S      0:00.01 /opt/homebrew/bin/git ls-tree -r -z HEAD
82675   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82676   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82677   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82678   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82679   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82680   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82681   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82682   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82683   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82684   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82685   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82686   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82687   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82688   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82689   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82690   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82691   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82692   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82693   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82694   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82695   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82696   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82697   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82698   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82699   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82700   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82701   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82702   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82703   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82704   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82705   ??  S      0:00.01 /opt/homebrew/bin/git status --untracked-files --no-renames -z -- .
82706   ??  R      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82707   ??  R      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82708   ??  R      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82709   ??  R      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82710   ??  R      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82711   ??  R      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82712   ??  R      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82713   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82714   ??  R      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82715   ??  R      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82716   ??  R      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82717   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82718   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82719   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82720   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82721   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82722   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82723   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82724   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82725   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82726   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82727   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82728   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82729   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82730   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82731   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82732   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82733   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82734   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82735   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82736   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82737   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82738   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82739   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82740   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82741   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82742   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82743   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82744   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82745   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82746   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82747   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82748   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82749   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82750   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82751   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82752   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82753   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82754   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82755   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82756   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82757   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82758   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82759   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82760   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82761   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82762   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82763   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82764   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD
82765   ??  S      0:00.00 /opt/homebrew/bin/git ls-tree -r -z HEAD

@weyert
Copy link
Contributor Author

weyert commented Apr 20, 2024

I did find some daemon logs:

2024-04-20T22:14:29.846856Z  WARN turborepo_filewatch::package_watcher: lagged behind 57389 processing file watching events
2024-04-20T22:14:46.317279Z  WARN turborepo_filewatch::package_watcher: lagged behind 10745 processing file watching events
2024-04-20T22:14:46.374547Z  WARN turborepo_filewatch::package_watcher: lagged behind 75 processing file watching events
2024-04-20T22:14:46.429666Z  WARN turborepo_filewatch::package_watcher: lagged behind 64 processing file watching events
2024-04-20T22:14:46.508793Z  WARN turborepo_filewatch::package_watcher: lagged behind 103 processing file watching events
2024-04-20T22:14:46.552476Z  WARN turborepo_filewatch::package_watcher: lagged behind 33 processing file watching events
2024-04-20T22:14:46.585974Z  WARN turborepo_filewatch::package_watcher: lagged behind 40 processing file watching events
2024-04-20T22:14:46.636853Z  WARN turborepo_filewatch::package_watcher: lagged behind 46 processing file watching events
2024-04-20T22:14:46.705137Z  WARN turborepo_filewatch::package_watcher: lagged behind 101 processing file watching events
2024-04-20T22:14:46.787413Z  WARN turborepo_filewatch::package_watcher: lagged behind 170 processing file watching events
2024-04-20T22:14:46.829122Z  WARN turborepo_filewatch::package_watcher: lagged behind 49 processing file watching events
2024-04-20T22:14:46.892172Z  WARN turborepo_filewatch::package_watcher: lagged behind 82 processing file watching events
2024-04-20T22:14:46.965256Z  WARN turborepo_filewatch::package_watcher: lagged behind 88 processing file watching events
2024-04-20T22:14:47.179187Z  WARN turborepo_filewatch::package_watcher: lagged behind 162 processing file watching events
2024-04-20T22:14:47.216137Z  WARN turborepo_filewatch::package_watcher: lagged behind 29 processing file watching events
2024-04-20T22:14:47.270342Z  WARN turborepo_filewatch::package_watcher: lagged behind 62 processing file watching events
2024-04-20T22:14:47.338752Z  WARN turborepo_filewatch::package_watcher: lagged behind 120 processing file watching events
2024-04-20T22:14:47.391705Z  WARN turborepo_filewatch::package_watcher: lagged behind 80 processing file watching events
2024-04-20T22:14:47.432932Z  WARN turborepo_filewatch::package_watcher: lagged behind 67 processing file watching events
2024-04-20T22:14:47.536967Z  WARN turborepo_filewatch::package_watcher: lagged behind 200 processing file watching events
2024-04-20T22:14:47.583575Z  WARN turborepo_filewatch::package_watcher: lagged behind 66 processing file watching events
2024-04-20T22:14:47.684939Z  WARN turborepo_filewatch::package_watcher: lagged behind 205 processing file watching events
2024-04-20T22:14:47.740454Z  WARN turborepo_filewatch::package_watcher: lagged behind 82 processing file watching events
2024-04-20T22:14:47.806190Z  WARN turborepo_filewatch::package_watcher: lagged behind 61 processing file watching events
2024-04-20T22:14:47.829885Z  WARN turborepo_filewatch::package_watcher: lagged behind 2 processing file watching events
2024-04-20T22:14:47.847463Z  WARN turborepo_filewatch::package_watcher: lagged behind 4 processing file watching events
2024-04-20T11:21:42.889298Z ERROR turborepo_lib::daemon::server: package changes stream closed: channel closed
2024-04-20T13:52:38.086820Z  WARN turborepo_lib::package_changes_watcher: file event lagged
2024-04-20T13:52:40.501541Z  WARN turborepo_filewatch::package_watcher: lagged behind 722 processing file watching events
2024-04-20T13:53:30.844364Z  WARN turborepo_filewatch::package_watcher: lagged behind 21723 processing file watching events
2024-04-20T13:53:31.912051Z  WARN turborepo_lib::package_changes_watcher: file event lagged
2024-04-20T13:53:32.911811Z  WARN turborepo_filewatch::package_watcher: lagged behind 420 processing file watching events
2024-04-20T13:53:34.360625Z  WARN turborepo_filewatch::package_watcher: lagged behind 373 processing file watching events
2024-04-20T13:53:34.919452Z  WARN turborepo_filewatch::package_watcher: lagged behind 92 processing file watching events
2024-04-20T13:53:35.766474Z  WARN turborepo_filewatch::package_watcher: lagged behind 117 processing file watching events
2024-04-20T13:53:36.505176Z  WARN turborepo_filewatch::package_watcher: lagged behind 137 processing file watching events
2024-04-20T13:53:36.815700Z  WARN turborepo_filewatch::package_watcher: lagged behind 79 processing file watching events
2024-04-20T13:53:37.570043Z  WARN turborepo_filewatch::package_watcher: lagged behind 193 processing file watching events
2024-04-20T13:53:38.275014Z  WARN turborepo_filewatch::package_watcher: lagged behind 178 processing file watching events
2024-04-20T13:53:38.852277Z  WARN turborepo_filewatch::package_watcher: lagged behind 192 processing file watching events
2024-04-20T13:53:39.645846Z  WARN turborepo_filewatch::package_watcher: lagged behind 4 processing file watching events

@NicholasLYang
Copy link
Contributor

Hey, thanks for a very thorough and helpful issue! I have a PR up to improve the error messages, a bit of an oversight on my part not threading the proper error logic through. We're working on moving watch mode to a more stable foundation, which will hopefully eliminate the performance and lagging issues that you've noticed.

@weyert
Copy link
Contributor Author

weyert commented Apr 22, 2024

Thank you, for taking the time to look into it!

@NicholasLYang
Copy link
Contributor

Hi @weyert, could you try the latest canary? We shipped some error handling and performance improvements. We should have some more coming very soon

@weyert
Copy link
Contributor Author

weyert commented Apr 23, 2024

Sure! I only think the latest is still the canary.3 release?

@weyert
Copy link
Contributor Author

weyert commented Apr 24, 2024

Ah I have found .canary.4. Probably a bit too tired last night. I will give it a shot today :)

@weyert
Copy link
Contributor Author

weyert commented Apr 24, 2024

Looks like it limited the number of git processes running. Cpu usage also seems a bit less. Progress. I would say.

Never noticed before, If I quite turbo I do have some of the tasks still running. Not sure if my projects are incorrectly handling the signals sent to it. I will need to have a closer look at that.

@weyert
Copy link
Contributor Author

weyert commented Apr 29, 2024

@NicholasLYang I can confirm the original issue is resolved in 1.3.3 only I haven't been to get watch working:

pnpm exec turbo watch build --filter={packages/\*}
• Packages in scope: <snip>
• Running build in 36 packages
• Remote caching enabled
  × failed to connect to daemon
  ╰─▶ server is unavailable: channel closed

pnpm exec turbo daemon status
✓ daemon is running
log file: /Users/xx/Development/Projects/monorepo/.turbo/daemon/f5b0831ce8ff9a15-turbo.log.2024-04-29
uptime: 2h 4m 42s 815mss
pid file: /var/folders/1m/4921_csd7gnddqdr0smhfqjh0000gn/T/turbod/f5b0831ce8ff9a15/turbod.pid
socket file: /var/folders/1m/4921_csd7gnddqdr0smhfqjh0000gn/T/turbod/f5b0831ce8ff9a15/turbod.sock

pnpm exec turbo watch build --filter={packages/\*}
• Packages in scope: <snip>
• Running build in 36 packages
• Remote caching enabled
  × failed to connect to daemon
  ╰─▶ server is unavailable: channel closed

@NicholasLYang
Copy link
Contributor

Interesting. I have a bug fix out for watch mode. Could you send me the output of turbo daemon logs?

@weyert
Copy link
Contributor Author

weyert commented Apr 30, 2024 via email

@mehulkar mehulkar removed the needs: triage New issues get this label. Remove it after triage label May 2, 2024
@NicholasLYang
Copy link
Contributor

Hi @weyert, could you try the latest canary? It has some fixes for various issues along with some performance improvements and better change detection with file hashing

@alan-nf
Copy link

alan-nf commented Jun 5, 2024

I'm also seeing the failed to connect to daemon error in turborepo 2.0.1 and 2.0.2-canary.0. I don't have a lot of packages.

❯ npx turbo watch build:watch graphql:generate --filter=rights...
• Packages in scope: <redacted>
• Running build:watch, graphql:generate in 7 packages
• Remote caching disabled
  × failed to connect to daemon
  ╰─▶ server is unavailable: channel closed

When this error occurs, there is only one new line in the daemon logs:

2024-06-05T20:56:58.703710Z ERROR turborepo_lib::daemon::server: package changes stream closed: channel closed

My env:

node v18.19.1
npm v9.9.3

Should I start a separate thread, I wonder?

@luskin
Copy link

luskin commented Jun 12, 2024

We are receiving this as well in "turbo": "2.0.3",. It's not ideal, but when this happens run: px axu | grep turbo and find the duplicate process ID then kill it, i.e. kill {id}

@NicholasLYang
Copy link
Contributor

Hi, could you try running turbo daemon clean and see if that fixes anything?

@dBianchii
Copy link

Hi, could you try running turbo daemon clean and see if that fixes anything?

Before:
× failed to connect to daemon
╰─▶ server is unavailable: channel closed
After turbo daemon clean:
Packages in scope: @kdx/api, @kdx/auth, @kdx/date-fns, @kdx/dayjs, @kdx/db, @kdx/eslint-config, @kdx/kdx, @kdx/locales, @kdx/prettier-config, @kdx/react-email, @kdx/shared, @kdx/tailwind-config, @kdx/tsconfig, @kdx/ui, @kdx/upstash-dev, @kdx/validators
• Running dev in 16 packages
• Remote caching disabled
× discovery failed: bad grpc status code: The operation was cancelled

@NicholasLYang
Copy link
Contributor

Hi all, thanks for these reports. I'm gonna close out this issue, please feel free to open up a new issue with these bugs.

@Cypher1
Copy link

Cypher1 commented Jun 21, 2024

Sorry, I'm uncertain of the logic of marking this issue completed. It's still occurring?

@NicholasLYang
Copy link
Contributor

Yes, the problem is still occurring, but this issue is originally for a completely different problem, so I'd prefer that we open a new issue with a more relevant title, so people can easily search and find it.

@Byron
Copy link

Byron commented Jul 21, 2024

I have created a new issue for the other problem discovered here: #8800

@mafuyuuu1
Copy link

We are receiving this as well in "turbo": "2.0.3",. It's not ideal, but when this happens run: px axu | grep turbo and find the duplicate process ID then kill it, i.e. kill {id}

This solved my problem as well. Thank you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind: bug Something isn't working owned-by: turborepo
Projects
None yet
Development

No branches or pull requests

9 participants