[CI][Windows] Processes slow or hanging

[dcharkes]

Various process invocations seem to hang on the CI.
It doesn't look like increasing timeouts fixes the issue, it actually hangs.

  FINER: 2023-04-28 07:13:28.837437: Looking up version with --version for ToolInstance(dumpbin.exe, null, file:///C:/Program%20Files/Microsoft%20Visual%20Studio/2022/Enterprise/VC/Tools/MSVC/14.34.31933/bin/HostX64/x64/dumpbin.exe).
  
  INFO: 2023-04-28 07:13:28.837437: Running `C:\Program Files\Microsoft Visual Studio\2022\Enterprise\VC\Tools\MSVC\14.34.31933\bin\HostX64\x64\dumpbin.exe --version`.
  TimeoutException after 0:01:00.000000: Test timed out after 1 minutes.
  dart:isolate  _RawReceivePort._handleMessage

FINER: 2023-04-28 07:13:35.466475: Looking for Visual Studio Locator on PATH.

https://github.com/dart-lang/native/actions/runs/4828010210/jobs/8601346569

FINER: 2023-04-28 07:27:06.814897: Checking if ToolInstance(Apple Clang, null, file:///C:/Program%20Files/LLVM/bin/clang.exe) satisfies CLI filter.
  
  INFO: 2023-04-28 07:27:06.830574: Running `C:\Program Files\LLVM\bin\clang.exe --version`.
  TimeoutException after 0:00:30.000000: Test timed out after 30 seconds. See https://pub.dev/packages/test#timeouts
  dart:isolate  _RawReceivePort._handleMessage

FINER: 2023-04-28 07:27:[36](https://github.com/dart-lang/native/actions/runs/4828010210/jobs/8601594600#step:10:38).736019: No compiler set in config[cc].

https://github.com/dart-lang/native/actions/runs/4828010210/jobs/8601594600

I wonder if there is something wrong with the way we're trying to capture output of those process invocations so that the future we're waiting for doesn't complete.

pkgs/c_compiler/lib/src/utils/run_process.dart

[dcharkes]

  FINER: 2023-04-28 07:37:01.930010: Looking up version with --version for ToolInstance(cl.exe, null, file:///C:/Program%20Files/Microsoft%20Visual%20Studio/2022/Enterprise/VC/Tools/MSVC/14.29.30133/bin/HostX64/x86/cl.exe).
  
  INFO: 2023-04-28 07:37:01.930010: Running `C:\Program Files\Microsoft Visual Studio\2022\Enterprise\VC\Tools\MSVC\14.29.30133\bin\HostX64\x86\cl.exe`.
  TimeoutException after 0:01:00.000000: Test timed out after 1 minutes.
  dart:isolate  _RawReceivePort._handleMessage

FINER: 2023-04-28 07:37:11.478765: Looking for Visual Studio Locator on PATH.

https://github.com/dart-lang/native/actions/runs/4828010210/jobs/8601752423

This takes 50 seconds out of the 60 and then times out. That could indicate the process is genuinely running or hanging.

[dcharkes]

Some timings:

  FINER: 2023-04-28 07:36:52.243025: Looking up version with --version for ToolInstance(cl.exe, null, file:///C:/Program%20Files/Microsoft%20Visual%20Studio/2022/Enterprise/VC/Tools/MSVC/14.16.27023/bin/HostX64/x86/cl.exe).
  
  INFO: 2023-04-28 07:36:52.243025: Running `C:\Program Files\Microsoft Visual Studio\2022\Enterprise\VC\Tools\MSVC\14.16.27023\bin\HostX64\x86\cl.exe`.
  
  SEVERE: 2023-04-28 07:37:01.351491:   Microsoft (R) C/C++ Optimizing Compiler Version 19.16.27049 for x86
  
  SEVERE: 2023-04-28 07:37:01.523423:   Copyright (C) Microsoft Corporation.  All rights reserved.
  
  FINE: 2023-04-28 07:37:01.523423:   usage: cl [ option... ] filename... [ /link linkoption... ]
  
  FINE: 2023-04-28 07:37:01.930010: Found version for ToolInstance(cl.exe, 19.16.27049, file:///C:/Program%20Files/Microsoft%20Visual%20Studio/2022/Enterprise/VC/Tools/MSVC/14.16.27023/bin/HostX64/x86/cl.exe).

running some process: 9 seconds

  FINER: 2023-04-28 07:36:43.164965: Looking for cl.exe relative to [ToolInstance(MSVC, 14.16.27023, file:///C:/Program%20Files/Microsoft%20Visual%20Studio/2022/Enterprise/VC/Tools/MSVC/14.16.27023/), ToolInstance(MSVC, 14.29.30133, file:///C:/Program%20Files/Microsoft%20Visual%20Studio/2022/Enterprise/VC/Tools/MSVC/14.29.30133/), ToolInstance(MSVC, 14.34.31933, file:///C:/Program%20Files/Microsoft%20Visual%20Studio/2022/Enterprise/VC/Tools/MSVC/14.34.31933/), ToolInstance(MSVC, 14.35.32215, file:///C:/Program%20Files/Microsoft%20Visual%20Studio/2022/Enterprise/VC/Tools/MSVC/14.35.32215/)] with bin/Hostx64/x86/cl.exe.
  
  FINE: 2023-04-28 07:36:52.243025: Found [ToolInstance(cl.exe, null, file:///C:/Program%20Files/Microsoft%20Visual%20Studio/2022/Enterprise/VC/Tools/MSVC/14.16.27023/bin/HostX64/x86/cl.exe), ToolInstance(cl.exe, null, file:///C:/Program%20Files/Microsoft%20Visual%20Studio/2022/Enterprise/VC/Tools/MSVC/14.29.30133/bin/HostX64/x86/cl.exe), ToolInstance(cl.exe, null, file:///C:/Program%20Files/Microsoft%20Visual%20Studio/2022/Enterprise/VC/Tools/MSVC/14.34.31933/bin/HostX64/x86/cl.exe), ToolInstance(cl.exe, null, file:///C:/Program%20Files/Microsoft%20Visual%20Studio/2022/Enterprise/VC/Tools/MSVC/14.35.32215/bin/Hostx64/x86/cl.exe)].

looking up some files / glob: 9 seconds

  INFO: 2023-04-28 07:36:20.653689: Running `C:\Program Files\Microsoft Visual Studio\2022\Enterprise\VC\Tools\MSVC\14.35.32215\bin\Hostx64\x64\dumpbin.exe --version`.
  
  FINE: 2023-04-28 07:36:40.006900:   Microsoft (R) COFF/PE Dumper Version 14.35.32217.1
  Copyright (C) Microsoft Corporation.  All rights reserved.

Run process: 20 seconds.

  INFO: 2023-04-28 07:36:15.680959: Running `C:\Program Files\Microsoft Visual Studio\2022\Enterprise\VC\Tools\MSVC\14.34.31933\bin\HostX64\x64\dumpbin.exe --version`.
  
  FINE: 2023-04-28 07:36:20.278565:   Microsoft (R) COFF/PE Dumper Version 14.34.31944.0
  Copyright (C) Microsoft Corporation.  All rights reserved.

Run process: 5 seconds.

[dcharkes]

Maybe it is actually the machines or the internet connection of those machines:

Windows build 1:

Windows build 2:

pub get taking 2 minutes while 18 seconds on the other build.

Maybe just giving very generous timeouts will help.