Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

pkg/dartdev/test/commands/info_macos_test fails with RuntimeError on pkg-mac-release-arm64 #52402

Closed
stereotype441 opened this issue May 15, 2023 · 8 comments
Assignees
Labels
area-dart-cli Use area-dart-cli for issues related to the 'dart' command like tool. area-pkg Used for miscellaneous pkg/ packages not associated with specific area- teams.

Comments

@stereotype441
Copy link
Member

There are new test failures on [flow analysis] clean up public methods that call other public methods..

The tests

pkg/dartdev/test/commands/info_macos_test RuntimeError (expected Pass)

are failing on configurations

unittest-asserts-release-mac-arm64

Although the blamelist indicates that the test started failing at 214a98e, it's very difficult to imagine a way this commit could have provoked the failure, since the commit is a small refactor to flow analysis, and the failure is related to dartdev's ProcessInfo.commandLine getter returning an unexpectedly trimmed string.

If I had to guess, I suspect some change was made to the configuration of the trybot (e.g. an OS upgrade perhaps) that changed the way the process information appears when querying for processes on a mac.

CC @devoncarew

@devoncarew
Copy link
Member

Test failure output:

00:00 �[32m+0�[0m: process listing macos�[0m

00:00 �[32m+0�[0m�[31m -1�[0m: process listing macos �[1m�[31m[E]�[0m�[0m

  Expected: a string starting with 'dart'
    Actual: 'analysis_server.dart.snapshot --suppress-analytics --client-id=dart-fix --disable-server-feature-completion --disable-server-feature-search --sdk <path>/dart-sdk'
  

  package:matcher/src/expect/expect.dart 149:31        fail
  package:matcher/src/expect/expect.dart 144:3         _expect
  package:matcher/src/expect/expect.dart 56:3          expect
  pkg/dartdev/test/commands/info_macos_test.dart 24:9  main.<fn>.<fn>
  package:test_api/src/backend/declarer.dart 215:19    Declarer.test.<fn>.<fn>
  ===== asynchronous gap ===========================
  package:test_api/src/backend/declarer.dart 213:7     Declarer.test.<fn>
  ===== asynchronous gap ===========================
  package:test_api/src/backend/invoker.dart 258:9      Invoker._waitForOutstandingCallbacks.<fn>
  

00:00 �[32m+0�[0m�[31m -1�[0m: process listing parseMacos�[0m

00:00 �[32m+1�[0m�[31m -1�[0m: info macos shows process info�[0m

@lrhn lrhn added area-pkg Used for miscellaneous pkg/ packages not associated with specific area- teams. pkg-dartdev labels May 17, 2023
@sstrickl
Copy link
Contributor

Same test failure as above (log):

stdout:
00:00 �[32m+0�[0m: process listing macos�[0m

00:00 �[32m+0�[0m�[31m -1�[0m: process listing macos �[1m�[31m[E]�[0m�[0m

  Expected: a string starting with 'dart'
    Actual: 'analysis_server.dart.snapshot --suppress-analytics --client-id=dart-fix --disable-server-feature-completion --disable-server-feature-search --sdk <path>/dart-sdk'
  

  package:matcher/src/expect/expect.dart 149:31        fail
  package:matcher/src/expect/expect.dart 144:3         _expect
  package:matcher/src/expect/expect.dart 56:3          expect
  pkg/dartdev/test/commands/info_macos_test.dart 24:9  main.<fn>.<fn>
  package:test_api/src/backend/declarer.dart 215:19    Declarer.test.<fn>.<fn>
  ===== asynchronous gap ===========================
  package:test_api/src/backend/declarer.dart 213:7     Declarer.test.<fn>
  ===== asynchronous gap ===========================
  package:test_api/src/backend/invoker.dart 258:9      Invoker._waitForOutstandingCallbacks.<fn>
  

00:00 �[32m+0�[0m�[31m -1�[0m: process listing parseMacos�[0m

00:00 �[32m+1�[0m�[31m -1�[0m: info macos shows process info�[0m

00:00 �[32m+2�[0m�[31m -1�[0m: �[31mSome tests failed.�[0m

@alexmarkov alexmarkov changed the title Failures on [flow analysis] clean up public methods that call other public methods. pkg/dartdev/test/commands/info_macos_test fails with RuntimeError on pkg-mac-release-arm64 Jun 1, 2023
@alexmarkov
Copy link
Contributor

This test started failing once again on the unrelated commit:

--- Command "vm" (took 01.000926s):
DART_CONFIGURATION=ReleaseARM64 CHROME_PATH="/opt/s/w/ir/cache/builder/sdk/third_party/browsers/chrome/Google Chrome.app/Contents/MacOS/Google Chrome" xcodebuild/ReleaseARM64/dart-sdk/bin/dart --enable_asserts --sound-null-safety -Dtest_runner.configuration=unittest-asserts-release-mac-arm64 --ignore-unrecognized-flags --packages=/opt/s/w/ir/cache/builder/sdk/.dart_tool/package_config.json /opt/s/w/ir/cache/builder/sdk/pkg/dartdev/test/commands/info_macos_test.dart

exit code:
255

stdout:
00:00 �[32m+0�[0m: process listing macos�[0m

00:00 �[32m+0�[0m�[31m -1�[0m: process listing macos �[1m�[31m[E]�[0m�[0m

  Expected: a string starting with 'dart'
    Actual: 'analysis_server.dart.snapshot --suppress-analytics --client-id=dart-fix --disable-server-feature-completion --disable-server-feature-search --sdk <path>/dart-sdk'
  

  package:matcher/src/expect/expect.dart 149:31        fail
  package:matcher/src/expect/expect.dart 144:3         _expect
  package:matcher/src/expect/expect.dart 56:3          expect
  pkg/dartdev/test/commands/info_macos_test.dart 24:9  main.<fn>.<fn>
  package:test_api/src/backend/declarer.dart 215:19    Declarer.test.<fn>.<fn>
  ===== asynchronous gap ===========================
  package:test_api/src/backend/declarer.dart 213:7     Declarer.test.<fn>
  ===== asynchronous gap ===========================
  package:test_api/src/backend/invoker.dart 258:9      Invoker._waitForOutstandingCallbacks.<fn>
  

00:00 �[32m+0�[0m�[31m -1�[0m: process listing parseMacos�[0m

00:00 �[32m+1�[0m�[31m -1�[0m: info macos shows process info�[0m

00:00 �[32m+2�[0m�[31m -1�[0m: �[31mSome tests failed.�[0m



Consider enabling the flag chain-stack-traces to receive more detailed exceptions.
For example, 'dart test --chain-stack-traces'.

stderr:
Unhandled exception:
Dummy exception to set exit code.

--- Re-run this test:
python3 tools/test.py -n unittest-asserts-release-mac-arm64 pkg/dartdev/test/commands/info_macos_test

https://dart-ci.appspot.com/log/pkg-mac-release-arm64/unittest-asserts-release-mac-arm64/8307/pkg/dartdev/test/commands/info_macos_test

@alexmarkov
Copy link
Contributor

/cc @bkonyi

@alexmarkov alexmarkov added the area-dart-cli Use area-dart-cli for issues related to the 'dart' command like tool. label Jun 1, 2023
@devoncarew devoncarew self-assigned this Jun 13, 2023
@devoncarew
Copy link
Member

Looking at this now -

copybara-service bot pushed a commit that referenced this issue Jun 20, 2023
Bug: #52402
Change-Id: I71a9d1112475347beae5a634d0275847a5c7685e
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/308962
Commit-Queue: Devon Carew <devoncarew@google.com>
Reviewed-by: Ben Konyi <bkonyi@google.com>
@joshualitt
Copy link
Contributor

I think I may have also triggered this on a recent commit(https://dart-review.googlesource.com/c/sdk/+/307961). Approving the failure for now.

@nshahan
Copy link
Contributor

nshahan commented Jul 6, 2023

This test just started failing again on one of my unrelated changes with the same process listing macos failure shown above.

@aam
Copy link
Contributor

aam commented Jul 6, 2023

Duplicate of #52658

@aam aam marked this as a duplicate of #52658 Jul 6, 2023
@aam aam closed this as completed Jul 6, 2023
copybara-service bot pushed a commit that referenced this issue Jul 6, 2023
Align info_macos_test with info_linux_test in this regard: fix is similar to how #50583 was addressed.

BUG=#52658
BUG=#52402

TEST=ci

Change-Id: If7ab54990069c86eb5c0348e20086254818da839
Reviewed-on: https://dart-review.googlesource.com/c/sdk/+/312705
Reviewed-by: Siva Annamalai <asiva@google.com>
Commit-Queue: Alexander Aprelev <aam@google.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area-dart-cli Use area-dart-cli for issues related to the 'dart' command like tool. area-pkg Used for miscellaneous pkg/ packages not associated with specific area- teams.
Projects
None yet
Development

No branches or pull requests

8 participants