Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

AccessibilityBridge TextField password TextField has correct Android semantics is flaky, Missing: {AndroidSemanticsAction.copy} #114360

Closed
keyonghan opened this issue Oct 31, 2022 · 3 comments
Assignees
Labels
a: accessibility Accessibility, e.g. VoiceOver or TalkBack. (aka a11y) c: flake Tests that sometimes, but not always, incorrectly pass framework flutter/packages/flutter repository. See also f: labels. P1 High-priority issues at the top of the work list

Comments

@keyonghan
Copy link
Contributor

The post-submit test builder Linux_android android_semantics_integration_test has been almost flaky 100% on every commit.
Screen Shot 2022-10-31 at 8 55 04 AM

Example builds:
https://ci.chromium.org/ui/p/flutter/builders/prod/Linux_android%20android_semantics_integration_test/3085/overview
https://ci.chromium.org/ui/p/flutter/builders/prod/Linux_android%20android_semantics_integration_test/3084/overview
https://ci.chromium.org/ui/p/flutter/builders/prod/Linux_android%20android_semantics_integration_test/3083/overview

[ +262 ms] 00:28 �[32m+8�[0m�[31m -2�[0m: AccessibilityBridge Headings body text does not have Android heading semantics�[0m
[android_semantics_integration_test] [STDOUT] stdout: [ +279 ms] 00:28 �[32m+9�[0m�[31m -2�[0m: AccessibilityBridge Headings (tearDownAll)�[0m
[android_semantics_integration_test] [STDOUT] stdout: [ +171 ms] 00:29 �[32m+9�[0m�[31m -2�[0m: AccessibilityBridge (tearDownAll)�[0m
[android_semantics_integration_test] [STDOUT] stdout: [   +6 ms] E/AccessibilityBridge(12459): Semantics node id does not equal ROOT_NODE_ID.
[android_semantics_integration_test] [STDOUT] stdout: [        ] E/AccessibilityBridge(12459): Semantics node id does not equal ROOT_NODE_ID.
[android_semantics_integration_test] [STDOUT] stdout: [+1096 ms] 00:30 �[32m+9�[0m�[31m -2�[0m: �[31mSome tests failed.�[0m
[android_semantics_integration_test] [STDOUT] stdout: [        ] Consider enabling the flag chain-stack-traces to receive more detailed exceptions.
[android_semantics_integration_test] [STDOUT] stdout: [        ] For example, 'dart test --chain-stack-traces'.
[android_semantics_integration_test] [STDOUT] stderr: [   +1 ms] Unhandled exception:
[android_semantics_integration_test] [STDOUT] stderr: [        ] Dummy exception to set exit code.
[android_semantics_integration_test] [STDOUT] stdout: [+1032 ms] Unregistering signal handlers...
[android_semantics_integration_test] [STDOUT] stdout: [   +1 ms] executing: /opt/s/w/ir/cache/android/sdk/platform-tools/adb -s ZY223CL9H5 shell screencap -p /data/local/tmp/flutter_screenshot.png
[android_semantics_integration_test] [STDOUT] stdout: [+1787 ms] executing: /opt/s/w/ir/cache/android/sdk/platform-tools/adb -s ZY223CL9H5 pull /data/local/tmp/flutter_screenshot.png /opt/s/w/ir/x/w/recipe_cleanup/flutter_logs_dir/drive_01.png
[android_semantics_integration_test] [STDOUT] stdout: [  +14 ms] 
@keyonghan keyonghan added framework flutter/packages/flutter repository. See also f: labels. P1 c: flake Tests that sometimes, but not always, incorrectly pass labels Oct 31, 2022
@pdblasi-google
Copy link
Contributor

Issues with the tree breaking were resolved by marking the tests with the bringup attribute in this PR. Investigation into a root problem is still ongoing.

@jmagman
Copy link
Member

jmagman commented Feb 15, 2023

This is still flaking: https://logs.chromium.org/logs/flutter/buildbucket/cr-buildbucket/8789103787419111409/+/u/run_android_semantics_integration_test/test_stdout

[android_semantics_integration_test] [STDOUT] stdout: [+1416 ms] 00:10 �[32m+0�[0m�[31m -1�[0m: AccessibilityBridge TextField TextField has correct Android semantics �[1m�[31m[E]�[0m�[0m
[android_semantics_integration_test] [STDOUT] stdout: [        ]   Expected: AndroidSemanticsNode with className: android.widget.EditText with actions: [AndroidSemanticsAction.click, AndroidSemanticsAction.copy, AndroidSemanticsAction.setSelection, AndroidSemanticsAction.setText] with flag isEditable: true with flag isFocusable: true with flag isFocused: true with flag isPassword: false
[android_semantics_integration_test] [STDOUT] stdout: [        ]     Actual: AndroidSemanticsNode:<{flags: {isEditable: true, isEnabled: true, isDismissible: false, isCheckable: false, isChecked: false, isFocused: true, isLongClickable: false, isFocusable: true, isPassword: false}, id: 4, text: null, rect: {height: 144, width: 1080, bottom: 128.0, top: 80.0, left: 0.0, right: 360.0}, actions: [131072, 2097152, 16, 128], className: android.widget.EditText, liveRegion: 1, contentDescription: null}>
[android_semantics_integration_test] [STDOUT] stdout: [        ]      Which: Expected actions: [AndroidSemanticsAction.click, AndroidSemanticsAction.copy, AndroidSemanticsAction.setSelection, AndroidSemanticsAction.setText]
[android_semantics_integration_test] [STDOUT] stdout: [        ]             Actual actions: [AndroidSemanticsAction.clearAccessibilityFocus, AndroidSemanticsAction.click, AndroidSemanticsAction.setSelection, AndroidSemanticsAction.setText]
[android_semantics_integration_test] [STDOUT] stdout: [        ]             Unexpected: {AndroidSemanticsAction.clearAccessibilityFocus}
[android_semantics_integration_test] [STDOUT] stdout: [        ]             Missing: {AndroidSemanticsAction.copy}
[android_semantics_integration_test] [STDOUT] stdout: [        ] 00:10 �[32m+0�[0m�[31m -1�[0m: AccessibilityBridge TextField password TextField has correct Android semantics�[0m
[android_semantics_integration_test] [STDOUT] stdout: [ +736 ms] 00:10 �[32m+0�[0m�[31m -2�[0m: AccessibilityBridge TextField password TextField has correct Android semantics �[1m�[31m[E]�[0m�[0m
[android_semantics_integration_test] [STDOUT] stdout: [        ]   Expected: AndroidSemanticsNode with className: android.widget.EditText with actions: [AndroidSemanticsAction.click, AndroidSemanticsAction.copy, AndroidSemanticsAction.setSelection, AndroidSemanticsAction.setText] with flag isEditable: true with flag isFocusable: true with flag isFocused: true with flag isPassword: true
[android_semantics_integration_test] [STDOUT] stdout: [        ]     Actual: AndroidSemanticsNode:<{flags: {isEditable: true, isEnabled: true, isDismissible: false, isCheckable: false, isChecked: false, isFocused: true, isLongClickable: false, isFocusable: true, isPassword: true}, id: 5, text: null, rect: {height: 144, width: 1080, bottom: 592.0, top: 544.0, left: 0.0, right: 360.0}, actions: [131072, 2097152, 16, 128], className: android.widget.EditText, liveRegion: 1, contentDescription: null}>
[android_semantics_integration_test] [STDOUT] stdout: [        ]      Which: Expected actions: [AndroidSemanticsAction.click, AndroidSemanticsAction.copy, AndroidSemanticsAction.setSelection, AndroidSemanticsAction.setText]
[android_semantics_integration_test] [STDOUT] stdout: [        ]             Actual actions: [AndroidSemanticsAction.clearAccessibilityFocus, AndroidSemanticsAction.click, AndroidSemanticsAction.setSelection, AndroidSemanticsAction.setText]
[android_semantics_integration_test] [STDOUT] stdout: [        ]             Unexpected: {AndroidSemanticsAction.clearAccessibilityFocus}
[android_semantics_integration_test] [STDOUT] stdout: [        ]             Missing: {AndroidSemanticsAction.copy}

@jmagman jmagman added the a: accessibility Accessibility, e.g. VoiceOver or TalkBack. (aka a11y) label Feb 15, 2023
@jmagman jmagman changed the title Linux_android android_semantics_integration_test is severely flaky AccessibilityBridge TextField password TextField has correct Android semantics is flaky, Missing: {AndroidSemanticsAction.copy} Feb 15, 2023
godofredoc added a commit to godofredoc/flutter that referenced this issue Apr 11, 2023
Set multiple tests as non flaky to save bot capacity.

Bug: flutter#119720
Bug: flutter#114360
Bug: flutter#112577
Bug: flutter#112573
Bug: flutter#106806
Bug: flutter#120808
Bug: flutter#107681
@github-actions
Copy link

This thread has been automatically locked since there has not been any recent activity after it was closed. If you are still experiencing a similar issue, please open a new bug, including the output of flutter doctor -v and a minimal reproduction of the issue.

@github-actions github-actions bot locked as resolved and limited conversation to collaborators Apr 26, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
a: accessibility Accessibility, e.g. VoiceOver or TalkBack. (aka a11y) c: flake Tests that sometimes, but not always, incorrectly pass framework flutter/packages/flutter repository. See also f: labels. P1 High-priority issues at the top of the work list
Projects
None yet
Development

No branches or pull requests

6 participants