New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Improve yast2_samba.pm #3344
Improve yast2_samba.pm #3344
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I can confirm that test module is stable and main reason of failures are kernel messages disrupting ncurses ui, however on production there were other failures, like:
https://openqa.opensuse.org/tests/435819#step/yast2_samba/29
The main problem with tests (independent from other sources of instability) is that we do a lot of key presses and do not verify what happened. So I would spend more time trying to eliminate potential issues we have already seen.
I only see a dmesg call so the commit and PR description does not fit the content |
@okurz it seems that the changes got somehow lost, I'm checking this... |
@okurz got lost changes back :) |
tests/console/yast2_samba.pm
Outdated
send_key 'alt-f'; | ||
send_key 'alt-i'; | ||
wait_screen_change { send_key 'alt-f' }; | ||
wait_screen_change { send_key 'alt-i' }; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
no wait_screen_change before assert_screen
tests/console/yast2_samba.pm
Outdated
|
||
# finally, close with OK | ||
send_key 'alt-o'; | ||
wait_screen_change { send_key 'alt-o' }; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
also this should not be necessary when we have a wait_serial just afterwards
- use "dmesg -n 4" against kernel message floating over console - use wait_screen_change to avoid timeout issue
As we see a lot of failures related to the fact that return code is not there after 60 seconds, I suggest that we increase it to some bigger value, e.g. 180. |
@rwx788 as we talked already, there is no issue related to timeout (wait_serial) at moment. Since a couple of days I have sometimes failures for samba because of yast2 got crashed. I've reported the issue: |
@rwx788 should we mark the dmesg with a soft fail? |
@okurz sounds good to me. But we need to make up our mind about this in general. Adding "quiet" to boot option should do the trick, for example: |
ok, I added an according comment to https://progress.opensuse.org/issues/19398 . That should be good enough for now |
openSUSE TW: http://e13.suse.de/tests/3730#step/yast2_samba
openSUSE Leap: http://e13.suse.de/tests/3731#step/yast2_samba
SLES 12 SP3: http://e13.suse.de/tests/3750#step/yast2_samba