Intermittent issue with TEST_RUNNER_BANNER_ID #12

talbert · 2023-01-09T20:52:04Z

More than half of my scheduled test runner executions attempts (sys_atf_schedule) fail with an error regarding the inability to find "test_runner_banner" string on the client test runner page.

When the scheduled execution starts, I confirm it connects successfully to the remote machine as the docker image runs on it, as confirmed with a docker ps showing that it's running the robot.robot script.

talbert@latrian:~$ docker ps
CONTAINER ID   IMAGE                                                    COMMAND                  CREATED         STATUS        PORTS     NAMES
6feb577f06f7   ghcr.io/servicenow/atf-headless-runner:lin-1.0.1-alpha   "/bin/sh -c 'robot r…"   3 seconds ago   Up 1 second             a14f25a1bd906d10798f6c924dde5aaa.1.9zf6pugadfykmd2x2o19rbad2

I can confirm the docker user has the correct roles (atf_test_designer, impersonator) and indeed sometimes the scheduled test runner works with the user as-is.

If I view the page source of atf_test_runner.do I can confirm it contains:

<div class="navbar-header" style="padding: 6px 5px;" id="test_runner_banner">

As you would expect from the validations here.

When it does work, it works immediately. When it fails, it cycles through
"Headless client test runners not started, attempts left: 9."

Configuration was completed as follows on the docs site. Port 2376 is open and as show above the PDI is connecting to the remote machine.

I'm kind of at a loss for what's happening?

Below is an example of the output from sn_atf_docker_service I get when a failure occurs.

(EDIT: can confirm sn_atf.schedule.enabled and sn_atf.runner.enabled are set to true on this instance).

O==============================================================================
ORobot :: Script to startup a headless client test runner                      
O==============================================================================
sOpen browser                                                          AGENT_ID is a94f25a1fd906d106c98272cfaddb5a9
�BROWSER is headlesschrome
2INSTANCE_URL is https://dev115395.service-now.com
�USERNAME is docker
&Secret Path: /run/secrets/sn_password
�TIMEOUT is 1440 minutes
�LOGIN_PAGE is login.do
nRUNNER_URL is atf_test_runner.do?sysparm_nostack=true&sysparm_scheduled_tests_only=true&sysparm_headless=true
NBROWSER_OPTIONS is add_argument('--no-sandbox');add_argument('--disable-gpu')
!LOGIN_BUTTON_ID is sysverb_login
�USER_FIELD_ID is user_name
#PASSWORD_FIELD_ID is user_password
9HEADLESS_VALIDATION_PAGE is atf_headless_validation_page
+VP_VALIDATION_ID is headless_vp_validation
'VP_HAS_ROLE_ID is headless_vp_has_role
%VP_SUCCESS_ID is headless_vp_success
,TEST_RUNNER_BANNER_ID is test_runner_banner
�HEARTBEAT_ENABLED is true
+HEARTBEAT_URI is /api/now/atf_agent/online
8Login URL is https://dev115395.service-now.com/login.do
�Logging in user: docker
�>[ WARN ] Keyword 'BuiltIn.Run Keyword Unless' is deprecated. 
�>[ WARN ] Keyword 'BuiltIn.Run Keyword Unless' is deprecated. 
�Clicked Login Button
OGoing to entry: https://dev115395.service-now.com/atf_headless_validation_page
�Going to runner: https://dev115395.service-now.com/atf_test_runner.do?sysparm_nostack=true&sysparm_scheduled_tests_only=true&sysparm_headless=true&sys_atf_agent=a94f25a1fd906d106c98272cfaddb5a9
	| FAIL |
tThe client test runner page could not load, Property sn_atf.schedule.enabled and sn_atf.runner.enabled must be true
O------------------------------------------------------------------------------
ORobot :: Script to startup a headless client test runner              | FAIL |
�1 test, 0 passed, 1 failed
O==============================================================================
$Output:  /var/servicenow/output.xml
"Log:     /var/servicenow/log.html
%Report:  /var/servicenow/report.html
O==============================================================================
ORobot :: Script to startup a headless client test runner                      
O==============================================================================
sOpen browser                                                          AGENT_ID is a94f25a1fd906d106c98272cfaddb5a9
�BROWSER is headlesschrome
2INSTANCE_URL is https://dev115395.service-now.com
�USERNAME is docker
&Secret Path: /run/secrets/sn_password
�TIMEOUT is 1440 minutes
�LOGIN_PAGE is login.do
nRUNNER_URL is atf_test_runner.do?sysparm_nostack=true&sysparm_scheduled_tests_only=true&sysparm_headless=true
NBROWSER_OPTIONS is add_argument('--no-sandbox');add_argument('--disable-gpu')
!LOGIN_BUTTON_ID is sysverb_login
�USER_FIELD_ID is user_name
#PASSWORD_FIELD_ID is user_password
9HEADLESS_VALIDATION_PAGE is atf_headless_validation_page
+VP_VALIDATION_ID is headless_vp_validation
'VP_HAS_ROLE_ID is headless_vp_has_role
%VP_SUCCESS_ID is headless_vp_success
,TEST_RUNNER_BANNER_ID is test_runner_banner
�HEARTBEAT_ENABLED is true
+HEARTBEAT_URI is /api/now/atf_agent/online
8Login URL is https://dev115395.service-now.com/login.do
�Logging in user: docker
�>[ WARN ] Keyword 'BuiltIn.Run Keyword Unless' is deprecated. 
�>[ WARN ] Keyword 'BuiltIn.Run Keyword Unless' is deprecated. 
�Clicked Login Button
OGoing to entry: https://dev115395.service-now.com/atf_headless_validation_page
�Going to runner: https://dev115395.service-now.com/atf_test_runner.do?sysparm_nostack=true&sysparm_scheduled_tests_only=true&sysparm_headless=true&sys_atf_agent=a94f25a1fd906d106c98272cfaddb5a9
�d[ WARN ] Keyword 'Capture Page Screenshot' could not be run on failure: Message: invalid session id
�Stacktrace:
��#0 0x55916cadef33 <unknown>
��#1 0x55916c828faf <unknown>
��#2 0x55916c8526ff <unknown>
��#3 0x55916c853985 <unknown>
��#4 0x55916cb234cd <unknown>
��#5 0x55916cb275ec <unknown>
��#6 0x55916cb0d71e <unknown>
��#7 0x55916cb28238 <unknown>
��#8 0x55916cb02870 <unknown>
��#9 0x55916cb44608 <unknown>
��#10 0x55916cb44788 <unknown>
��#11 0x55916cb5ef1d <unknown>
��#12 0x7f769d1f4ea7 <unknown>
�
	| FAIL |
RWebDriverException: Message: unknown error: session deleted because of page crash
4from unknown error: cannot determine loading status
�from tab crashed
0  (Session info: headless chrome=102.0.5005.61)
Stacktrace:
�#0 0x55916cadef33 <unknown>
�#1 0x55916c828faf <unknown>
�#2 0x55916c81503d <unknown>
�#3 0x55916c814a55 <unknown>
�#4 0x55916c813f15 <unknown>
�#5 0x55916c812c0f <unknown>
�#6 0x55916c81319c <unknown>
�#7 0x55916c8215ff <unknown>
�#8 0x55916c822162 <unknown>
�#9 0x55916c83024d <unknown>
�#10 0x55916c83366a <unknown>
�#11 0x55916c8135c6 <unknown>
�#12 0x55916c82fdf1 <unknown>
�#13 0x55916c8906e8 <unknown>
�#14 0x55916c87ce63 <unknown>
�#15 0x55916c85282a <unknown>
�#16 0x55916c853985 <unknown>
�#17 0x55916cb234cd <unknown>
�#18 0x55916cb275ec <unknown>
�#19 0x55916cb0d71e <unknown>
�#20 0x55916cb28238 <unknown>
�#21 0x55916cb02870 <unknown>
�#22 0x55916cb44608 <unknown>
�#23 0x55916cb44788 <unknown>
�#24 0x55916cb5ef1d <unknown>
�#25 0x7f769d1f4ea7 <unknown>
O------------------------------------------------------------------------------
ORobot :: Script to startup a headless client test runner              | FAIL |
�1 test, 0 passed, 1 failed
O==============================================================================
$Output:  /var/servicenow/output.xml
"Log:     /var/servicenow/log.html
%Report:  /var/servicenow/report.html

Output from from the rarer case of a successful execution:

O==============================================================================
ORobot :: Script to startup a headless client test runner                      
O==============================================================================
sOpen browser                                                          AGENT_ID is 5cb9216d42506d10db9f2db79903c20d
�BROWSER is headlesschrome
2INSTANCE_URL is https://dev115395.service-now.com
�USERNAME is docker
&Secret Path: /run/secrets/sn_password
�TIMEOUT is 1440 minutes
�LOGIN_PAGE is login.do
nRUNNER_URL is atf_test_runner.do?sysparm_nostack=true&sysparm_scheduled_tests_only=true&sysparm_headless=true
NBROWSER_OPTIONS is add_argument('--no-sandbox');add_argument('--disable-gpu')
!LOGIN_BUTTON_ID is sysverb_login
�USER_FIELD_ID is user_name
#PASSWORD_FIELD_ID is user_password
9HEADLESS_VALIDATION_PAGE is atf_headless_validation_page
+VP_VALIDATION_ID is headless_vp_validation
'VP_HAS_ROLE_ID is headless_vp_has_role
%VP_SUCCESS_ID is headless_vp_success
,TEST_RUNNER_BANNER_ID is test_runner_banner
�HEARTBEAT_ENABLED is true
+HEARTBEAT_URI is /api/now/atf_agent/online
8Login URL is https://dev115395.service-now.com/login.do
�Logging in user: docker
�>[ WARN ] Keyword 'BuiltIn.Run Keyword Unless' is deprecated. 
�>[ WARN ] Keyword 'BuiltIn.Run Keyword Unless' is deprecated. 
�Clicked Login Button
OGoing to entry: https://dev115395.service-now.com/atf_headless_validation_page
�Going to runner: https://dev115395.service-now.com/atf_test_runner.do?sysparm_nostack=true&sysparm_scheduled_tests_only=true&sysparm_headless=true&sys_atf_agent=5cb9216d42506d10db9f2db79903c20d
!Waiting for agent to come online
I2023-01-09 21:53:53 | Heartbeat Response: {'result': {'online': 'true'}}
�Agent is online
I2023-01-09 21:53:54 | Heartbeat Response: {'result': {'online': 'true'}}

EDITS: better success and failure examples

The text was updated successfully, but these errors were encountered:

chiarng · 2023-01-10T15:48:19Z

Hey this is the wrong place to report this, would you mind submitting a CS ticket with ServiceNow support team? Thanks.

chiarng closed this as completed Jan 10, 2023

tohlox mentioned this issue Sep 11, 2023

lin-1.0.1-alpha version issues #14

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Intermittent issue with TEST_RUNNER_BANNER_ID #12

Intermittent issue with TEST_RUNNER_BANNER_ID #12

talbert commented Jan 9, 2023 •

edited

Loading

chiarng commented Jan 10, 2023

Intermittent issue with TEST_RUNNER_BANNER_ID #12

Intermittent issue with TEST_RUNNER_BANNER_ID #12

Comments

talbert commented Jan 9, 2023 • edited Loading

chiarng commented Jan 10, 2023

talbert commented Jan 9, 2023 •

edited

Loading