Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Job output is not displayed fully #11765

Closed
4 of 6 tasks
guliaka opened this issue Feb 17, 2022 · 21 comments
Closed
4 of 6 tasks

Job output is not displayed fully #11765

guliaka opened this issue Feb 17, 2022 · 21 comments

Comments

@guliaka
Copy link

guliaka commented Feb 17, 2022

Please confirm the following

  • I agree to follow this project's code of conduct.
  • I have checked the current issues for duplicates.
  • I understand that AWX is open source software provided for free and that I might not receive a timely response.

Summary

Some lines is grayed out in job output results

image

AWX version

19.5.1

Select the relevant components

  • UI
  • API
  • Docs

Installation method

openshift

Modifications

no

Ansible version

2.9

Operating system

Win10

Web browser

Firefox, Chrome, Edge

Steps to reproduce

Run job with many line output

image

Expected results

See all output lines

Actual results

Many lines, specially toward end of the job just gray rectangles

image

or

image

Additional information

No response

@per-lind
Copy link

I can see the same thing in the job log, some times it will not scroll at all.
Just upgraded to version 20.0.0 in the hope that it would get better, but it feels like it is happening even more often now.

awx-1
Can see lots of request going from the browser, requests get fired nonstop even without any scrolling or interaction.
awx-2

In the AWX pod this is from the log (URL changed to a dummy version)
192.168.32.14 - - [21/Feb/2022:12:26:07 +0000] "GET /websocket/ HTTP/1.1" 101 225 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/98.0.4758.102 Safari/537.36 Edg/98.0.1108.56" "10.9.208.5" 2022-02-21 12:26:07,636 DEBUG [fd95a3060b4d4864bb875b7d388c4bb9] awx.analytics.performance request: <WSGIRequest: GET '/api/v2/jobs/4213/job_events/?counter__gt=43&counter__lt=45&order_by=counter&page_size=1'>, response_time: 0.244s 192.168.32.14 - - [21/Feb/2022:12:26:07 +0000] "GET /api/v2/jobs/4213/job_events/?counter__gt=43&counter__lt=45&order_by=counter&page_size=1 HTTP/1.1" 200 1573 "https://awx.dummy.io/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/98.0.4758.102 Safari/537.36 Edg/98.0.1108.56" "10.9.208.5" [pid: 56|app: 0|req: 70/15306] 192.168.32.14 () {72 vars in 3089 bytes} [Mon Feb 21 12:26:07 2022] GET /api/v2/jobs/4213/job_events/?counter__gt=43&counter__lt=45&order_by=counter&page_size=1 => generated 1573 bytes in 249 msecs (HTTP/1.1 200) 15 headers in 594 bytes (1 switches on core 0) 2022-02-21 12:26:07,715 DEBUG [e133876f86cb4ef2979fb5748f2563d4] awx.analytics.performance request: <WSGIRequest: GET '/api/v2/jobs/4213/job_events/?counter__gt=69&counter__lt=71&order_by=counter&page_size=1'>, response_time: 0.288s 192.168.32.14 - - [21/Feb/2022:12:26:07 +0000] "GET /api/v2/jobs/4213/job_events/?counter__gt=69&counter__lt=71&order_by=counter&page_size=1 HTTP/1.1" 200 1582 "https://awx.dummy.io/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/98.0.4758.102 Safari/537.36 Edg/98.0.1108.56" "10.9.208.5" [pid: 59|app: 0|req: 45/15307] 192.168.32.14 () {72 vars in 3089 bytes} [Mon Feb 21 12:26:07 2022] GET /api/v2/jobs/4213/job_events/?counter__gt=69&counter__lt=71&order_by=counter&page_size=1 => generated 1582 bytes in 290 msecs (HTTP/1.1 200) 15 headers in 594 bytes (1 switches on core 0) 2022-02-21 12:26:07,742 DEBUG [c3a931d294a34419937ff3842e8680f6] awx.analytics.performance request: <WSGIRequest: GET '/api/v2/jobs/4213/job_events/?counter__gt=80&counter__lt=82&order_by=counter&page_size=1'>, response_time: 0.310s 192.168.32.14 - - [21/Feb/2022:12:26:07 +0000] "GET /api/v2/jobs/4213/job_events/?counter__gt=80&counter__lt=82&order_by=counter&page_size=1 HTTP/1.1" 200 1571 "https://awx.dummy.io/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/98.0.4758.102 Safari/537.36 Edg/98.0.1108.56" "10.9.208.5" [pid: 57|app: 0|req: 58/15308] 192.168.32.14 () {72 vars in 3089 bytes} [Mon Feb 21 12:26:07 2022] GET /api/v2/jobs/4213/job_events/?counter__gt=80&counter__lt=82&order_by=counter&page_size=1 => generated 1571 bytes in 311 msecs (HTTP/1.1 200) 15 headers in 594 bytes (1 switches on core 0) 2022-02-21 12:26:07,823 DEBUG [521f29b7f2814b1aa647ff46a5c9c3b4] awx.analytics.performance request: <WSGIRequest: GET '/api/v2/jobs/4213/job_events/?uuid=e2a0c945-4197-0817-05b5-0000000000b0'>, response_time: 0.374s 192.168.32.14 - - [21/Feb/2022:12:26:07 +0000] "GET /api/v2/jobs/4213/job_events/?uuid=e2a0c945-4197-0817-05b5-0000000000b0 HTTP/1.1" 200 1587 "https://awx.dummy.io/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/98.0.4758.102 Safari/537.36 Edg/98.0.1108.56" "10.9.208.5" [pid: 55|app: 0|req: 82/15309] 192.168.32.14 () {72 vars in 3055 bytes} [Mon Feb 21 12:26:07 2022] GET /api/v2/jobs/4213/job_events/?uuid=e2a0c945-4197-0817-05b5-0000000000b0 => generated 1587 bytes in 376 msecs (HTTP/1.1 200) 15 headers in 594 bytes (1 switches on core 0) 2022-02-21 12:26:07,942 DEBUG [4ec9cab64e1a4ea6a7c1483a43e1f7fb] awx.analytics.performance request: <WSGIRequest: GET '/api/v2/jobs/4213/job_events/?counter__gt=95&counter__lt=97&order_by=counter&page_size=1'>, response_time: 0.549s 192.168.32.14 - - [21/Feb/2022:12:26:07 +0000] "GET /api/v2/jobs/4213/job_events/?counter__gt=95&counter__lt=97&order_by=counter&page_size=1 HTTP/1.1" 200 1561 "https://awx.dummy.io/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/98.0.4758.102 Safari/537.36 Edg/98.0.1108.56" "10.9.208.5" [pid: 58|app: 0|req: 55/15310] 192.168.32.14 () {72 vars in 3089 bytes} [Mon Feb 21 12:26:07 2022] GET /api/v2/jobs/4213/job_events/?counter__gt=95&counter__lt=97&order_by=counter&page_size=1 => generated 1561 bytes in 551 msecs (HTTP/1.1 200) 15 headers in 594 bytes (1 switches on core 0) 2022-02-21 12:26:08,026 DEBUG [3c3fa428a705430d9f4e2c877781dc64] awx.analytics.performance request: <WSGIRequest: GET '/api/v2/jobs/4213/job_events/?counter__gt=59&counter__lt=61&order_by=counter&page_size=1'>, response_time: 0.383s 192.168.32.14 - - [21/Feb/2022:12:26:08 +0000] "GET /api/v2/jobs/4213/job_events/?counter__gt=59&counter__lt=61&order_by=counter&page_size=1 HTTP/1.1" 200 1551 "https://awx.dummy.io/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/98.0.4758.102 Safari/537.36 Edg/98.0.1108.56" "10.9.208.5" [pid: 56|app: 0|req: 71/15311] 192.168.32.14 () {72 vars in 3089 bytes} [Mon Feb 21 12:26:07 2022] GET /api/v2/jobs/4213/job_events/?counter__gt=59&counter__lt=61&order_by=counter&page_size=1 => generated 1551 bytes in 388 msecs (HTTP/1.1 200) 15 headers in 594 bytes (1 switches on core 0) 2022-02-21 12:26:08,034 DEBUG [1f6493572ace4a72874e009b1a031417] awx.analytics.performance request: <WSGIRequest: GET '/api/v2/jobs/4213/job_events/?counter__gt=40&counter__lt=42&order_by=counter&page_size=1'>, response_time: 0.317s 192.168.32.14 - - [21/Feb/2022:12:26:08 +0000] "GET /api/v2/jobs/4213/job_events/?counter__gt=40&counter__lt=42&order_by=counter&page_size=1 HTTP/1.1" 200 1600 "https://awx.dummy.io/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/98.0.4758.102 Safari/537.36 Edg/98.0.1108.56" "10.9.208.5" [pid: 59|app: 0|req: 46/15312] 192.168.32.14 () {72 vars in 3089 bytes} [Mon Feb 21 12:26:07 2022] GET /api/v2/jobs/4213/job_events/?counter__gt=40&counter__lt=42&order_by=counter&page_size=1 => generated 1600 bytes in 318 msecs (HTTP/1.1 200) 15 headers in 594 bytes (1 switches on core 0) 2022-02-21 12:26:08,227 DEBUG [485951a92400423eaaaab5dd56179192] awx.analytics.performance request: <WSGIRequest: GET '/api/v2/jobs/4213/job_events/?counter__gt=14&counter__lt=16&order_by=counter&page_size=1'>, response_time: 0.401s 192.168.32.14 - - [21/Feb/2022:12:26:08 +0000] "GET /api/v2/jobs/4213/job_events/?counter__gt=14&counter__lt=16&order_by=counter&page_size=1 HTTP/1.1" 200 1537 "https://awx.dummy.io/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/98.0.4758.102 Safari/537.36 Edg/98.0.1108.56" "10.9.208.5" [pid: 55|app: 0|req: 83/15313] 192.168.32.14 () {72 vars in 3089 bytes} [Mon Feb 21 12:26:07 2022] GET /api/v2/jobs/4213/job_events/?counter__gt=14&counter__lt=16&order_by=counter&page_size=1 => generated 1537 bytes in 403 msecs (HTTP/1.1 200) 15 headers in 594 bytes (1 switches on core 0) 2022-02-21 12:26:08,327 DEBUG [074a0e85472945859ef04b1e529fb6a2] awx.analytics.performance request: <WSGIRequest: GET '/api/v2/jobs/4213/job_events/?counter__gt=89&counter__lt=91&order_by=counter&page_size=1'>, response_time: 0.381s 192.168.32.14 - - [21/Feb/2022:12:26:08 +0000] "GET /api/v2/jobs/4213/job_events/?counter__gt=89&counter__lt=91&order_by=counter&page_size=1 HTTP/1.1" 200 1559 "https://awx.dummy.io/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/98.0.4758.102 Safari/537.36 Edg/98.0.1108.56" "10.9.208.5" [pid: 58|app: 0|req: 56/15314] 192.168.32.14 () {72 vars in 3089 bytes} [Mon Feb 21 12:26:07 2022] GET /api/v2/jobs/4213/job_events/?counter__gt=89&counter__lt=91&order_by=counter&page_size=1 => generated 1559 bytes in 385 msecs (HTTP/1.1 200) 15 headers in 594 bytes (1 switches on core 0) 2022-02-21 12:26:08,333 DEBUG [0ba0321fed4e4355862c978f97dea0ef] awx.analytics.performance request: <WSGIRequest: GET '/api/v2/jobs/4213/job_events/?counter__gt=62&counter__lt=64&order_by=counter&page_size=1'>, response_time: 0.302s 192.168.32.14 - - [21/Feb/2022:12:26:08 +0000] "GET /api/v2/jobs/4213/job_events/?counter__gt=62&counter__lt=64&order_by=counter&page_size=1 HTTP/1.1" 200 1543 "https://awx.dummy.io/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/98.0.4758.102 Safari/537.36 Edg/98.0.1108.56" "10.9.208.5" [pid: 56|app: 0|req: 72/15315] 192.168.32.14 () {72 vars in 3089 bytes} [Mon Feb 21 12:26:08 2022] GET /api/v2/jobs/4213/job_events/?counter__gt=62&counter__lt=64&order_by=counter&page_size=1 => generated 1543 bytes in 305 msecs (HTTP/1.1 200) 15 headers in 594 bytes (1 switches on core 0) 2022-02-21 12:26:08,349 DEBUG [ab74ef99337a4a25b24b069911d5da6c] awx.analytics.performance request: <WSGIRequest: GET '/api/v2/jobs/4213/job_events/?counter__gt=55&counter__lt=58&order_by=counter&page_size=1'>, response_time: 0.312s 192.168.32.14 - - [21/Feb/2022:12:26:08 +0000] "GET /api/v2/jobs/4213/job_events/?counter__gt=55&counter__lt=58&order_by=counter&page_size=1 HTTP/1.1" 200 1624 "https://awx.dummy.io/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/98.0.4758.102 Safari/537.36 Edg/98.0.1108.56" "10.9.208.5" [pid: 59|app: 0|req: 47/15316] 192.168.32.14 () {72 vars in 3089 bytes} [Mon Feb 21 12:26:08 2022] GET /api/v2/jobs/4213/job_events/?counter__gt=55&counter__lt=58&order_by=counter&page_size=1 => generated 1624 bytes in 376 msecs (HTTP/1.1 200) 15 headers in 594 bytes (1 switches on core 0) 2022-02-21 12:26:08,443 DEBUG [b53883f7c1b54cbf9703086775653d87] awx.analytics.performance request: <WSGIRequest: GET '/api/v2/jobs/4213/job_events/?counter__gt=72&counter__lt=74&order_by=counter&page_size=1'>, response_time: 0.214s 192.168.32.14 - - [21/Feb/2022:12:26:08 +0000] "GET /api/v2/jobs/4213/job_events/?counter__gt=72&counter__lt=74&order_by=counter&page_size=1 HTTP/1.1" 200 1535 "https://awx.dummy.io/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/98.0.4758.102 Safari/537.36 Edg/98.0.1108.56" "10.9.208.5" [pid: 55|app: 0|req: 84/15317] 192.168.32.14 () {72 vars in 3089 bytes} [Mon Feb 21 12:26:08 2022] GET /api/v2/jobs/4213/job_events/?counter__gt=72&counter__lt=74&order_by=counter&page_size=1 => generated 1535 bytes in 216 msecs (HTTP/1.1 200) 15 headers in 594 bytes (1 switches on core 0) 2022-02-21 12:26:08,453 DEBUG [a77428a7bb844eafbeaeab898bac83d1] awx.analytics.performance request: <WSGIRequest: GET '/api/v2/jobs/4213/job_events/?counter__gt=25&counter__lt=27&order_by=counter&page_size=1'>, response_time: 0.709s [pid: 57|app: 0|req: 59/15318] 192.168.32.14 () {72 vars in 3089 bytes} [Mon Feb 21 12:26:07 2022] GET /api/v2/jobs/4213/job_events/?counter__gt=25&counter__lt=27&order_by=counter&page_size=1 => generated 1562 bytes in 714 msecs (HTTP/1.1 200) 15 headers in 594 bytes (1 switches on core 0) 192.168.32.14 - - [21/Feb/2022:12:26:08 +0000] "GET /api/v2/jobs/4213/job_events/?counter__gt=25&counter__lt=27&order_by=counter&page_size=1 HTTP/1.1" 200 1562 "https://awx.dummy.io/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/98.0.4758.102 Safari/537.36 Edg/98.0.1108.56" "10.9.208.5" 2022-02-21 12:26:08,545 DEBUG [822b75edce2c45d0965a21083ead4877] awx.analytics.performance request: <WSGIRequest: GET '/api/v2/dashboard/graphs/jobs/?job_type=all&period=month'>, response_time: 0.216s 192.168.32.14 - - [21/Feb/2022:12:26:08 +0000] "GET /api/v2/dashboard/graphs/jobs/?job_type=all&period=month HTTP/1.1" 200 1141 "https://awx.dummy.io/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/98.0.4758.102 Safari/537.36 Edg/98.0.1108.56" "10.9.208.5" [pid: 58|app: 0|req: 57/15319] 192.168.32.14 () {72 vars in 3025 bytes} [Mon Feb 21 12:26:08 2022] GET /api/v2/dashboard/graphs/jobs/?job_type=all&period=month => generated 1141 bytes in 218 msecs (HTTP/1.1 200) 14 headers in 571 bytes (1 switches on core 0) 2022-02-21 12:26:08,720 DEBUG [dc9ab06460ab4540a22a5fedb45ca4f7] awx.analytics.performance request: <WSGIRequest: GET '/api/v2/dashboard/'>, response_time: 0.380s 192.168.32.14 - - [21/Feb/2022:12:26:08 +0000] "GET /api/v2/dashboard/ HTTP/1.1" 200 1434 "https://awx.dummy.io/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/98.0.4758.102 Safari/537.36 Edg/98.0.1108.56" "10.9.208.5" [pid: 56|app: 0|req: 73/15320] 192.168.32.14 () {72 vars in 2950 bytes} [Mon Feb 21 12:26:08 2022] GET /api/v2/dashboard/ => generated 1434 bytes in 382 msecs (HTTP/1.1 200) 15 headers in 666 bytes (1 switches on core 0) 2022-02-21 12:26:08,731 DEBUG [b63960c176274ba99c0f340e5a83e4a2] awx.analytics.performance request: <WSGIRequest: GET '/api/v2/jobs/4213/job_events/?counter__gt=28&counter__lt=30&order_by=counter&page_size=1'>, response_time: 0.284s 192.168.32.14 - - [21/Feb/2022:12:26:08 +0000] "GET /api/v2/jobs/4213/job_events/?counter__gt=28&counter__lt=30&order_by=counter&page_size=1 HTTP/1.1" 200 1563 "https://awx.dummy.io/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/98.0.4758.102 Safari/537.36 Edg/98.0.1108.56" "10.9.208.5" [pid: 55|app: 0|req: 85/15321] 192.168.32.14 () {72 vars in 3089 bytes} [Mon Feb 21 12:26:08 2022] GET /api/v2/jobs/4213/job_events/?counter__gt=28&counter__lt=30&order_by=counter&page_size=1 => generated 1563 bytes in 287 msecs (HTTP/1.1 200) 15 headers in 594 bytes (1 switches on core 0) 2022-02-21 12:26:08,738 DEBUG [05a6aa4a4ff1414b85c265033eb22b5f] awx.analytics.performance request: <WSGIRequest: GET '/api/v2/jobs/4213/job_events/?counter__gt=22&counter__lt=24&order_by=counter&page_size=1'>, response_time: 0.279s 192.168.32.14 - - [21/Feb/2022:12:26:08 +0000] "GET /api/v2/jobs/4213/job_events/?counter__gt=22&counter__lt=24&order_by=counter&page_size=1 HTTP/1.1" 200 1552 "https://awx.dummy.io/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/98.0.4758.102 Safari/537.36 Edg/98.0.1108.56" "10.9.208.5" [pid: 57|app: 0|req: 60/15322] 192.168.32.14 () {72 vars in 3089 bytes} [Mon Feb 21 12:26:08 2022] GET /api/v2/jobs/4213/job_events/?counter__gt=22&counter__lt=24&order_by=counter&page_size=1 => generated 1552 bytes in 281 msecs (HTTP/1.1 200) 15 headers in 594 bytes (1 switches on core 0) 2022-02-21 12:26:08,745 DEBUG [4bfc391bde4448dda9cace8978b47fef] awx.analytics.performance request: <WSGIRequest: GET '/api/v2/jobs/4213/job_events/?counter__gt=34&counter__lt=36&order_by=counter&page_size=1'>, response_time: 0.333s 192.168.32.14 - - [21/Feb/2022:12:26:08 +0000] "GET /api/v2/jobs/4213/job_events/?counter__gt=34&counter__lt=36&order_by=counter&page_size=1 HTTP/1.1" 200 1542 "https://awx.dummy.io/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/98.0.4758.102 Safari/537.36 Edg/98.0.1108.56" "10.9.208.5" [pid: 59|app: 0|req: 48/15323] 192.168.32.14 () {72 vars in 3089 bytes} [Mon Feb 21 12:26:08 2022] GET /api/v2/jobs/4213/job_events/?counter__gt=34&counter__lt=36&order_by=counter&page_size=1 => generated 1542 bytes in 334 msecs (HTTP/1.1 200) 15 headers in 594 bytes (1 switches on core 0) 2022-02-21 12:26:08,831 DEBUG [22e200d2a6fb4d5aac2bbd9b76b1824b] awx.analytics.performance request: <WSGIRequest: GET '/api/v2/jobs/4213/job_events/?counter__gt=66&counter__lt=68&order_by=counter&page_size=1'>, response_time: 0.284s [pid: 58|app: 0|req: 58/15324] 192.168.32.14 () {72 vars in 3089 bytes} [Mon Feb 21 12:26:08 2022] GET /api/v2/jobs/4213/job_events/?counter__gt=66&counter__lt=68&order_by=counter&page_size=1 => generated 1546 bytes in 288 msecs (HTTP/1.1 200) 15 headers in 594 bytes (1 switches on core 0) 192.168.32.14 - - [21/Feb/2022:12:26:08 +0000] "GET /api/v2/jobs/4213/job_events/?counter__gt=66&counter__lt=68&order_by=counter&page_size=1 HTTP/1.1" 200 1546 "https://awx.dummy.io/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/98.0.4758.102 Safari/537.36 Edg/98.0.1108.56" "10.9.208.5" 2022-02-21 12:26:09,034 DEBUG [5afef24e90684ff3bcf5b01f34e900bf] awx.analytics.performance request: <WSGIRequest: GET '/api/v2/jobs/4213/job_events/?counter__gt=75&counter__lt=77&order_by=counter&page_size=1'>, response_time: 0.292s 192.168.32.14 - - [21/Feb/2022:12:26:09 +0000] "GET /api/v2/jobs/4213/job_events/?counter__gt=75&counter__lt=77&order_by=counter&page_size=1 HTTP/1.1" 200 1560 "https://awx.dummy.io/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/98.0.4758.102 Safari/537.36 Edg/98.0.1108.56" "10.9.208.5" [pid: 57|app: 0|req: 61/15325] 192.168.32.14 () {72 vars in 3089 bytes} [Mon Feb 21 12:26:08 2022] GET /api/v2/jobs/4213/job_events/?counter__gt=75&counter__lt=77&order_by=counter&page_size=1 => generated 1560 bytes in 294 msecs (HTTP/1.1 200) 15 headers in 594 bytes (1 switches on core 0) 2022-02-21 12:26:09,044 DEBUG [ab826100f2624c5e922b958f32bbd4fb] awx.analytics.performance request: <WSGIRequest: GET '/api/v2/jobs/4213/job_events/?counter__gt=37&counter__lt=39&order_by=counter&page_size=1'>, response_time: 0.319s 192.168.32.14 - - [21/Feb/2022:12:26:09 +0000] "GET /api/v2/jobs/4213/job_events/?counter__gt=37&counter__lt=39&order_by=counter&page_size=1 HTTP/1.1" 200 1555 "https://awx.dummy.io/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/98.0.4758.102 Safari/537.36 Edg/98.0.1108.56" "10.9.208.5" [pid: 56|app: 0|req: 74/15326] 192.168.32.14 () {72 vars in 3089 bytes} [Mon Feb 21 12:26:08 2022] GET /api/v2/jobs/4213/job_events/?counter__gt=37&counter__lt=39&order_by=counter&page_size=1 => generated 1555 bytes in 323 msecs (HTTP/1.1 200) 15 headers in 594 bytes (1 switches on core 0) 2022-02-21 12:26:09,053 DEBUG [9aecc23e9045425299ad6163c39e4a02] awx.analytics.performance request: <WSGIRequest: GET '/api/v2/jobs/4213/job_events/?counter__gt=98&counter__lt=100&order_by=counter&page_size=1'>, response_time: 0.320s [pid: 55|app: 0|req: 86/15327] 192.168.32.14 () {72 vars in 3091 bytes} [Mon Feb 21 12:26:08 2022] GET /api/v2/jobs/4213/job_events/?counter__gt=98&counter__lt=100&order_by=counter&page_size=1 => generated 1571 bytes in 323 msecs (HTTP/1.1 200) 15 headers in 594 bytes (1 switches on core 0) 192.168.32.14 - - [21/Feb/2022:12:26:09 +0000] "GET /api/v2/jobs/4213/job_events/?counter__gt=98&counter__lt=100&order_by=counter&page_size=1 HTTP/1.1" 200 1571 "https://awx.dummy.io/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/98.0.4758.102 Safari/537.36 Edg/98.0.1108.56" "10.9.208.5" 2022-02-21 12:26:09,111 DEBUG [721ad2ca3a2b430f9f0a391dc8995a05] awx.analytics.performance request: <WSGIRequest: GET '/api/v2/jobs/4213/job_events/?counter__gt=46&counter__lt=48&order_by=counter&page_size=1'>, response_time: 0.315s [pid: 59|app: 0|req: 49/15328] 192.168.32.14 () {72 vars in 3089 bytes} [Mon Feb 21 12:26:08 2022] GET /api/v2/jobs/4213/job_events/?counter__gt=46&counter__lt=48&order_by=counter&page_size=1 => generated 1548 bytes in 366 msecs (HTTP/1.1 200) 15 headers in 594 bytes (1 switches on core 0) 192.168.32.14 - - [21/Feb/2022:12:26:09 +0000] "GET /api/v2/jobs/4213/job_events/?counter__gt=46&counter__lt=48&order_by=counter&page_size=1 HTTP/1.1" 200 1548 "https://awx.dummy.io/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/98.0.4758.102 Safari/537.36 Edg/98.0.1108.56" "10.9.208.5" 2022-02-21 12:26:09,137 DEBUG [a3c1b3fadf1548cbb8bc89714a10bb00] awx.analytics.performance request: <WSGIRequest: GET '/api/v2/jobs/4213/job_events/?counter__gt=52&counter__lt=54&order_by=counter&page_size=1'>, response_time: 0.299s 192.168.32.14 - - [21/Feb/2022:12:26:09 +0000] "GET /api/v2/jobs/4213/job_events/?counter__gt=52&counter__lt=54&order_by=counter&page_size=1 HTTP/1.1" 200 1541 "https://awx.dummy.io/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/98.0.4758.102 Safari/537.36 Edg/98.0.1108.56" "10.9.208.5" [pid: 58|app: 0|req: 59/15329] 192.168.32.14 () {72 vars in 3089 bytes} [Mon Feb 21 12:26:08 2022] GET /api/v2/jobs/4213/job_events/?counter__gt=52&counter__lt=54&order_by=counter&page_size=1 => generated 1541 bytes in 302 msecs (HTTP/1.1 200) 15 headers in 594 bytes (1 switches on core 0) 2022-02-21 12:26:09,184 DEBUG [2c87bedfd52c486797fd0c7ad4090e2b] awx.analytics.performance request: <WSGIRequest: GET '/api/v2/dashboard/graphs/jobs/?job_type=all&period=month'>, response_time: 0.145s 192.168.32.14 - - [21/Feb/2022:12:26:09 +0000] "GET /api/v2/dashboard/graphs/jobs/?job_type=all&period=month HTTP/1.1" 200 1141 "https://awx.dummy.io/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/98.0.4758.102 Safari/537.36 Edg/98.0.1108.56" "10.9.208.5" [pid: 57|app: 0|req: 62/15330] 192.168.32.14 () {72 vars in 3025 bytes} [Mon Feb 21 12:26:09 2022] GET /api/v2/dashboard/graphs/jobs/?job_type=all&period=month => generated 1141 bytes in 149 msecs (HTTP/1.1 200) 14 headers in 571 bytes (1 switches on core 0)

@thedatabaseme
Copy link

thedatabaseme commented Feb 22, 2022

I made the discovery, that this is more likely to happen, when I have some [WARNING] in my Log output. For instance will lead the following warning to a non-viewable log output in my case.

[DEPRECATION WARNING]: Distribution debian 10.11 on host piHole should use 
/usr/bin/python3, but is using /usr/bin/python for backward compatibility with 
prior Ansible releases. A future Ansible release will default to using the 
discovered platform python for this host. See https://docs.ansible.com/ansible/
2.11/reference_appendices/interpreter_discovery.html for more information. This
 feature will be removed in version 2.12. Deprecation warnings can be disabled 
by setting deprecation_warnings=False in ansible.cfg.

When fixing the deprecation warning, all is shown well in the logs.

@guliaka
Copy link
Author

guliaka commented Feb 23, 2022

I don't think suppressing warnings is a good idea. They are needed to catch changes and update playbooks.

@guliaka
Copy link
Author

guliaka commented Feb 23, 2022

But it seems like some of the warning messages cause output to disappear.

@thedatabaseme
Copy link

But it seems like some of the warning messages cause output to disappear.

That's what I meant.

@mjsalmi
Copy link

mjsalmi commented Mar 5, 2022

I'm having this same issue with 20.0.0. Applying search terms (for example appending url with ?job_output.not__stdout__startswith=[WARNING]) makes the missing lines appear in stdout (even warnings I thought I was filtering out, maybe I just can't use this search properly)

@chris93111
Copy link
Contributor

Hi i confirm with ?job_output.not__stdout__startswith=[WARNING] all output is appear

@guliaka
Copy link
Author

guliaka commented Mar 7, 2022

Hi all,

Confirm that ?job_output.not__stdout__startswith=[WARNING] does the job. So it is all duplicate of #11647

@keithjgrant
Copy link
Member

Applying search terms (for example appending url with ?job_output.not__stdout__startswith=[WARNING]) makes the missing lines appear in stdout (even warnings I thought I was filtering out, maybe I just can't use this search properly)

Does it seem to fix the issue when you apply any search terms?

@chris93111
Copy link
Contributor

@keithjgrant yes just apply not__stdout="" fix the stdout for me

@mjsalmi
Copy link

mjsalmi commented Mar 12, 2022

@keithjgrant I can also confirm this. I also noticed that the output field seem to have extra grayed lines after job summary when filtering a "broken" job output with ?job_output.not__stdout="". This doesn't seem to occur with ?job_output.not__stdout__startswith filter.

@keithjgrant
Copy link
Member

@chris93111 Thanks. This confirms my suspicions. Performing a search disables the event nesting functionality (the expand/collapse arrows), so the page is more performant with a search filter applied.

The problem is likely caused by the UI trying to determine how events are nested in parent/child relationships. Most of the network traffic in the screenshot above (#11765 (comment)) is used by the UI to determine how many child nodes each parent event has. This network traffic is much heavier than anticipated and is almost certainly the cause.

Instead of these network requests, we need to see if the API can surface more information up front about the number of children for each event.

@bobross419
Copy link

bobross419 commented Mar 16, 2022

@keithjgrant After clearing out the warnings in my code, I also experienced this issue when I have duplicate imports. I've tried all the variations of import, include, diff, including vars, dynamic task names, and no task names that I could think of. The allow_duplicates params didn't make any difference either.

It presents similarly to the warnings issue, and it goes away with the same stdout query filters so I believe its the same root. I didn't see any other open issues specifically mentioning duplicate tasks, but I can see that you've been inundated with variations on #11765.

Is it enough to tack it on to this issue or should I open a fresh issue referencing this?

- import_role:
    name: foo
    tasks_from: some.yml
  vars:
    bar: baz
- import_role:
    name: foo
    tasks_from: some.yml
  vars:
    bar: qux
    
---
#roles/foo/tasks/some.yml
- debug:
    var: bar

@keithjgrant
Copy link
Member

See also #11818 and #11647 for more discussion (closed as duplicates of this issue)

@robinduerhager
Copy link

robinduerhager commented Mar 30, 2022

I also wanted to confirm, that even appending the url just with ?job_output leads to a functioning output in my case.
I tested out all workarounds provided in this thread. All workarounds provided behave the same way. Only excluding ?job_output... leads to the censored output lines. The Animation displays the output according to using and not using the workarounds :).

AWX_Output_Animation

@InnocentK
Copy link
Contributor

Resolved

@stefanpinter
Copy link

sorry, how is this solved? by adding the filter each time?

@kurokobo
Copy link
Contributor

@stefanpinter
It's already fixed in upstream devel branch, but not released yet. We'd just wait for the next release😃

@stefanpinter
Copy link

stefanpinter commented Apr 11, 2022

ah, ok thank you :)
i still wonder where I can see the Pull Request? in which of the 5 or so issues regarding this... i did not come across sadly

@kurokobo
Copy link
Contributor

#11928 and #11944

@AlexSCorey
Copy link
Member

The release cadence of AWX varies, however we try to release a new version of AWX every few weeks. If you feel comfortable running the HEAD of awx/devel then these changes will be immediately available.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests