Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

failing network tests with code coverage enabled in qemu_x86 not failing when run with gdb #17784

Closed
applejax124 opened this issue Jul 25, 2019 · 1 comment · Fixed by #17989
Assignees
Labels
bug The issue is a bug, or the PR is fixing a bug Code Coverage priority: low Low impact/importance bug

Comments

@applejax124
Copy link

$ ./scripts/sanitycheck --coverage -p qemu_x86 -T tests/net/
JOBS: 4
Cleaning output directory /home/camelot/zephyrproject/zephyr/sanity-out
Building testcase defconfigs...
Filtering test cases...
51 tests selected, 21150 tests discarded due to filters
total complete:    9/  51  17%  failed:    0

qemu_x86                  tests/net/iface/net.iface.no_userspace_allowed     FAILED: unexpected eof
	see: sanity-out/qemu_x86/tests/net/iface/net.iface.no_userspace_allowed/handler.log

total complete:   10/  51  19%  failed:    1

qemu_x86                  tests/net/iface/net.iface.with_userspace           FAILED: unexpected eof
	see: sanity-out/qemu_x86/tests/net/iface/net.iface.with_userspace/handler.log

total complete:   19/  51  37%  failed:    2

qemu_x86                  tests/net/lib/mqtt_packet/net.mqtt.packet          FAILED: handler_crash
	see: sanity-out/qemu_x86/tests/net/lib/mqtt_packet/net.mqtt.packet/handler.log

total complete:   34/  51  66%  failed:    3

qemu_x86                  tests/net/socket/getaddrinfo/net.socket            FAILED: handler_crash
	see: sanity-out/qemu_x86/tests/net/socket/getaddrinfo/net.socket/handler.log

total complete:   35/  51  68%  failed:    4

qemu_x86                  tests/net/socket/getnameinfo/net.socket            FAILED: unexpected eof
	see: sanity-out/qemu_x86/tests/net/socket/getnameinfo/net.socket/handler.log

total complete:   36/  51  70%  failed:    5

qemu_x86                  tests/net/socket/misc/net.socket                   FAILED: handler_crash
	see: sanity-out/qemu_x86/tests/net/socket/misc/net.socket/handler.log

total complete:   37/  51  72%  failed:    6

qemu_x86                  tests/net/socket/net_mgmt/net.socket.mgmt          FAILED: unexpected eof
	see: sanity-out/qemu_x86/tests/net/socket/net_mgmt/net.socket.mgmt/handler.log

total complete:   38/  51  74%  failed:    7

qemu_x86                  tests/net/ptp/clock/net.ptp.clock                  FAILED: timeout
	see: sanity-out/qemu_x86/tests/net/ptp/clock/net.ptp.clock/handler.log

total complete:   39/  51  76%  failed:    8

qemu_x86                  tests/net/socket/register/net.socket.register.tls  FAILED: unexpected eof
	see: sanity-out/qemu_x86/tests/net/socket/register/net.socket.register.tls/handler.log

total complete:   40/  51  78%  failed:    9

qemu_x86                  tests/net/socket/select/net.socket                 FAILED: handler_crash
	see: sanity-out/qemu_x86/tests/net/socket/select/net.socket/handler.log

total complete:   41/  51  80%  failed:   10

qemu_x86                  tests/net/socket/tcp/net.socket.tcp                FAILED: unexpected eof
	see: sanity-out/qemu_x86/tests/net/socket/tcp/net.socket.tcp/handler.log

total complete:   42/  51  82%  failed:   11

qemu_x86                  tests/net/socket/udp/net.socket.udp                FAILED: unexpected eof
	see: sanity-out/qemu_x86/tests/net/socket/udp/net.socket.udp/handler.log

total complete:   47/  51  92%  failed:   12

qemu_x86                  tests/net/utils/net.util                           FAILED: unexpected eof
	see: sanity-out/qemu_x86/tests/net/utils/net.util/handler.log

total complete:   51/  51  100%  failed:   13

Enabling CONFIG_COVERAGE exposes test failures with networking tests under tests/net/. We need these be able to build and run successfully to assess code coverage of the network stack.

Upon further inspection, 2 of these don't seem to fail when run with gdb, but continue to fail when running sanitycheck.

  • tests/net/socket/register
  • tests/net/lib/mqtt_packet

Reproduce with:
sanitycheck --coverage -p qemu_x86 -T tests/net/

@applejax124 applejax124 added bug The issue is a bug, or the PR is fixing a bug Code Coverage labels Jul 25, 2019
@ioannisg ioannisg added the priority: low Low impact/importance bug label Jul 30, 2019
@andrewboie
Copy link
Contributor

This appears to be fixed by #17989

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug The issue is a bug, or the PR is fixing a bug Code Coverage priority: low Low impact/importance bug
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants