qa: grep kernel logs for kclient warnings/failures to fail a test

[kotreshhr]

Fixes: https://tracker.ceph.com/issues/50150
Signed-off-by: Kotresh HR khiremat@redhat.com

Checklist

• References tracker ticket
• Updates documentation if necessary
• Includes tests for new functionality or reproducer for bug

---

Show available Jenkins commands

• jenkins retest this please
• jenkins test classic perf
• jenkins test crimson perf
• jenkins test signed
• jenkins test make check
• jenkins test make check arm64
• jenkins test submodules
• jenkins test dashboard
• jenkins test api
• jenkins test docs
• jenkins render docs
• jenkins test ceph-volume all
• jenkins test ceph-volume tox

[kotreshhr]

@batrick Does the /var/log/kern.log truncates before every run ?

[kotreshhr]

jenkins test make check

[batrick]

The changes look good to me. @jtlayton is there a decent way to synthetically generate these failures so we can verify this grep works as advertised?

[jtlayton]

Crashing the box is pretty simple if you have sysrq turned on. See:

https://www.kernel.org/doc/html/latest/admin-guide/sysrq.html

It may need to be enabled on the box though (see the above doc on how to do that). Then, you can just do echo c > /proc/sysrq-trigger. The other ones are harder to generate on their own.

[batrick]

Sure but what about the others? It'd be nice to test for each one to know it works.

[jtlayton]

Actually...you may be able to just inject the messages you want to catch into /dev/kmsg:

echo "BUG:" > /proc/kmsg

...and it should show up in the kernel's ring buffer.

[batrick]

@idryomov this will affect your krbd testing too. Any patterns you would like to add?

[idryomov]

We already have this, see https://github.com/ceph/teuthology/blob/master/teuthology/task/internal/syslog.py#L100-L143. If it's broken let's fix it instead of duplicating the functionality in the ceph task.

[kotreshhr]

We already have this, see https://github.com/ceph/teuthology/blob/master/teuthology/task/internal/syslog.py#L100-L143. If it's broken let's fix it instead of duplicating the functionality in the ceph task.

Pushed a PR in teuthology repo ceph/teuthology#1666

[stale]

This pull request has been automatically marked as stale because it has not had any activity for 60 days. It will be closed if no further activity occurs for another 30 days.
If you are a maintainer or core committer, please follow-up on this pull request to identify what steps should be taken by the author to move this proposed change forward.
If you are the author of this pull request, thank you for your proposed contribution. If you believe this change is still appropriate, please ensure that any feedback has been addressed and ask for a code review.

[batrick]

ceph/teuthology#1666 (comment)

[vshankar]

Superseded by ceph/teuthology#1666