qa/suites: Add orch/cephadm/smoke-small suite

[zmc]

Contribution Guidelines

• To sign and title your commits, please refer to Submitting Patches to Ceph.

• If you are submitting a fix for a stable branch (e.g. "pacific"), please refer to Submitting Patches to Ceph - Backports for the proper workflow.

Checklist

• Tracker (select at least one)
  • References tracker ticket
  • Very recent bug; references commit where it was introduced
  • New feature (ticket optional)
  • Doc update (no ticket needed)
  • Code cleanup (no ticket needed)
• Component impact
  • Affects Dashboard, opened tracker ticket
  • Affects Orchestrator, opened tracker ticket
  • No impact that needs to be tracked
• Documentation (select at least one)
  • Updates relevant documentation
  • No doc update is appropriate
• Tests (select at least one)
  • Includes unit test(s)
  • Includes integration test(s)
  • Includes bug reproducer
  • No tests

Show available Jenkins commands

• jenkins retest this please
• jenkins test classic perf
• jenkins test crimson perf
• jenkins test signed
• jenkins test make check
• jenkins test make check arm64
• jenkins test submodules
• jenkins test dashboard
• jenkins test dashboard cephadm
• jenkins test api
• jenkins test docs
• jenkins render docs
• jenkins test ceph-volume all
• jenkins test ceph-volume tox
• jenkins test windows

[adk3798]

for my info, what's the main idea behind this test suite? @zmc

[adk3798]

for my info, what's the main idea behind this test suite? @zmc

ping @zmc

[zmc]

Whoops - I must have hit some keyboard shortcut that meant "submit your half-written comment and close the PR" without meaning to 🙂

@adk3798 Apologies - I've been so busy with the outage that I never answered your very reasonable question. This suite is mainly to be used with ceph-devstack, which is a tool I've been working on that lets us run tests in more locations than just the Sepia lab, with minimal setup.

[adk3798]

https://pulpito.ceph.com/adking-2023-01-21_05:38:21-orch:cephadm-wip-adk-testing-2023-01-20-1359-distro-default-smithi/

original run, all smoke-small tests passed. Going to run a larger batch of just those tests and report back

[adk3798]

28 more tests between these 2 runs

https://pulpito.ceph.com/adking-2023-01-22_16:18:38-orch:cephadm-wip-adk-testing-2023-01-20-1359-distro-default-smithi/
https://pulpito.ceph.com/adking-2023-01-22_16:58:19-orch:cephadm-wip-adk-testing-2023-01-20-1359-distro-default-smithi/

6 of them did fail, but it seems it was an external issue with some mirror we pull from being flaky

2023-01-22T17:05:38.685 INFO:teuthology.orchestra.run.smithi086.stdout:(2/3): kernel-modules-4.18.0-448.el8.x86_64.rpm  19 MB/s |  34 MB     00:01
2023-01-22T17:05:38.695 INFO:teuthology.orchestra.run.smithi138.stderr:Error: Error downloading packages:
2023-01-22T17:05:38.696 INFO:teuthology.orchestra.run.smithi138.stderr:  kernel-modules-4.18.0-448.el8.x86_64: Cannot download, all mirrors were already tried without success
2023-01-22T17:05:38.698 INFO:teuthology.orchestra.run.smithi114.stderr:Error: Error downloading packages:
2023-01-22T17:05:38.699 INFO:teuthology.orchestra.run.smithi114.stderr:  kernel-4.18.0-448.el8.x86_64: Cannot download, all mirrors were already tried without success

No correlation between which of the 4 different tests hit the failure, so totally unrelated I think. That means we should be good here in terms of the tests passing.

[adk3798]

LGTM and I'm interested in this devstack project (being able to run tests locally could be very useful). Anything left you want to test before we merge? @zmc

[zmc]

@adk3798 I think it's ready to merge - and I think ceph-devstack is nearly ready for some more exposure - I'll ping you this week to you get started if you're motivated!

[adk3798]

@adk3798 I think it's ready to merge - and I think ceph-devstack is nearly ready for some more exposure - I'll ping you this week to you get started if you're motivated!

awesome, please do