Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CI: Add support to run external programs necessary for a test #27956

Closed
ceolin opened this issue Sep 2, 2020 · 4 comments · Fixed by #57117
Closed

CI: Add support to run external programs necessary for a test #27956

ceolin opened this issue Sep 2, 2020 · 4 comments · Fixed by #57117
Assignees
Labels
area: Test Framework Issues related not to a particular test, but to the framework instead Enhancement Changes/Updates/Additions to existing features

Comments

@ceolin
Copy link
Member

ceolin commented Sep 2, 2020

Is your feature request related to a problem? Please describe.

In order to test gdbstub implementation is necessary to run the test itself and another process with gdb to attach the test. Currently there is no such way to do this in Zephyr's CI. Although this is describing the need for testing gdbstub there are possible several other cases where this can be helpful like, for example, an application that tests the network stack send unusual or malformed tailored packet to check corner cases.

Describe the solution you'd like
Allow an application run together with a test. Basically the idea is to be able to start an app A together with Zephyr, let them execute and than test the results.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
#27314

@ceolin ceolin assigned nashif and galak and unassigned nashif and galak Sep 2, 2020
@ceolin ceolin added the area: Test Framework Issues related not to a particular test, but to the framework instead label Sep 2, 2020
@nashif
Copy link
Member

nashif commented Sep 2, 2020

@jocelyn-li FYI

@nashif nashif added the Enhancement Changes/Updates/Additions to existing features label Sep 2, 2020
@nashif
Copy link
Member

nashif commented Mar 15, 2022

you can do this with pytest I guess.

samples/subsys/testsuite/pytest

@ceolin ceolin self-assigned this Apr 9, 2022
@PerMac PerMac mentioned this issue May 10, 2023
5 tasks
@PerMac
Copy link
Member

PerMac commented May 10, 2023

I linked #57117 as a fix since it basically fulfils the request from the title.

@PerMac
Copy link
Member

PerMac commented May 10, 2023

e.g. we already are working on using mcumgr during pytest tests. Other prototype I saw at work with our tools was end2end tests for llwm2m, where a dut (can be qemu/hw/etc) runs client app and in addition a virtual server is run in the test. Test is verifying if the commands sent to the client are correctly addressed by the server.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area: Test Framework Issues related not to a particular test, but to the framework instead Enhancement Changes/Updates/Additions to existing features
Projects
Development

Successfully merging a pull request may close this issue.

4 participants