Skip to content

pytest evaluation#2717

Open
alekseyborisyukvalidas wants to merge 6 commits intoeclipse-score:mainfrom
alekseyborisyukvalidas:albor_pytest_evaluation
Open

pytest evaluation#2717
alekseyborisyukvalidas wants to merge 6 commits intoeclipse-score:mainfrom
alekseyborisyukvalidas:albor_pytest_evaluation

Conversation

@alekseyborisyukvalidas
Copy link
Copy Markdown
Contributor

@alekseyborisyukvalidas alekseyborisyukvalidas commented Mar 25, 2026

Added tool evaluation for pytest
1 use case: Run tests and generate test report
added safety measures where availbale

@github-actions
Copy link
Copy Markdown

⚠️ Docs-as-Code version mismatch detected
Please check the CI build logs for details and align the documentation version with the Bazel dependency.

@alekseyborisyukvalidas alekseyborisyukvalidas changed the title Albor pytest evaluation FuSa pytest evaluation Mar 25, 2026
@alekseyborisyukvalidas alekseyborisyukvalidas changed the title FuSa pytest evaluation pytest evaluation Mar 25, 2026
@alekseyborisyukvalidas alekseyborisyukvalidas marked this pull request as ready for review April 22, 2026 12:09
@alekseyborisyukvalidas alekseyborisyukvalidas requested a review from a team as a code owner April 22, 2026 12:09
@MaximilianSoerenPollak
Copy link
Copy Markdown
Contributor

We are also using pytest (but also other test frameworks) to facilitate the traceability to tests.
I'm unsure if this has / should play into here.

@alekseyborisyukvalidas
Copy link
Copy Markdown
Contributor Author

alekseyborisyukvalidas commented Apr 22, 2026

We are also using pytest (but also other test frameworks) to facilitate the traceability to tests. I'm unsure if this has / should play into here.

@MaximilianSoerenPollak, if you could give me the list of these frameworks and where/how they used, i can extend the existing tool list

| Pytest fails to load provided file even if file is present and accessible.
- yes
- (implicit) Check test run status
- yes
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

does this say "yes" to there is an impact on detection or there is a detection? Where can I find the detection? Is "Check test run status" the entire detection description? Unfortunately, I have no idea what that means

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This "yes" is to "Impact safety detection sufficient?"

@alekseyborisyukvalidas
Copy link
Copy Markdown
Contributor Author

Pytest is only part of ITF and not supposed to used independently according to: https://eclipse-score.github.io/score/main/platform_management_plan/software_verification.html

@MaximilianSoerenPollak
Copy link
Copy Markdown
Contributor

MaximilianSoerenPollak commented Apr 23, 2026

Pytest is only part of ITF and not supposed to used independently according to: https://eclipse-score.github.io/score/main/platform_management_plan/software_verification.html

Many repositories use it themselfs see here:

https://github.com/eclipse-score/docs-as-code/blob/main/src/extensions/score_source_code_linker/tests/
https://github.com/eclipse-score/persistency/tree/main/tests/test_cases/tests

Etc.

So if this is truly the case, then these all need to be updated & changed.
I was not aware of such restriction.

@AlexanderLanin does this ring a bell for you?
Not sure who else to tag / ask here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Status: Backlog

Development

Successfully merging this pull request may close these issues.

3 participants