Skip to content

Setting up driver tests to run against previous versions of lua libs through jenkins pipeline#2852

Merged
aleclorimer merged 1 commit intomainfrom
jenkins-backwards-lualibs-integration-testing
Mar 27, 2026
Merged

Setting up driver tests to run against previous versions of lua libs through jenkins pipeline#2852
aleclorimer merged 1 commit intomainfrom
jenkins-backwards-lualibs-integration-testing

Conversation

@aleclorimer
Copy link
Copy Markdown
Contributor

Moving to testing PR commits against current and legacy versions of SmartThingsEdgeDrivers. This change moves away from using Github workflows to run the tests and instead kicks off a set of Jenkins jobs when provided a version and commit. Upon completion of testing, the Jenkins job(s) will report back a passing or failing status to the PR for each version tested against.

@varzac
Copy link
Copy Markdown
Contributor

varzac commented Mar 26, 2026

I think we should keep the run against the latest uploaded artifact in addition to the jenkins version matrix testing. This gives us 1) rich test results directly in PR, and 2) a fallback of test status if the jenkins connection is unavailable for some reason.

@aleclorimer aleclorimer force-pushed the jenkins-backwards-lualibs-integration-testing branch 3 times, most recently from 75ee49a to 1bafd8e Compare March 26, 2026 18:24
@aleclorimer
Copy link
Copy Markdown
Contributor Author

aleclorimer commented Mar 26, 2026

I think we should keep the run against the latest uploaded artifact in addition to the jenkins version matrix testing. This gives us 1) rich test results directly in PR, and 2) a fallback of test status if the jenkins connection is unavailable for some reason.

Done. I added back the latest GH route. Moved the jenkins script to its own file and lastly removed the Artifactory route from GH run-tests.yml because this has not worked in some time and does not sound like a route we will be pursuing going forward.

This flow should be replicated and can be seen in a development/test PR

strategy:
matrix:
version:
[ 60 ]
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What will we expand this to and when can we do that?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Question mainly for @varzac. Chats about maybe going back to 52, but for sure looking to go to 59 at least. Currently working on a script that makes it easier to backport the tagging of tests to earlier versions of lua-libs.

@aleclorimer aleclorimer force-pushed the jenkins-backwards-lualibs-integration-testing branch from 1bafd8e to 905bf50 Compare March 27, 2026 21:21
@aleclorimer aleclorimer merged commit 310e7e0 into main Mar 27, 2026
1 check passed
@aleclorimer aleclorimer deleted the jenkins-backwards-lualibs-integration-testing branch March 27, 2026 21:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants