Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Automated bisection base coverage #260

Closed
6 tasks done
gctucker opened this issue Sep 25, 2023 · 3 comments · Fixed by kernelci/kernelci-backend#302
Closed
6 tasks done

Automated bisection base coverage #260

gctucker opened this issue Sep 25, 2023 · 3 comments · Fixed by kernelci/kernelci-backend#302
Projects

Comments

@gctucker
Copy link
Contributor

gctucker commented Sep 25, 2023

After reducing the costs when moving to the new Azure subscription, automated bisections were disabled in order to keep costs in a safe zone. We've now evaluated the costs of running the dedicated VM for bisections again and have agreed on a way forward by only enabling it on mainline, linux-next, stable and stable-rc trees.

The plan is to have this done for next Monday's production update:

  • Start the dedicated VM again
  • Enable the Jenkins CasC section for the bisection runner
  • Adjust Jenkins job parameters to filter out other trees than the ones listed above
  • Add filter in kernelci-backend to avoid filling the Jenkins queue with jobs that then get cancelled
  • Verify on staging
  • Merge all changes ahead of the production update
@gctucker gctucker added this to To do in Sysadmin via automation Sep 25, 2023
@gctucker gctucker moved this from To do to In progress in Sysadmin Sep 29, 2023
Sysadmin automation moved this from In progress to Done Oct 4, 2023
@gctucker gctucker reopened this Oct 4, 2023
Sysadmin automation moved this from Done to In progress Oct 4, 2023
@gctucker
Copy link
Contributor Author

gctucker commented Oct 6, 2023

@VinceHillier Here's the Jenkins settings section from /etc/kernelci/kernelci-celery.cfg used on staging:

    "jenkins_options": {
        "url": "https://bot.staging.kernelci.org/",
        "user": "bisection",
        "bisect": "lava-bisection",
        "token": "<TOKEN>",
        "bisection-git-trees": ["gtucker"]
    },

Similarly, please add this item in the file used in production before doing the Monday update:

        "bisection-git-trees": ["kernelci", "mainline", "next", "stable", "stable-rc"]

The same list of trees is already configured in the Jenkins env files so that should get applied automatically when restarting Jenkins during the production update.

The bisection Jenkins runner appears to have been enabled again already in nodes.yaml and the matching VM is kernelci-prod-jenkins-runner-1.westus3.cloudapp.azure.com so please just make sure it's up and running before starting the production update.

I think that's all that's needed, we should then start to see bisections for these trees only in the Jenkins queue when regressions get detected. Probably we could artificially create one on the kernelci tree after a day or two if we're not seeing any real ones, at least this has all been tested on staging.

@nuclearcat
Copy link
Collaborator

Dedicated VM enabled, jenkins showing node status online, will check tomorrow if any jobs queued

@gctucker
Copy link
Contributor Author

OK at least one bisection job completed in production about 8h ago:
https://groups.io/g/kernelci-results/message/47247

d6d6c513f5d2d14651336fb4e30f097822b46f29 is the first bad commit
commit d6d6c513f5d2d14651336fb4e30f097822b46f29
Author: Xingyu Wu <xingyu.wu@starfivetech.com>
Date:   Mon Aug 21 22:41:48 2023 +0800

    ASoC: dwc: Use ops to get platform data
    
    Use of_device_get_match_data() to get platform data.
    
    Signed-off-by: Xingyu Wu <xingyu.wu@starfivetech.com>
    Link: https://lore.kernel.org/r/20230821144151.207339-3-xingyu.wu@starfivetech.com
    Signed-off-by: Mark Brown <broonie@kernel.org>

Sysadmin automation moved this from In progress to Done Oct 10, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Development

Successfully merging a pull request may close this issue.

2 participants