Add self hosted GitHub runners

[ReenigneArcher]

Is there an existing issue for this item?

• I have searched the existing issues

Repositories

No response

Languages/Skills/Technologies

Bash/Shell/Scripting

Description

Adding self hosted GitHub runners could allow us to unit test with actual GPUs passed through to the runner container/VM.

Idea is to create VM templates in Proxmox, then write a small application to listen for webhooks from GitHub that will create the VM on demand, and tear it down when the job is finished.

This will require a new server as my current Proxmox host is already consuming all GPU slots for other purposes.

Estimated Effort

effort:Extra-Large

Priority

priority:Low

Target Milestone

6+ months

Dependencies

No response

[ReenigneArcher]

An old note I made:

Docker runners

• https://www.youtube.com/watch?v=d3isYUrPN7s
• https://github.com/marcel-dempers/docker-development-youtube-series/tree/master/github/actions/self-hosted-runner

Ideal solution... auto-scale Proxmox VMs.

• Application/Docker-image that receives webhooks from github... example (https://github.com/carlos-jenkins/python-github-webhooks/blob/master/webhooks.py)
• Get queued events from webhook
• Get requested job labels from webhook
• Map the labels to a Proxmox template (in config?)
• If labels in mapping, start up a VM based on mapped template
• Use ephemeral mode: https://docs.github.com/en/actions/hosting-your-own-runners/managing-self-hosted-runners/autoscaling-with-self-hosted-runners#using-ephemeral-runners-for-autoscaling
• Need to know when job on that VM finishes? So it can be deleted...