Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Github workflow fails as it exhaust all available CPU even if I upgraded on Github Enterprise #10244

Closed
2 of 13 tasks
ggkiokas opened this issue Jul 17, 2024 · 9 comments
Closed
2 of 13 tasks

Comments

@ggkiokas
Copy link

Description

Github workflow fails as it exhausts all available CPU even I upgraded on Github Enterprise.
Please I need assistance for understanding how I can have larger runners

Platforms affected

  • Azure DevOps
  • GitHub Actions - Standard Runners
  • GitHub Actions - Larger Runners

Runner images affected

  • Ubuntu 20.04
  • Ubuntu 22.04
  • Ubuntu 24.04
  • macOS 12
  • macOS 13
  • macOS 13 Arm64
  • macOS 14
  • macOS 14 Arm64
  • Windows Server 2019
  • Windows Server 2022

Image version and build link

https://github.com/Seafair/poseidon/actions/runs/9975020032/job/27563828236

Is it regression?

yes

Expected behavior

Workflow should run without problems

Actual behavior

Workflow fails with an error

Repro steps

Please see the logs of this workflow:
https://github.com/Seafair/poseidon/actions/runs/9975020032/job/27563828236

@Prabhatkumar59
Copy link

Hi @ggkiokas - Thank you for bringing this issue to us. We are looking into this issue and will update you shortly on this issue after investigating.

@ggkiokas
Copy link
Author

Thank you @Prabhatkumar59 ! Please lmk how I can switch to larger runners. I thought by default Github Enterprise plan includes them

@Prabhatkumar59
Copy link

Prabhatkumar59 commented Jul 18, 2024

@ggkiokas - Thanks for your response:)
In order to switch to larger runners on GitHub Actions, especially when you're facing CPU and disk space limitations, you need to make some configurations. GitHub Enterprise does offer options for larger runners, but you need to explicitly configure your workflows to use them. Below are the detailed steps and options for using larger runners. You can trying using below steps:-

Check Available Runner Sizes:
You can verify the available runner sizes in your GitHub Enterprise setup. This information is typically available in your GitHub Enterprise documentation (https://docs.github.com/en/enterprise-server@3.13)

Specify Larger Runners in Workflow:
You can also update your GitHub Actions workflow configuration to specify a larger runner.

To make it easier for you, i am providing an example how to specify a larger runner in your workflow configuration:-

name: CI

on: [push, pull_request]

jobs:
  build:
    runs-on: [self-hosted, large]

    steps:
    - name: Checkout
      uses: actions/checkout@v2
    - name: Build
      run: |
        echo "Building the project..."
    - name: Test
      run: |
        echo "Running tests..."


Using Self-Hosted Runners
If GitHub-hosted runners are not sufficient, you can use self-hosted runners, which can be configured with more powerful hardware.

A. Set Up Self-Hosted Runners:

Follow the GitHub documentation to set up self-hosted runners: Self-hosted runners.

B. Specify Self-Hosted Runner in Workflow:

Use the runs-on keyword to specify the self-hosted runner.

name: CI

on: [push, pull_request]

jobs:
  build:
    runs-on: self-hosted

    steps:
    - name:

So by using above steps, you can utilize larger runners to ensure your workflows run smoothly without exhausting available CPU or disk space.

@ggkiokas
Copy link
Author

Hello @Prabhatkumar59 , thank you so much for your prompt response.

  1. We use gh-actions-hosted runners as Seafair org.

  2. Here in this actions page of my repo I see an available option, of a larger runner but neither me nor the admin of Seafair org can click on it. Do you know how I could do that ? Does this runner comes for free with Github Enterprise plan ?

  3. After having read carefully the documentation for large runners here, it is still not clear to me how I can find labels related with each runner. So I can use them after on my workflow
    e.g
    For CPU: 8GB | RAM: 32GB -> runs-on: ubuntu-22.04-large
    For CPU: 32GB | RAM: 128GB -> runs-on: ubuntu-22.04-x-large

Thanks a lot, I really appreciate your help since I am kinda lost here.
Giorgos

@Prabhatkumar59
Copy link

Prabhatkumar59 commented Jul 19, 2024

Hi @ggkiokas- Thanks for responding
To address your concerns regarding the use of larger GitHub Actions runners within the Seafair organisation, here are some steps and clarifications:-

Availability and Cost:-

Larger runners are typically available for GitHub Enterprise customers, but they may not be enabled by default. You can check with GitHub support to confirm whether your plan includes access to larger runners and any associated costs.
Configuring Larger Runners:-

If larger runners are available in your plan, you need to configure them properly in your workflow. The inability to click on the option might be due to permissions or the need for additional setup.

You can also follow below Steps to enable and Use Larger Runners:-

Contact GitHub Support:

You can reach out to GitHub support to ensure that larger runners are enabled for your GitHub Enterprise plan and to clarify any additional steps required. https://docs.github.com/en/actions/using-github-hosted-runners/about-github-hosted-runners

Assign Labels to Runners:
During the setup, assign custom labels to your runners to identify them easily in your workflows.

Example command to configure a self-hosted runner with a custom label
./config.sh --url https://github.com/your-org/your-repo --token YOUR_TOKEN --labels ubuntu-22.04-large

GitHub uses labels to identify and assign runners. The labels for larger runners can vary, so confirming the correct labels with GitHub support or your organization’s admin is crucial.

@ggkiokas
Copy link
Author

ggkiokas commented Jul 19, 2024 via email

@ggkiokas
Copy link
Author

Hello @Prabhatkumar59 ,
Thanks for your answer. Sorry for my previous email but I tried to forward some info on enterprise-support@github.com
but without success.
Can you please indicate me a way of communicating with gh-support. An email or a url where I can create a ticket ?

@Prabhatkumar59
Copy link

Prabhatkumar59 commented Jul 20, 2024

Hi @ggkiokas- The link you shared above(https://github.com/Seafair/poseidon/actions/runners), I do not have access of this actually. So, unable to check.

And in order to contact GitHub Support, you can try using the following methods:-

Contact GitHub Support
A. GitHub Support Website:

Visit the GitHub Support page: GitHub Support
Choose the relevant option based on your issue (e.g., "Contact Enterprise Support" if you are an Enterprise customer).
Fill in the required details and submit your request.
B. GitHub Enterprise Support:

If you are a GitHub Enterprise customer, you can directly access support through the GitHub Enterprise Support portal.
Visit: GitHub Enterprise Support

C. Email Support:

You can also email GitHub Support at enterprise-support@github.com if you are using GitHub Enterprise.

For you, I am adding an example as well of an Email to GitHub Support:-

To: enterprise-support@github.com
Subject: Assistance Required for Configuring Larger Runners on GitHub Enterprise

Dear GitHub Support Team,

I am writing to seek assistance with configuring larger runners for our workflows in the Seafair organization on GitHub Enterprise. Despite having access to an option for larger runners, neither I nor the admin can enable or click on this option.

Could you please provide guidance on how we can enable and utilize larger runners for our workflows? Specifically, we need information on the correct labels for these runners and any additional steps required to configure them.

Here is a link to our actions page: [GitHub Actions Page](https://github.com/Seafair/poseidon/actions/runners).

Thank you for your assistance.

Best regards,

For Submitting a Ticket via GitHub Support Website:-

A. Visit the Support Page: GitHub Support
B. Select the Relevant Option:
For GitHub Enterprise: Choose "Contact Enterprise Support."
For general support: Choose the appropriate option based on your issue.
C. Fill in the Form:
You can provide detailed information about your issue.
Attach any relevant screenshots or links.
D. Then submit your Request.

Following these steps should help you get in touch with GitHub Support and resolve your issue with configuring larger runners. If you have any other questions or need further assistance, feel free to ask!..thanks:)

@ggkiokas
Copy link
Author

Thanks a lot @Prabhatkumar59 for your assistance.
I emailed enterprise-support@github.com letting them know about my issue.
Best regards,
Giorgos

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants