GitHub API rate limit exceeded

[rvalitov]

Description

Hello!
It seems that GitHub does not like one of my IPs. I struggle a few days to make it work, I always get error Failed to get latest version. Manual curl request response:

curl -s https://api.github.com/repos/henrygd/beszel/releases/latest
{"message":"API rate limit exceeded for x.x.x.x. (But here's the good news: Authenticated requests get a higher rate limit. Check out the documentation for more details.)","documentation_url":"https://docs.github.com/rest/overview/resources-in-the-rest-api#rate-limiting"}

It would be great if such issue would be documented in the Troubleshooting section of the README with some advice or workarounds.

OS / Architecture

amd64

Beszel version

0.12.6

Installation method

Binary

Configuration

No response

Hub Logs

No response

Agent Logs

No response

[henrygd]

Is this preventing the update command from working?

We have a mirror option for Chinese users which uses our gh.beszel.dev mirror, so you can try beszel-agent update --china-mirrors.

Or hit directly:

curl "https://gh.beszel.dev/repos/henrygd/beszel/releases/latest?api=true"

[henrygd]

Also note that --china-mirrors was added in 0.12.6 so older versions do not have it.

[rvalitov]

Thank you! I have already tried the --china-mirrors option when I first faced this issue. However, it also failed with Failed to get latest version error message. Unfortunately, I can't now make a new clean test and try curl with https://gh.beszel.dev, because now I don't receive rate limiting errors from GitHub for my IP. So now all curl requests work good. I will try to make tests in the upcoming days, perhaps, I can catch this situation again.

[alexdelprete]

We have a mirror option for Chinese users which uses our gh.beszel.dev mirror, so you can try beszel-agent update --china-mirrors.

my beszel agents were not updating, because of GH rate limits. So I decided to try your workaround but I have an error installing the latest version:

curl -sL https://get.beszel.dev -o /tmp/install-agent.sh && chmod +x /tmp/install-agent.sh && /tmp/install-agent.sh -p 45876 -k "ssh-ed25519 MYPUBKEY" -t "MYTOKEN" -url "https://beszel.mydomain.net" --china-mirrors --auto-update true

Confirm use of GitHub mirror (https://gh.beszel.dev) for downloading beszel-agent?
This helps to install properly in mainland China. (Y/n): y
Using GitHub Mirror (https://gh.beszel.dev) for downloads...
Creating a dedicated user for the Beszel Agent service...
docker:x:998:beszel
Adding beszel to docker group
Downloading and installing the agent...
Failed to get latest version

If I run the command with the -v options I see this as output:

/tmp/install-agent.sh: 345: shift: can't shift that many

After many tries, it managed to install it:

Confirm use of GitHub mirror (https://gh.beszel.dev) for downloading beszel-agent?
This helps to install properly in mainland China. (Y/n): y
Using GitHub Mirror (https://gh.beszel.dev) for downloads...
Creating a dedicated user for the Beszel Agent service...
docker:x:998:beszel
Adding beszel to docker group
Downloading and installing the agent...
Downloading and installing agent version 0.12.12 from https://gh.beszel.dev ...
###################################################################################################################################################################################################################################### 100.0%
Creating the systemd service for the agent...

Loading and starting the agent service...
Created symlink '/etc/systemd/system/multi-user.target.wants/beszel-agent.service' → '/etc/systemd/system/beszel-agent.service'.
Setting up daily automatic updates for beszel-agent...
Created symlink '/etc/systemd/system/timers.target.wants/beszel-agent-update.timer' → '/etc/systemd/system/beszel-agent-update.timer'.

Daily updates have been enabled.

Beszel Agent has been installed successfully! It is now running on 45876.

But the process isn't smooth. Also, the confirmation question is preventing to do an unattended install. If I specify the option --china-mirrors (btw: it's not just for China, It's an option that uses a mirror, I'd call it --repo-mirror or something like that) it shouldn't ask for confirmation, since it was explicitly specified.

I looked at the script, and it's using GH API to get the latest version number. So I guess we're hitting rate limits. Instead of doing that, the script could download latest version directly, which is available in the assets without the version in the filename: https://github.com/henrygd/beszel/releases/latest/download/beszel-agent_linux_amd64.tar.gz

The only problem would be the checksum file, that has the version in the filename: https://github.com/henrygd/beszel/releases/download/v0.12.12/beszel_0.12.12_checksums.txt

but IS available in "latest" url format:
https://github.com/henrygd/beszel/releases/latest/download/beszel_0.12.12_checksums.txt

So if it was simply renamed or available in the assets also as beszel_checksums.txt, you wouldn't need to hit the GH API in the script:
https://github.com/henrygd/beszel/releases/latest/download/beszel_checksums.txt