Gitea consumes excessive CPU and RAM when mirror tokens expire

[crazyuploader]

Description

My Gitea instance, running in Docker, experienced excessive CPU and RAM usage (CPU maxed out, ~12 GB RAM) when several mirrored repositories failed to sync due to expired GitLab tokens. Instead of failing gracefully, Gitea repeatedly attempted to sync these mirrors, leading to resource exhaustion.

Gitea Version

1.24.2

Can you reproduce the bug on the Gitea demo site?

No

Log Gist

No response

Screenshots

After putting the updated tokens, and restarting the container seems to solve the problem as can be seen below -

Git Version

2.49.0

Operating System

Ubuntu 22.04.5 LTS

How are you running Gitea?

Using official Gitea Docker Images, and running it in a Docker Container.

Database

SQLite

[crazyuploader]

I can attach goroutine diagnosis zip file, if that helps :)

[lunny]

Please post the gorountine diagnosis zip file.
And if possible, please enable performance tracing and share the trace files with us for further analysis.

[crazyuploader]

Please post the gorountine diagnosis zip file. And if possible, please enable performance tracing and share the trace files with us for further analysis.

The goroutine diagnosis file is given below, it's when I was checking site administration settings in Gitea, when I stumbled upon goroutines page, and there were a lot of goroutines, so quickly downloaded the diagnosis file.

gitea-diagnosis-20250629-202224.zip

[lunny]

Based on your diagnostic file, the high CPU and memory usage appears to be caused by the Git compare/diff page. This is a known issue when comparing large commits or repositories with significant changes.

If the repositories involved are public, could you please share them with us? That would help us further investigate and potentially reproduce the issue.

[wxiaoguang]

Are you running a public instance? If yes, there might be crawlers. If you'd like to block the crawlers, you can try this: Add a config option to block "expensive" pages for anonymous users #34024 , you can also fine tune the block rules and build your own binary.

[crazyuploader]

Based on your diagnostic file, the high CPU and memory usage appears to be caused by the Git compare/diff page. This is a known issue when comparing large commits or repositories with significant changes.

If the repositories involved are public, could you please share them with us? That would help us further investigate and potentially reproduce the issue.

I am seeing a lot of repeated log entries for the following public repositories -

• https://github.com/YouROK/TorrServer
• https://github.com/Viren070/AIOStreams
• https://github.com/mhdzumair/mediaflow-proxy

But it looks like I might be suffering from the fact that the instance is public; crawlers are doing their thing and messing things.

[crazyuploader]

Are you running a public instance? If yes, there might be crawlers. If you'd like to block the crawlers, you can try this: Add a config option to block "expensive" pages for anonymous users #34024 , you can also fine tune the block rules and build your own binary.

Yes, I am running a public instance. Thanks for this angle, checked and seeing a lot of Meta, Azure IPs in logs, let me try the config that you have mentioned. But damn these crawlers, hitting where it hurts the most, compare pages, and that too, comparing old tags to the newest one, and tons of significant changes as that!

gitea_instance.log