-
-
Notifications
You must be signed in to change notification settings - Fork 4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Addon manager causes temporary ban from github (ratelimit) #15059
Comments
I cannot reproduce on Windows |
I can reproduce, banned two times today 😅 |
With git enabled (
|
Ok now I tried it via mobile data and at least GH does not ban me, but Edit: |
My wired connection ISP is Vodafone CZ and they are using CGNAT with DSlite (default). So my public IPv4 is shared with others and that could explain rate limit issue (even though I did not notice it anywhere else than with FreeCAD). @kadet1090 could you share some details about your connectivity? |
@diggit are you self-compiling? If so, the latest main should have fixed the "getting stuck at OSH" issue on Qt6 -- it may also fix the temp-ban problem, I'm not 100% sure which rate-limiter is being tripped. None of this has anything at all to do with the "use zip download" setting -- we're not using git (the app) to access this data, we're using GitHub (the website) to pull down one specific file. |
Hard to say if I'm behind ISP NAT - my ISP is Orange PL. However I'm also using arch and get basically same results - after opening addon manager I can't access github anymore. I doub that this is API rate limiting - more like some firewall on some part of the network triggers and cuts of all traffic from my IP as I also cant access github via SSH. So either GitHub changed their firewalls and they are blocking traffic from IPs making rapid requests or there is another firewall that we have in common that is doing exactly that. Nontheless - tried again and cannot reproduce now, maybe github were under DDoS attack and had enabled more strict firewall rules. Edit: Managed to get banned, it appears that I get cut out at this node as it is first missing from my traceroute after ban:
|
I also got flooded with the killTimer msg today, playing with FEM and maybe accessing examples. Everything seemed to work fine though, except for me.
|
This issue is still present, using an AUR build. If I download the latest appimage, everything works fine.
|
Is that a clean rebuild? In particular, I want to ensure that the Addon Manager's Python files got copied correctly. Current MD5sum of NetworkManager.py should be 6898c9fe2ad4ea03135d375591435565. |
hmmm, looks like the checksum here is : 2a165bb8303af497941997d4c5c8ca3d I'll try and force it on my install. |
@chennes the MD5 I posted in above comment matches the latest file after downloading it directly from the repo using my browser. |
OK, thanks. Then the rate limit issue was not related to the redirect issue (which is the one I fixed last week). It's odd to me that the rate limiter would affect different platforms differently, but perhaps we are just skating on the edge of it, and some platforms are slightly faster than others. I'll try to code up something to detect it. |
This is really probably a deeper issue: it's not a great idea for every copy of FreeCAD to do this scrape every time. I was planning on doing the cache server-side post-1.0, but it appears that I am going to have to do it now. |
Reduce the number of GitHub fetches when rebuilding the local addon cache by using a remote cache stored on FreeCAD's servers. Intended to mitigate the Addon Manager hitting GitHub's rate limiters. Addresses, but does not fully close, FreeCAD#15059
Reduce the number of GitHub fetches when rebuilding the local addon cache by using a remote cache stored on FreeCAD's servers. Intended to mitigate the Addon Manager hitting GitHub's rate limiters. Addresses, but does not fully close, FreeCAD#15059
Reduce the number of GitHub fetches when rebuilding the local addon cache by using a remote cache stored on FreeCAD's servers. Intended to mitigate the Addon Manager hitting GitHub's rate limiters. Addresses, but does not fully close, #15059
Reduce the number of GitHub fetches when rebuilding the local addon cache by using a remote cache stored on FreeCAD's servers. Intended to mitigate the Addon Manager hitting GitHub's rate limiters. Addresses, but does not fully close, FreeCAD#15059
Although I'd still like to make this process more efficient, I believe the issue with hitting GitHub's rate limiter has been resolved. I'm closing this and essentially converting it to a feature request. |
Reduce the number of GitHub fetches when rebuilding the local addon cache by using a remote cache stored on FreeCAD's servers. Intended to mitigate the Addon Manager hitting GitHub's rate limiters. Addresses, but does not fully close, FreeCAD#15059
Is there an existing issue for this?
Problem description
When I open
Addon manager
, it gets stuck and after that github is not reachable from my machine for several minutes. No response to ping. I am seeing terminal being flooded withMy suspicion is that
Addon manager
somehow causes some rate limit being breached and thus github bans my IP of several minutes.Tested with
Disable git
checkbox ticked, so it should be only about zip download.Full version info
OS: Arch Linux Word size of FreeCAD: 64-bit Version: 0.22.0dev.37923 (Git) Build type: Release Branch: main Hash: 3b304e5b1a62f3119d7311aeb736dcb53cb4faad Python 3.12.4, Qt 6.7.2, Coin 4.0.2, Vtk 9.3.0, OCC 7.7.2 Locale: C/Default (C) Installed mods: * SheetMetal 0.4.18
Subproject(s) affected?
None
Anything else?
network capture (filtered with
ip.src == 140.82.121.3 || ip.dst== 140.82.121.3
) fc_addon_manager_github.pcapng.gzRunning on up to date Archlinux, walynad, sway.
Sheet metal WB was manually cloned and was not obtained via Addon Manager due to this issue.
stdout log
Code of Conduct
The text was updated successfully, but these errors were encountered: