apt fails: Bandwidth or Storage Limit Exceeded

[jochenwezel]

Operating System/Distribution

Which distribution of Linux are you using?
Ubuntu 20.04

What happened?

apt update fails with following message:

apt update
Hit:1 http://download.opensuse.org/repositories/isv:/ownCloud:/desktop/Ubuntu_20.04  InRelease
Hit:2 https://download.mono-project.com/repo/ubuntu stable-focal InRelease
Hit:3 https://download.mono-project.com/repo/ubuntu vs-bionic InRelease
Hit:4 http://archive.ubuntu.com/ubuntu focal InRelease
Get:5 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB]
Get:6 http://archive.ubuntu.com/ubuntu focal-security InRelease [109 kB]
Hit:7 https://packages.microsoft.com/ubuntu/20.04/prod focal InRelease
Get:8 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB]
Err:9 https://packagecloud.io/shiftkey/desktop/any any InRelease
  429  Too Many Requests [IP: 192.168.0.1 8000]

Note: Last IP 192.168.0.1 address is my local proxy server.

A manual test call with browser (without proxy) at https://packagecloud.io/shiftkey/desktop/any/dists/any/InRelease also shows error message.

Bandwidth or Storage Limit Exceeded

[Saladin1812]

@jochenwezel The storage limit was reached not just for ubuntu but the whole package cloud repo, as I already have the repo installed and unable to update with same error on Fedora, Shiftkey will have to exceed the bandwidth or shift the repo to OBS or other alternatives, I recommend installing from github releases until then. Personally I am currently just disabling the repo (not removing it) and re enable once its recharged.

[shiftkey]

#310

Yep, I've had another month where the bandwidth limit on Packagecloud (165GB) is reached early, so the account gets suspended.

It's costing me USD $150 per month to cover and I've asked for support with covering these costs from the community so until that's covered I'm not keen to extend myself further.

The billing cycle resets around the 22nd of the month, and the manual install from the Releases page is still available.

[Soneji]

Is there any way to use GitHub packages or pages to host this, instead of a 3rd party? I am happy to help with this. Or maybe it would be cheaper to setup a VPS?

[ShadrackKimutai]

encountering the same problem... switching to manual install

[jochenwezel]

Maybe I haven't understood completely: is it a problem of

• storage limit
• or bandwith in meaning of "traffic volume" (TB/month)
• or bandwith in meaning of "bandwith" (MB/second)

[jochenwezel]

And what is the current limit line and how much would be required?

[jochenwezel]

Are there chances to use alternative solutions, like @Soneji suggested exemplarily?

[Soneji]

Maybe I haven't understood completely: is it a problem of

• storage limit

• or bandwith in meaning of "traffic volume" (TB/month)

• or bandwith in meaning of "bandwith" (MB/second)

I think it is 160gb per month

[jochenwezel]

I think it is 160gb per month

The current limit or the required traffic volume?

[Soneji]

The current limit, I believe the required traffic volume was estimated at ~100GB of bandwidth each month at some point in the past (see here)

I think if @shiftkey would like, we should find a solution with unlimited bandwidth, as this package is amazing and I can't expect it to ever stop growing in popularity

[shiftkey]

Is there any way to use GitHub packages or pages to host this, instead of a 3rd party?

Not really. This was my "must-have" list of requirements from elsewhere:

• hosted infrastructure
• accepts .deb directly
• handles GPG signing natively
• also supports RPM hosting

I started looking at OBS but it seems that requires build scripts to be hosted by them, based on this comment #363 (comment)

You have to upload your deb build script rules files etc... to them. Then their system will build the packages and publish.

Unless someone has done this with an Electron app that I can get inspiration from, this won't work with how I'm doing building and packaging currently...

I've thought about reaching out to PackageCloud to see if they'll sponsor this (the pricing page mentions open source projects) but I feel this is a murky area, it's based off a GitHub OSS project. And I do want to support them monetarily because it's been a huge timesaver for me.

[jochenwezel]

I've thought about reaching out to PackageCloud to see if they'll sponsor this

that would be really cool, since your project IS an open-source project :-)

And I do want to support them monetarily

this I don't understand

because it's been a huge timesaver for me.

this I do understand

But in summary,

• your project is open-source
• you could get the support from PackageCloud for free
  • so, you don't have to collect money a huge amount from the community to support/spend that money to PackageCloud
  • so, you should use that free offer (if there is no disadvantage), don't you?

[jochenwezel]

Not really. This was my "must-have" list of requirements from elsewhere:

• hosted infrastructure
• accepts .deb directly
• handles GPG signing natively
• also supports RPM hosting

Well, I don't know what needs to be done if you could run your own root server. I use vcloud root servers with approx. 5 TB/month bandwidth for 8 EUR (approx. 10 USD) per month. So it seems, there is lot of saving potential in comparison to 160 USD/month (if this money is really required)

[Soneji]

I've thought about reaching out to PackageCloud to see if they'll sponsor this (the pricing page mentions open source projects) but I feel this is a murky area, it's based off a GitHub OSS project. And I do want to support them monetarily because it's been a huge timesaver for me.

I think the best solution is to reach out to PackageCloud – a lot of hosting/build companies offer free options for open source. And it looks as easy as emailing support@packagecloud.io. You can just send a link to the repo and this issue. I think this project definitely deserves the free hosting.

[tmiland]

How about Hosting your own PPA repository on GitHub 🤔