Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error 500 in build worker API when artifacts storage size limit reached #2005

Open
IlyaFinkelshteyn opened this issue Jan 2, 2018 · 24 comments

Comments

@IlyaFinkelshteyn
Copy link
Contributor

No description provided.

@IlyaFinkelshteyn IlyaFinkelshteyn self-assigned this Jan 2, 2018
@IlyaFinkelshteyn IlyaFinkelshteyn changed the title Error 500 in artifacts build worker API when limit reached Error 500 in build worker API when artifacts storage size limit reached Jan 5, 2018
@austinv900
Copy link

Any update for this?

@IlyaFinkelshteyn
Copy link
Contributor Author

Will try to fix it in next milestone. @austinv900 do you have account with this issue right now? Lest us know, we will unblock you by increasing the artifacts storage size limit.

@austinv900
Copy link

Yes I do. @IlyaFinkelshteyn What do you need from me?

@IlyaFinkelshteyn
Copy link
Contributor Author

@austinv900 Link to failed build or just account name (part after project in URL).

@austinv900
Copy link

@IlyaFinkelshteyn
Copy link
Contributor Author

Should be good now. Side question -- why you use GitHub repository as a generic Git? You are loosing a lot of nice features implemented by us using GitHub API...

@austinv900
Copy link

still kinda playing around with features. Been working with a dotnet core helper application for appveyor

@nyanhp
Copy link

nyanhp commented Mar 27, 2018

Hi @IlyaFinkelshteyn , I think I have a related issue with https://ci.appveyor.com/project/AutomatedLab/automatedlab, which recently stopped pushing artifacts and the exception looks pretty much the same. We are using the PowerShell cmdlet Push-AppVeyorArtifact and it fails with code 500 as well. At the moment, this does not fail our build, but it might be that way in the future.
If necessary, I can open up another issue, but to me they seem related. If you guys need additional info, let me know.

@IlyaFinkelshteyn
Copy link
Contributor Author

@nyanhp we just bumped your artifact storage limit so you should be good now. Sorry for the trouble.

@nyanhp
Copy link

nyanhp commented Mar 28, 2018

Cool, thanks. Am I correct in assuming that there is no retention I can set yet to e.g. only have the artifacts of the last three builds?

@IlyaFinkelshteyn
Copy link
Contributor Author

There are still not retention (it is coming), but we will increase your limit again if you hit it again. We were needed to add that limits to get some control over artifact storage and prevent obvious abuse, but we are OK to increase it for customers who need it.

@pcercuei
Copy link

We seem to get the same error here: https://ci.appveyor.com/project/pioneerspacesim/pioneer

The build succeeds but the artifact upload fails with (500) internal server error. I assume we're also hitting the artifact storage limit.

Upping the limit only delays the problem, is there a way to nuke all the artifacts older than a certain date?
Have it done automatically maybe? (e.g. nuke all the artifacts older than 10 days).

@IlyaFinkelshteyn
Copy link
Contributor Author

@pcercuei Upping the limit is OK solution, because retention policy will start catch up with your artifact collection speed. We increased the limit for you, please do not hesitate to ping us again.

@pcercuei
Copy link

It works now. Thanks!

@pcercuei
Copy link

@IlyaFinkelshteyn, looks like we're hitting the limit again :(

@fluffyfreak
Copy link

@IlyaFinkelshteyn
Is there no way to remove old artifacts?
Or to configure how long they should be stored for?

We really only need them for the build itself, and maybe half a day afterwards, not the 6 months it's set too.

I tried cleaning out old builds but new builds are still failing and holding up a new deployment for us.

@FeodorFitsner
Copy link
Member

@pcercuei it's been extended. Should be OK now.

@fluffyfreak what's your account name?

@fluffyfreak
Copy link

@FeodorFitsner it's ok, @pcercuei and I are on the same project.

Are there plans to allow us to delete old artifacts, or adjust the retention period?

@FeodorFitsner
Copy link
Member

Sure, we are working on that.

@pcercuei
Copy link

We face the same problem once again :(
How much space do we use right now?

@fluffyfreak
Copy link

@FeodorFitsner we're facing this problem again, has there been any work/progress on allowing us to delete artefacts?

How do other teams handle this because we can't be the only team facing these issues?

@FeodorFitsner
Copy link
Member

@fluffyfreak what's your AppVeyor account?

@fluffyfreak
Copy link

@FeodorFitsner https://ci.appveyor.com/project/pioneerspacesim/pioneer is where we're having the problem

@impaktor
Copy link

impaktor commented Apr 5, 2020

@FeodorFitsner hi! we (pioneerspacesim & @fluffyfreak above) still have failed build on all pull requests, it would be great if you could delete our old artefacts so it will work again, thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

7 participants