-
Notifications
You must be signed in to change notification settings - Fork 150
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
plugin sometimes stops uploading #56
Comments
Can you double check if its related to #55 |
I have time_file set to 1 minute. |
I am seeing the same behavior, happens with both time_file and size_file. I have tried each individually and also together (small file size and longer time) just to see if the size didn't catch it the time one would, but still having the issue |
So it looks like the problem is with how you are setting up the worker threads. They don't stay alive after they process an upload. I tested this by setting the number of upload workers, and every time I get that number of files and then things start queuing on disk. logstash 2.1.1 |
We seam to have the exact problem reported by zot420. Is there any advice here? At least a work around? Thanks! |
Is this issue resolved ?? |
Unfortunately i have no idea about the bug and it's resolution. However a quick work around for me was to restart logstash in case the folder start filling up more than expected. I have nothing to share as we are currently migrating to another solution, therefor did no automation script (aside from standard disk monitoring) to manage that. Hope this help at least a little. |
My team is also running into this bug consistently. I don't think it is related to workers though - we have multiple identical machines, but one of them stopped uploading at 998 files, and the other one is at 1400 files but is still working correctly. My guess is that the S3 connection returns some sort of unexpected error, and the plugin doesn't handle it correctly. It must be the S3 upload part - the file rotation still works as expected, just that the file doesn't get uploaded. Restarting logstash does work, but is obviously not a good solution. We will likely look into alternatives until this is fixed. |
I am testing logstash under docker with this plugin under localstack. Here is my output config file:
|
Hi,
We have a recurring bug that is happening for a while now.
Every once in a while the plugin just stops uploading the files to S3.
The files are still saved to disk, but the disks just keeps getting filled with the uploader not doing anything..
Any ideas what it can be or how i can debug it? There are no warnings/error in the log file
The text was updated successfully, but these errors were encountered: