Join GitHub today
GitHub is home to over 36 million developers working together to host and review code, manage projects, and build software together.Sign up
compressed dynafile output corruption #933
I have the template
and the action:
action(type="omfile" template="json" dynafile="perserverjson" dynafilecachesize="1200" ziplevel="9" flushinterval="60" name="perserverjson" ioBufferSize="512k" )
but if I go into this directory and try to access the zip files, I get errors.
zgrep -c ' ' _.17_json.gz
gzip: las1prsvc001.20160330.17-00.json.gz: invalid compressed data--format violated
gzip: las1prsvc001.20160330.17-01.json.gz: invalid compressed data--format violated
gzip: las1prsvc001.20160330.17-02.json.gz: invalid compressed data--format violated
gzip: las1prsvc001.20160330.17-03.json.gz: invalid compressed data--format violated
ls -l _.17_json.gz
Just to make sure: you cannot access currently open files. Might this be
Sent from phone, thus brief.
no, it happens with older files as well. Things many HUPs old.
On Thu, 31 Mar 2016, Rainer Gerhards wrote:
I see this too. My logrotate issues "invoke-rc.d rsyslog rotate" which runs "start-stop-daemon --stop --signal HUP --quiet --pidfile $PIDFILE --exec $DAEMON" at 6:25am.
All compressed log files are corrupt and end at this time and data is lost until a new log file is created and HUP issued, OR dynafile template causes a new file to be created.
Version: (Debian) 8.16.0-1~bpo8+1
Simply having two omfile directives that write to same file will break it.
Since it's impossible to append GZ file after receiving HUP signal there is an option to solve this issue with other way.