Permalink
| ------------------------------------------------------------------------------ | |
| Version 8.29.0 [v8-stable] 2017-08-08 | |
| - imptcp: add experimental parameter "multiline" | |
| This enables a heuristic to support multiline messages on raw tcp syslog | |
| connections. | |
| - imptcp: framing-related error messages now also indicate remote peer | |
| This is the case e.g. for oversize messages. | |
| - imtcp: framing-related error messages now also indicate remote peer | |
| This is the case e.g. for oversize messages. | |
| - imptcp: add session statistics conunter | |
| - session.opened | |
| - session.openfailed | |
| - session.closed | |
| - impstats: add new ressoure counter "openfiles" | |
| - omfwd/udp: improve error reporting, depricate maxerrormessages parameter | |
| Generally improved udp-related error messages (e.g. they now contain the | |
| socket number, which makes it easier to related them to errors reported by | |
| net.c subsystem). | |
| We also depricated (removed) the "maxerrormessages" configuration parameters. | |
| It provided some very rough rate-limiting capabilities and was introduced | |
| before we had native rate-limiters. The default was that only the first 5 | |
| error messages were actually reported. For long-running instances, that | |
| meant that in many cases no errors were ever reported. We now use the default | |
| internal message rate limter, which works far better and ensures that also | |
| long-running instances will be able to emit error messages after prolonged | |
| runtime. In contrast, this also means that users will see more error | |
| messages from rsyslog, but that should actually improve the end user | |
| experience. | |
| - core/net.c: improve UDP socket creation error messages | |
| - omfwd/udp: add "udp.sendbuf" parameter | |
| - core: make rsyslog internal message rate-limiter configurable | |
| New parameters "internalmsg.ratelimit.interval" and "internalmsg.ratelimit.burst" | |
| have been added. | |
| - imptcp bugfix: potential socket leak on session shutdown | |
| imptcp first tries to remove a to-be-shut-down socket from the | |
| epoll set, and errors out if that does not work. In that case, the | |
| underlying socket will be leaked. | |
| This patch refactors the code; most importantly, it is not necessary | |
| to remove the socket from the epoll set, as this happens automatically | |
| on close. As such, we simply remove that part of the code, which | |
| also removes the root cause of the socket leak. | |
| - omfwd/omudpspoof bugfix: switch udp client sockets to nonblocking mode | |
| On very busy systems, we see "udp send error 11" inside the logs, and the requesting | |
| action is being suspended (and later resumed). During the suspension period (in | |
| default configuration), messages are lost. Error 11 translates to EAGAIN and the | |
| cause of this problem is that the system is running out of UDP buffer space. This | |
| can happen on very busy systems (with busy networks). | |
| It is not an error per se. Doing a short wait will resolve the issue. The real root | |
| cause of the issue is that omfwd uses a nonblocking socket for sending. If it were | |
| blocking, the OS would block until the situation is resolved. The need for a | |
| non-blocking sockets is a purely historical one. In the days of single-threaded | |
| processing (pre v3), everything needed to be done by multiplexing, and blocking was | |
| not permitted. Since then, the engine has dramatically changed. Actions now run on | |
| their own thread(s). As such, there is no longer a hard need to use non-blocking i/o | |
| for sending data. Many other output plugins also do blocking wait (e.g. omelasticsearch). | |
| As such, the real root cause of the trouble is unnecessarily using non-blocking mode, | |
| and consequently the right solution is to change that. | |
| Note that using blocking i/o might change some timeing inside rsyslog, especially | |
| during shutdown. So theoretical there is regression potential in that area. However, | |
| the core is designed to handle that situation (e.g. there is special shutdown code to | |
| handle the blocking case), so this does not stand against the "proper" solution. | |
| This patch applies the change on the rsyslog core level, within net.c. The only | |
| users of the changed functionality are omfwd and omudpspoof. Imudp is unaffected as | |
| it requests server sockets. | |
| Note that according to the sendto() man page, there is a second cause for the EAGAIN | |
| error, this is when the system temporarily runs out of emphermeral ports. It is not | |
| 100% clear if this can also happen in the blocking case. However, if so, we can argue | |
| this is a case where we really want the default retry logic. So for the time being, | |
| it is appropriate to not handle EAGAIN in a special case any longer. | |
| closes https://github.com/rsyslog/rsyslog/issues/1665 | |
| - imklog: fix permitnonkernelfacility not working | |
| - core bugfix: segfault after configuration errors | |
| - core/queue bugfixes: | |
| * Fix behaviour of PersistStateInterval | |
| If PersistStateInterval=1, then each log line read should cause the state file | |
| to be updated, but this was not happening because nRecords was being post-increment. | |
| Thanks to Anthony Howe for the patch. | |
| * potential problem during deserialization | |
| if queue object deserialization fails, invalid memory blocks might be | |
| free'ed. | |
| For more information see https://github.com/rsyslog/rsyslog/pull/1647 | |
| Thanks to Derek Smith for the patch. | |
| - core bugfix: messsage garbled after message modification | |
| The MsgDup() function will return a garbled message object under these | |
| conditions: The message was originally created with message length equal or | |
| larger to CONF_RAWMSG_BUFSIZE. This makes rsyslog store the message in | |
| dynamically allocated buffer space. Then, a component reduces the message | |
| size to a size lower than CONGF_RAWMSG_BUFSIZE. A frequent sample is the | |
| parser removing a known-bad LF at the end of the messages. Then, MsgDup is | |
| executed. It checks the message size and finds that it is below | |
| CONF_RAWMSG_BUFSIZE, which make it copy the msg object internal buffer | |
| instead of the dynamically allocated one. That buffer was not written to in | |
| the first place, so unitialized data is copied. Note that no segfault can | |
| happen, as the copied location was properly allocated, just not used in | |
| this processing flow. In the end result, the new message object contains | |
| garbage data. Whenever the new object is used (e.g. in a async ruleset or | |
| action) that garbage will be used. Whenever the old object is accessed, | |
| correct data will be used. Both types of access can happen inside the | |
| same processing flow, which makes the problem appear to be random. | |
| closes https://github.com/rsyslog/rsyslog/issues/1658 | |
| - lmsig_ksi: removed pre-KSI_LS12 components | |
| As of GuardTime, the provider, these no longer work due to backend | |
| changes. The lmsig_ksi_ls12 module shall be used instead. This is | |
| available since 8.27.0. | |
| ------------------------------------------------------------------------------ | |
| Version 8.28.0 [v8-stable] 2017-06-27 | |
| - NEW BUILD REQUIREMENT: librelp 1.2.14 (to build relp components) | |
| This was necessary because imrelp requires an API introduced in 1.2.14. | |
| - omfwd: add parameter "tcp_frameDelimiter" | |
| - omkafka: large refactor of kafka subsystem | |
| This offers improvements and greatly increases reliablity. | |
| Closes https://github.com/rsyslog/rsyslog/issues/1559 | |
| Closes https://github.com/rsyslog/rsyslog/issues/1584 | |
| Closes https://github.com/rsyslog/rsyslog/issues/1515 | |
| Closes https://github.com/rsyslog/rsyslog/issues/1052 | |
| May fix https://github.com/rsyslog/rsyslog/issues/1230 | |
| - imfile: improved handling of atomically renamed file (w/ wildcards) | |
| if a file is atomically renamed, the state file is also being renamed, | |
| so processing continues as if the original name were kept. | |
| see also: https://github.com/rsyslog/rsyslog/issues/1417 | |
| - imfile: add capability to truncate oversize messages or split into multiple | |
| also in this case an error message is emitted. Both of these actions are | |
| configurable. This also solves memory issues when an endregex does not | |
| match for prolonged time. In that case, large parts of the file were | |
| previously buffered, which could cause big problems in case e.g. the | |
| endregex was simply wrong and never matched. For the later, see also | |
| https://github.com/rsyslog/rsyslog/issues/1552 | |
| - mmdblookup | |
| * upgraded from "contrib" to "fully supported" state | |
| * refactored and simplified code | |
| * added ability to specify custom names for extracted fields | |
| * added ability to spehttp://www.landesrecht-bw.de/jportal/portal/t/6el/page/bsbawueprod.psml/action/portlets.jw.MainAction?p1=0&eventSubmit_doNavigate=searchInSubtreeTOC&showdoccase=1&doc.hl=0&doc.id=jlr-UmwVwGBWrahmen&doc.part=R&toc.poskey=#focuspointcify container name for extracted fields | |
| * bugfix: fixed multiple memory leaks | |
| - imptcp: add new parameter "flowControl" | |
| - imrelp: add "maxDataSize" config parameter | |
| Thanks to Nathan Brown for the patch. | |
| - multiple modules: gtls: improve error if certificate file can't be opened | |
| - omsnare: allow different tab escapes | |
| Thanks to Shane P. Lawrence for the patch. | |
| - omelasticsearch: converted to use libfastjson instead of json-c | |
| json-c was used for historical purposes, and it's source included | |
| within the rsyslog source tree. We now use libfastjson inside all | |
| components. | |
| - imjournal: _PID fallback | |
| * added fallback for _PID proprety when SYSLOG_PID is not available | |
| * introduced new option "usepid" which sets which property should | |
| rsyslog use, it has 3 states system|syslog|both, default is both | |
| * deprecated "usepidfromsystem" option, still can be used | |
| and override the "usepid" | |
| * it is possible to revert previous default with usepid="syslog" | |
| Thanks to Radovan Sroka for the patch | |
| - multiple modules: add better error messages when regcomp is failing | |
| - omhiredis: fix build warnings | |
| Thanks to Brian Knox for the fix. | |
| - imfile bugfix: files mv-ed in into directory were not handled | |
| Thanks to Zachary M. Zhao for the patch. | |
| see also https://github.com/rsyslog/rsyslog/issues/1588 | |
| - omprog bugfix: execve() incorrectly called | |
| this caused failures on some but not all platforms | |
| Thanks to 張君天(Chun-Tien Chang) and Matthew Seaman for the patch. | |
| - imfile bugfix: multiline timeout did not work if state file exists | |
| The timeout feature for multiline reads does not correctly work for | |
| files for which a state file existed. This is usually the case for files | |
| that had been processed by a previous run and that still exist on the | |
| new start. For all other files, especially those monitored by a | |
| wildcard and newly created after the rsyslog start, timeout worked as | |
| expected. | |
| closes https://github.com/rsyslog/rsyslog/issues/1445 | |
| - lmsig_ksi-ls12 bugfix: build problems on some platforms | |
| - core bugfix: invalid object type assertion | |
| This lead to aborts due to failing assertion. Note that this could only | |
| happen during debugging runs which includes runtime instrumentation, | |
| something that never should be done in a stable production build. | |
| So this did not affect ordinary users, only developers in with | |
| deep debugging settings. | |
| - regression fix: local hostname was not always detected properly... | |
| ... on early start (w/o network). Introduced in 8.27.0. | |
| Thanks to github user jvymazal for the patch and whissi for | |
| reporting and helping with the analysis. | |
| - bugfix: format security issues in zmq3 modules | |
| see also: https://github.com/rsyslog/rsyslog/pull/1565 | |
| Thanks to Thomas D. (whissi) for the patch. | |
| - bugfix build system: add libksi only to those binaries that need it | |
| Thanks to Allan Park for the patch. | |
| - bugfix KSI ls12 components: invalid tree height calculation | |
| Thanks to Allan Park for the patch. | |
| - testbench/CI enhancements | |
| * re-enable and add kafka tests | |
| Kafka tests were disabled in 8.27.0 (a regression from imkafka). | |
| * better testbench coverage for mmdblookup | |
| * lmsig_ksi-ls12 is now being built at least on Centos7 | |
| ------------------------------------------------------------------------------ | |
| Version 8.27.0 [v8-stable] 2017-05-16 | |
| - imkafka: add module | |
| - imptcp enhancements: | |
| * optionally emit an error message if incoming messages are truncated | |
| * optionally emit connection tracking message (on connection create and | |
| close) | |
| * add "maxFrameSize" parameter to specify the maximum size permitted | |
| in octet-counted mode | |
| * add parameter "discardTruncatedMsg" to permit truncation of | |
| oversize messages | |
| * improve octect-counted mode detection: if the octet count is larger | |
| then the set frame size (or overly large in general), it is now | |
| assumed that octet-stuffing mode is used. This probably solves a | |
| number of issues seen in real deployments. | |
| - imtcp enhancements: | |
| * add parameter "discardTruncatedMsg" to permit truncation of | |
| oversize messages | |
| * add "maxFrameSize" parameter to specify the maximum size permitted | |
| in octet-counted mode | |
| - imfile bugfix: "file not found error" repeatedly being reported | |
| for configured non-existing file. In polling mode, this message | |
| appeared once in each polling cycle, causing a potentially very large | |
| amout of error messages. Note that they were usually emitted too | |
| infrequently to trigger the error message rate limiter, albeit often | |
| enough to be a major annoance. | |
| - imfile: in inotify mode, add error message if configured file cannot | |
| be found | |
| - imfile: add parameter "fileNotFoundError" to optinally disable | |
| "file not found" error messages | |
| - core: replaced gethostbyname() with getaddrinfo() call | |
| Gethostbyname() is generally considered obsolete, is not reentrant and | |
| cannot really work with IPv6. Changed the only place in rsyslog where | |
| this call remained. | |
| Thanks to github user jvymazal for the patch | |
| - omkafka: add "origin" field to stats output | |
| See also https://github.com/rsyslog/rsyslog/issues/1508 | |
| Thanks to Yury Bushmelev for providing the patch. | |
| - imuxsock: rate-limiting also uses process name | |
| both for the actual limit procesing as well as warning messages emitted | |
| see also https://github.com/rsyslog/rsyslog/pull/1520 | |
| Thanks to github user jvymazal for the patch | |
| - Added new module: KSI log signing ver. 1.2 (lmsig_ksi_ls12) | |
| - rsylsog base functionality now builds on osx (Mac) | |
| Thanks to github user hdatma for his help in getting this done. | |
| - build now works on solaris again | |
| - imfile: fix cross-platform build issue | |
| see also https://github.com/rsyslog/rsyslog/issues/1494 | |
| Thanks to Felix Janda for bug report and solution suggestion. | |
| - bugfix core: segfault when no parser could parse message | |
| This could happen if the default parser chain was changed and the | |
| RFC3164 parser was not included. Never seen in practice, just by | |
| experimenting in lab. | |
| - bugfix core: rate-limit internal messages when going to external log system | |
| Rate-limiting was only applied to messages processed internally. | |
| While the external logging system probably also applies rate-limiting, | |
| it would be preferrable that rsyslog applies the same policies on | |
| internal messages, no matter where they go. This is now the case. | |
| - bugfix core: when obtaining local hostname, a NULL pointer could be | |
| accessed. This depends on many factors, among them that no local host | |
| name is configured in rsyslog.conf AND the local system configuration | |
| also is set to an empty hostname. | |
| Thanks to github user jvymazal for the patch. | |
| - bugfix core: on shutdown, stderr was written to, even if already closed | |
| This lead to messages going to whatever was associated with file | |
| descriptor two. | |
| Thanks to Allan Park for the patch. | |
| - bugfix core: perform MainqObj destruction only when not NULL already | |
| This affects the config object; in theory may lead to misadressing during | |
| config parsing. | |
| Thanks to github user jvymazal for the patch | |
| - bugfix core: memory leak when internal messages not processed internally | |
| In this case, the message object is not destructed, resulting in | |
| a memory leak. Usually, this is no problem due to the low number | |
| of internal message, but it can become an issue if a large number | |
| of messages is emitted. | |
| closes https://github.com/rsyslog/rsyslog/issues/1548 | |
| closes https://github.com/rsyslog/rsyslog/issues/1531 | |
| - bugfix imptcp: potential overflow in octet count computation | |
| when a very large octet count was specified, the counter could overflow | |
| ------------------------------------------------------------------------------ | |
| Version 8.26.0 [v8-stable] 2017-04-04 | |
| - NEW BUILD REQUIREMENT: liblognorm 2.0.3 is required for mmnormalize | |
| If mmnormalize is not built, the build requirements are unchanged. | |
| The new version is necessary because it contains an enhanced API for a | |
| new mmnormalize feature. | |
| - enable internal error messages at all times | |
| This is an important change to the design of the rsyslog core internal | |
| error message system. Previous code could deadlock if internal messages were | |
| issued inside queue processing code, which effectively limited error-reporting | |
| capabilities. This change makes it possible to call error messages from any | |
| part of the code at any time. | |
| As a side-effect, this also fixes an issue where rsyslog could deadlock if | |
| imuxsock submited messages to the system log socket when that socket blocked. | |
| This was a rare race, albeit consistently reproducible and also seen in | |
| practice. The work-around for this issue was to set | |
| global(processInternalMessages="on") | |
| in rsyslog.conf. With the new code, this race can never happen again. The new | |
| code also sets stage for emitting better error messages, especially in places | |
| where we previously refrained from doing so and messages went only to the | |
| debug log. For some file output and queue subsytem related messages, this | |
| is already done, but there is still further work required. | |
| Note well: this is a redesign of an important core component. While intensely | |
| tested, this may still have some larger regeression potential than usual code | |
| changes. | |
| - core: added logging name of source of rate-limited messages | |
| This adds the name to the rate-limiting message itself, making it easier | |
| to identify the actual source of "spam" messages. | |
| Thanks to github user jvymazal for the patch. | |
| - omfwd: omfwd: add support for network namespaces | |
| Thanks to Bastian Stender for the patch. | |
| - imrelp: honor input name if provided when submitting to impstats | |
| Thanks to Jon Henry for the patch. | |
| - imptcp: add ability to set owner/group/access perms for uds | |
| Thanks to Nathan Brown for implementing this feature. | |
| - mmnormalize: add ability to load a rulebase from action() parameter | |
| This is especially useful for small rulebases, as it avoids having | |
| a separate rulebase file. | |
| closes https://github.com/rsyslog/rsyslog/issues/625 | |
| - pmrfc3164 improvements | |
| - permit to ignore leading space in MSG | |
| - permit to use at-sign in host names | |
| - permit to require tag to end in colon | |
| Thanks to github user bdolez for the contribution | |
| - add new global parameter "umask" | |
| This is equivalent to "$umask" and permits to convert that construct | |
| to new-style config format. | |
| closes https://github.com/rsyslog/rsyslog/issues/1382 | |
| - core: make use of -T command line option more secure | |
| When the -T option is used, a chdir is now done right after chroot. It must | |
| be noted, though, that -T is a testing option and has no intent to provide | |
| real security. So this change does not mean it actually is sufficiently | |
| secure. | |
| Thanks to github user jvymazal for the patch. | |
| - omfile: add error if both file and dynafile are set | |
| - bugfix: build problem on MacOS (not a supported platform) | |
| Thanks to FX Coudert for the fix. | |
| - regression fix: in 8.25, str2num() returned error on empty string | |
| past behaviour was to return 0 in this case; past behavior was reinstanciated | |
| Thanks to github user jvymazal for the patch. | |
| - bugfix omsnmp: improper handling of new-style configuration parameters | |
| Thanks to Radovan Sroka for the patch. | |
| - bugfix: rsyslog identifies itself as "liblogging-stdlog" in internal messages | |
| This occured when liblogging-stdlog was used, and was used by default (without | |
| explicit configuration). This is a regression of the new default, which does | |
| not correctly call stdlog_open() in the default case. | |
| closes https://github.com/rsyslog/rsyslog/issues/1442 | |
| - bugfix imfile: wrong files were monitored when using multiple imfile inputs | |
| The bug was introduced by the changes for the multilevel wildcard feature | |
| in 8.25.0. We have to handle FileCreate events different if the directory | |
| watch is configured or added dynamically. | |
| closes https://github.com/rsyslog/rsyslog/issues/1452 | |
| - bugfix: setting net.aclResolveHostname/net.acladdhostnameonfail segfaults | |
| When compiling using hardned gcc (gentoo), specifying net.aclResolveHostname | |
| or net.acladdhostnameonfail results in rsyslogd segfaulting on startup. | |
| Thanks to Radovan Sroka for the patch. | |
| - bugfix: immark emitted error messages with text "imuxsock" | |
| Thanks to Chris Pilkington for the patch. | |
| - bugfix tcpflood: build failed if RELP was disabled | |
| - fix gcc6 compiler warnings | |
| This also fixes a small bug with incorrectly working deprecated -u | |
| command line option. | |
| Thanks to Nikola Pajkovsky for the patch. | |
| - the output module array passing interface has been removed | |
| It wasn't functional since the v8 update, and the only user was omoracle, | |
| which is a contributed module that is no longer maintained. So we | |
| removed that interface to streamline the code. Should it ever be needed | |
| again, we could check the 8.25 code base. Note, though, that that code | |
| still needs to be adjusted to the v8 engine. | |
| - testbench: | |
| * tcpflood now automatically enters silent mode during Travis CI testing | |
| This reduces testbench output, which is limited under Travis. | |
| * the libqpid-proton package is no longer available for Ubuntu trusty. As | |
| such, we disabled its use in Travis on this platform. Right now, this | |
| means omaqp1 module is no longer tested on trusty. | |
| ------------------------------------------------------------------------------ | |
| Version 8.25.0 [v8-stable] 2017-02-21 | |
| - imfile: add support for wildcards in directory names | |
| This now permits to monitor newly created directories without altering | |
| the configuration. | |
| - add new global option "parser.PermitSlashInProgramname" | |
| - mmdblookup: fix build issues, code cleanup | |
| Thanks to Dan Molik for the patch. | |
| - improved debug output for queue corruption cases | |
| - an error message is now displayed when a directory owner cannot be set | |
| This mostly happens with omfile and dynafils. The new messages | |
| facilitates troubleshooting. | |
| - rainerscript: | |
| * add new function ipv42num | |
| * add new function num2ipv4 | |
| - bugfix: ratelimiter does not work correctly is time is set back | |
| Thanks to github user hese10 for the patch. | |
| see also https://github.com/rsyslog/rsyslog/issues/1354 | |
| - core: fix potential message loss in old-style transactional interface | |
| This was experienced for example by omrelp. Could loose one message per | |
| broken connection, iff that message did not make it to the unacked list. | |
| - bugfix queue subsystem: queue corrupted if certain msg props are used | |
| The core issues was in the msg object deserializer, which had the wrong | |
| deserialization sequence. That in turn lead to queue corruption issues. | |
| Corruption of disk queue (or disk part of DA queue) always happens if | |
| the "json" property (message variables) is present and "structured-data" | |
| property is also present. This causes rsyslog to serialize to the | |
| queue in wrong property sequence, which will lead to error -2308 on | |
| deserialization. | |
| Seems to be a long-standing bug. Depending on version used, some or | |
| all messages in disk queue may be lost. | |
| closes https://github.com/rsyslog/rsyslog/issues/1404 | |
| - bugfix imjournal: fixed situation when time goes backwards | |
| This is resolving the situation when system is after reboot and | |
| boot_id doesn't match so cursor pointing into "future". | |
| Usually sd_journal_next jump to head of journal due to journal | |
| aproximation, but when system time goes backwards and cursor is | |
| still invalid, rsyslog stops logging. | |
| We use sd_journal_get_cursor to validate our cursor. | |
| When cursor is invalid we are trying to jump to the head of journal | |
| This problem with time should not affect persistent journal, | |
| but if cursor has been intentionally compromised it could stop | |
| logging even with persistent journal. | |
| - bugfix: bFlushOnTxEnd == 0 not honored when writing w/o async writer | |
| If bFlushOnTXEnd is set, we need to flush on transaction end - in | |
| any case. It is not relevant if this is using background writes | |
| (which then become pretty slow) or not. And, similarly, no flush | |
| happens when it is not set. | |
| see also https://github.com/rsyslog/rsyslog/issues/1297 | |
| - bugfix core: str2num mishandling empty strings | |
| If str2num() receives an empty string, misadressing happens. | |
| This theoretically can lead to a segfault if a RainerScript function | |
| is used inside the configuration which calls code that could trigger | |
| this bug. | |
| closes https://github.com/rsyslog/rsyslog/issues/1412 | |
| - bugfix rainerscript: set/unset statement do not check variable name validity | |
| Only JSON-based variables can be use with set and unset. Unfortunately, | |
| this restriction is not checked. If an invalid variable is given | |
| (e.g. $invalid), this is not detected upon config processing on | |
| startup. During execution phase, this can lead to a segfault, a | |
| memory leak or other types of problems. | |
| Thanks to github user mostolog for reporting and helping to analyze | |
| this issue. | |
| see also https://github.com/rsyslog/rsyslog/issues/1376 | |
| closes https://github.com/rsyslog/rsyslog/issues/1377 | |
| - bugfix mmrm1stspace: last character of rawmsg property was doubled | |
| - bugfix: rsyslog loops on freebsd when trying to write /dev/console | |
| Rsyslog 8.23.0 loops on FreeBSD when trying to access a (now revoked) | |
| /dev/console file descriptor, as per Alexandre's original bug report [1]. | |
| The original patch fixes the problem when tryTTYRecover() sees errno 6 ENXIO. | |
| Running FreeBSD 10-stable here and getting errno 5 EIO, same as Xavier gets | |
| in his 2016 bug report [2]. | |
| New patch [3] includes errno 5 to tryTTYRecover() in runtime/stream.c and | |
| fixes the problem for me, on multiple machines. | |
| [1] https://github.com/rsyslog/rsyslog/issues/371 | |
| [2] https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=211033 | |
| [3] https://bz-attachments.freebsd.org/attachment.cgi?id=178452 | |
| closes https://github.com/rsyslog/rsyslog/issues/1351 | |
| Thanks to Damien Fleuriot for the patch. | |
| - bugfix imtcp: fix very small (cosmetic) memory leak | |
| For each listener, the name of an assigned ruleset is not freed. This | |
| is cosmetic, because it is a very small static leak AND it needs to | |
| be kept until end of run anyways (and at end of run the OS frees it). | |
| However, the leak breaks memleak checks in the testbench. | |
| - fix build issues on some platforms (detected on newer Fedora) | |
| ------------------------------------------------------------------------------ | |
| Version 8.24.0 [v8-stable] 2017-01-10 | |
| - rsyslog now builds on AIX | |
| see also: https://github.com/rsyslog/rsyslog/pull/1247 | |
| Thanks to github user purnimam1 and the team at IBM | |
| Note: the rsyslog project has no AIX platform to ensure that future versions | |
| will remain buildable on AIX. If you would like to contribute ressources, | |
| please contact the rsyslog team. | |
| - mmdblookup: new maxminddb lookup message modify plugin | |
| Thanks to 饶琛琳 (github user chenryn) for the contribution | |
| - mmrm1stspace: new module; removes first space in MSG if present | |
| - KSI signature provider: file permissions can now be specified | |
| This happens via parameters equal to those used by omfile itself. | |
| Note that KSI files can have different permissions/owner than the log | |
| files themself. | |
| Thanks to Allan Park for the patch. | |
| - omzmq: new features | |
| Thanks to Brian Knox for the patch. | |
| - change: when the hostname is empty, we now use "localhost-empty-hostname" | |
| In 8.23.0, "localhost" was used in this case, but that could be misleading. | |
| The new name makes the error condition (gethostname() should always return | |
| a non-empty name) more obvious. | |
| - omelasticsearch: remove "asyncrepl" config parameter | |
| The _bulk index endpoint on ElasticSearch 5.0 no longer | |
| ignores the ?replication=async query parameter. It was deprecated | |
| since 1.5 and silently ignored in 2.x but passing it to a 5.x | |
| instance breaks omeleastisearch with a 400 response. | |
| closes https://github.com/rsyslog/rsyslog/issues/1250 | |
| - omfwd: Add support for bind-to-device (see below on same for imudp) | |
| - imudp: Add support for bind-to-device | |
| Add support for bind-to-device option to omfwd and imudp modules. | |
| Configured using device="name". Only new syntax format is supported. | |
| e.g., | |
| input(type="imudp" port=["10514"] device="eth0" name="udp") | |
| Action(type="omfwd" Target="192.168.1.23" Port="10514" Device="eth0") | |
| see also https://github.com/rsyslog/rsyslog/pull/1261 | |
| Thanks to David Ahern for the patch. | |
| - imudp: limit rcvbufsize parameter to max 1GiB | |
| - rainerscript: implement new "call_indirect" statement | |
| - bugfix imjournal: make state file handling more robust | |
| There is a bug in rsyslog which is caused by not very atomic writes of | |
| imjournal statefile. It's hardly reproducible but there is a way. | |
| fscanf error appears only when rsyslog reads an empty statefile which | |
| causes that imjournal is stopped so no logging from journal is | |
| performed. When the statefile contains random bytes error appears | |
| again but from journal and imjournal is stopped too. | |
| In this patch Rsyslog writes imjournal statefile more atomically and | |
| secure. Reading the statefile is more robust and doesn't affect | |
| imjournal module so when corrupted statefile is read imjournal | |
| ignores statefile, continues with logging and it doesn't stop. Logger | |
| can be used as a test if it's logging or not. | |
| Patch introduces a new option with both old and new config format | |
| "IgnoreNonValidStateFile" which is "on" by default and it can turn | |
| off ignorance of non valid statefile. | |
| Thanks to github user tomassykora for the patch. | |
| - bugfix core: lookup table reload was not properly integrated | |
| The opcode was not handled, what lead to misleading messages | |
| in debug log. Since we run debug builds more strictly, it also | |
| causes an assertion to trigger, thus aborting the test | |
| - bugfix core: potential dealock on shutdown | |
| could happen when rsyslog was started and quickly shut down OR when | |
| co-incidently a new thread was spawend "with bad timing" around the time | |
| of shutdown. | |
| See also https://github.com/rsyslog/rsyslog/pull/1274 | |
| Thanks to github user tomassykora for the final patch and Rado Sroka for | |
| the analysis and an initial patch. | |
| - bugfix ommongodb: did not work in v8 due to invalid indirection | |
| Thanks to Benoit Dolez for the patch. | |
| - bugfix ommongodb: fix tryResume handling | |
| To make tryResume working, the connection to mongodb need to be closed. | |
| Thus close it on "insert error". | |
| Thanks to Benoit Dolez for the patch. | |
| - bugfix omfwd: retry processing was not done correctly, could stall | |
| see also https://github.com/rsyslog/rsyslog/pull/1261 | |
| Thanks to David Ahern for the patch. | |
| - bugfix imuxsock: segfault non shutdown when $OmitLocalLogging is on | |
| Imuxsock tries to close socket on index 0 which ends with segfault. | |
| Thanks to Tomas Sykora for the patch. | |
| - testbench: | |
| * empty-hostname test did not work correctly | |
| * improve debugging by better output | |
| ------------------------------------------------------------------------------ | |
| Version 8.23.0 [v8-stable] 2016-11-15 | |
| - NEW BUILD REQUIREMENT: libfastjson 0.99.3 | |
| This was introduced in 8.20.0 as a suggestion and has now become a hard | |
| requirement. See 8.20.0 ChangeLog entry for more details. | |
| - KSI signatures: removed SHA2-224 hash algorithm | |
| This is considered insecure and no longer supported by the underlying | |
| KSI library. If still used within a configuration, a descriptive error | |
| message is emitted during config processing. | |
| Thanks to Henri Lakk for the initial patch. | |
| - imfile: new timeout feature for multi-line reads | |
| When using startmsg.regex, messages are held until the next one is written. | |
| We now provide a "readTimeout" parameter family (see doc) to timeout such | |
| reads and ensure messages are not held for a very long time. | |
| see also https://github.com/rsyslog/rsyslog/issues/1133 | |
| - omfile: improve robustness against network file system failures | |
| in case of failure, a close and re-open is tried, which often solves the | |
| issue (and wasn't handle before this patch). | |
| see also https://github.com/rsyslog/rsyslog/pull/1161 | |
| Thanks to github user hese10 for the patch. | |
| - pmaixforwardedfrom: support for AIX syslogd -s option | |
| if syslog in AIX started with "-s" option, AIX syslog adds only "From " | |
| instead of "Message forwarded from ". With this patch, both are now | |
| detected. | |
| Thanks to github user patelritesh for the patch. | |
| - omelasticsearch: add ability to specify max http request size | |
| This permits to keep batches below ES-configured limits. | |
| Thanks to github user barakshechter for the patch. | |
| - omelasticsearch: high availability addressing of ElasticSearch cluster | |
| allow to specify an array of servers, which is tried until a working | |
| one is found (and given up only if none works). | |
| Thanks to github user barakshechter for the patch. | |
| - omelasticsearch: make compatible with ElasticSearch 2.x and 5.x | |
| fixes omelasticsearch logs response from ElasticSearch 5.0 _bulk | |
| endpoint as error | |
| See also https://github.com/rsyslog/rsyslog/pull/1253 | |
| Thanks to Christian Rodemeyer for the patch. | |
| - omhiredis: add dynakey attribute. | |
| If set to on, this causes omhiredis to treat the key attribute as the | |
| name of a template so that you can build a dynamic redis queue name | |
| or list key. | |
| see also: https://github.com/rsyslog/rsyslog/pull/1218 | |
| Thanks to github user bobthemighty for the patch | |
| - omtcl: new contributed module | |
| see also https://github.com/rsyslog/rsyslog/pull/1041 | |
| Please note: contributed modules are not directly supported by the | |
| project. You might want to contact the author for questions. | |
| Thanks to Francisco Castro for contributing it. | |
| - RainerScript: provide a capability to set environment variables | |
| via 'global(environment="var=val")' config statement. | |
| This is most importantly for things like HTTP_PROXY. | |
| see also https://github.com/rsyslog/rsyslog/issues/1209 | |
| - lookup tables: improved error checking | |
| Thanks to Janmejay Singh for the patch. | |
| - queue subsystem: add configuration parameter "queue.samplinginterval" | |
| Supports sampling of messages (as often used in data transmission). | |
| Thanks to Zachary M. Zhao for the patch. | |
| - bugfix core: errmsg.LogError now switches to dfltErrLogger just before shutdown | |
| Thanks to Janmejay Singh for the patches. | |
| - bugfix core: fixed un-freed memory in non-transactional action using string-passing | |
| closes https://github.com/rsyslog/rsyslog/issues/968 | |
| Thanks to Janmejay Singh for the patches. | |
| - rsgtutil: option to specify KSI publications file certificate constraints | |
| see also https://github.com/rsyslog/rsyslog/issues/1207 | |
| - omprog: bugfixes and enhancements | |
| - omprog resource leak fix (fd leak) | |
| - omprog got ability to force-kill process if it doesn't die in 5 seconds | |
| (linux specific) | |
| - child-process lifecycle debugging aid (in form of logs) (mainLoop and | |
| omprog cleanup both log pid at child-death, mainLoop reaping is now | |
| visible to user, as opposed to being a mystery, because omprog didn't | |
| seem to anticipate it in terms of code) | |
| Thanks to Janmejay Singh for the patches. | |
| see also https://github.com/rsyslog/rsyslog/pull/1155 | |
| - bugfix imfile: ReopenOnTruncate processing, file open processing | |
| This fixes | |
| * ReopenOnTrucate was only honored when a state file existed | |
| see https://github.com/rsyslog/rsyslog/issues/1090 | |
| * open processing could run into a loop | |
| see https://github.com/rsyslog/rsyslog/issues/1174 | |
| This is done via refactoring the open file handling, which provides | |
| overall cleaner and easier-to-follow code. | |
| Thanks to Owen Smith for analyzing the problem and providing a | |
| prototype PR which greatly helped towards the final solution. | |
| - bugfix omlibdbi: libdbi-driver-sqlite3/2 requires to provide a path to | |
| database split into two strings: | |
| * absolute path, where the database file sits | |
| * database filename itself. | |
| This was previously not done. | |
| Thanks to github user aleek for the patch. | |
| - bugfix RainerScript: issue in prifilt() function | |
| Initialize func-data(and to-be-freed flag) correctly for prifilt | |
| function-node | |
| Thanks to Janmejay Singh for the patch. | |
| - bugfix omrelp: invalid module name imrelp was used in some error messages | |
| Thanks to Chris Pilkington for the patch. | |
| - bugfix core: abort when persisting object state | |
| This causes a segfault. It happens whenever an object state larger | |
| than 4095 byte is persisted. Then, incorrectly a try to rollover to | |
| a new state file is tried, which will lead to a division by zero | |
| as the necessary variables for this operation are not set because we | |
| are NOT in circular mode. | |
| This problem can happen wherever state files are written. It has been | |
| experienced with imfile and queue files. | |
| Many thanks to github user mostolog for his help in reproducing the issue, | |
| which was very important to finally nail down this long-standing bug. | |
| closes https://github.com/rsyslog/rsyslog/issues/1239 | |
| closes https://github.com/rsyslog/rsyslog/issues/1162 | |
| closes https://github.com/rsyslog/rsyslog/issues/1074 | |
| - bugfix: segfault if hostname is unset on system | |
| happens when gethostname() returns empty string. This will cause | |
| the createon of the localhostname prop_t to fail, which in turn | |
| leads to a NULL pointer dereference when emitting local messages. | |
| As we emit a startup message by default, this had usually lead | |
| to a segfault on startup. | |
| Thanks to Erik Potter and github user mostolog for their help | |
| in analyzing this problem. | |
| closes https://github.com/rsyslog/rsyslog/issues/1040 | |
| closes https://github.com/rsyslog/rsyslog/issues/335 | |
| - bugfix external module perl skeleton: did not work properly | |
| Thanks to github user Igorjan666 for the patch. | |
| - bugfix build system: Fix detection of pthread_setschedparam() on platforms | |
| such as FreeBSD | |
| see also https://github.com/rsyslog/rsyslog/pull/1147 | |
| Thanks to Matthew Seaman for the patch. | |
| - bugfix omelasticsearch: modifies constant memory under some circumstances | |
| Function computeBaseUrl may modify its serverParam parameter, but | |
| this may contain the constant string "localhost". Depending on the | |
| platform, this can lead to a segfault. | |
| Noticed while working on compiler warnings, not seen in practice. | |
| - "bugfix": theoretical queue file corruption when more than MAX_INT files | |
| closes https://github.com/rsyslog/rsyslog/issues/1202 | |
| - bug fix/KSI: LOGSIG11 missing in the beginning of KSI log signature file | |
| When logging with KSI is not working properly for whatever reason, an | |
| empty .ksisig file is created (which by itself is not an issue). However, | |
| later it looks like this file is re-used, but it is not checked whether it | |
| already contains the magic LOGSIG11 in the beginning of the file. This leads | |
| to a log signature file which has correct content but is missing the | |
| LOGSIG11 magic in the beginning. | |
| - bugfix template processor: missing escaping of backslash in json mode | |
| Thanks to github user mostolog for providing the patch. | |
| - build environment: --enable-debug now defaults to new "auto" mode | |
| previously, DEBUG mode (and thus assert() macros) was disabled by default | |
| and explicitly needed to be enabled by providing the --enable-debug | |
| ./configure switch. Now, a new --enable-debug=auto mode has been added | |
| and made the default. It enables DEBUG mode if we build from git and only | |
| disables it when a release build is done (from the release tarball). This | |
| aims at better error checking during testbench runs and developer testing. | |
| - testbench improvements | |
| * improved testbench file generation tool | |
| Thanks to Pascal Withopf for the patch. | |
| * added some plumbing for extended tests which work by overriding OS APIs | |
| * imfile ReopenOnTruncate option is now being tested | |
| * the CI environment now runs most tests in debug mode, but some in | |
| release mode to cover potential release-mode races | |
| * template json option is now being tested | |
| * object state persisting received a basic test | |
| * added test for empty hostnames | |
| * added tests for omprog | |
| ------------------------------------------------------------------------------ | |
| Version 8.22.0 [v8-stable] 2016-10-04 | |
| - ompgsql: add template support | |
| Thanks to Radu Gheorghe for implementing this. | |
| - generate somewhat better error message on config file syntax error | |
| a common case (object at invalid location) has received it's own error | |
| message; for the rest we still rely on the generic flex/bison handler | |
| - bugfix:omhiredis reconnects after failure | |
| previously it could loose messages under such conditions. | |
| Thanks to Bob Gregory for the patch. | |
| - general cleanup and code improvement | |
| mostly guided by compiler warnings induced by newer opensuse builbot | |
| environment | |
| ------------------------------------------------------------------------------ | |
| Version 8.21.0 [v8-stable] 2016-08-23 | |
| - CHANGE OF BEHAVIOUR: | |
| by default, internal messages are no longer logged via the internal | |
| bridge to rsyslog but via the syslog() API call [either directly or | |
| via liblogging). For the typical single-rsyslogd-instance installation this | |
| is mostly unnoticable (except for some additional latency). If multiple | |
| instances are run, only the "main" (the one processing system log messages) | |
| will see all messages. To return to the old behaviour, do either of those | |
| two: | |
| 1) add in rsyslog.conf: | |
| global(processInternalMessages="on") | |
| 2) export the environment variable RSYSLOG_DFLT_LOG_INTERNAL=1 | |
| This will set a new default - the value can still be overwritten via | |
| rsyslog.conf (method 1). Note that the environment variable must be | |
| set in your **startup script**. | |
| For more information, please visit | |
| http://www.rsyslog.com/rsyslog-error-reporting-improved/ | |
| - slightly improved TLS syslog error messages | |
| - queue subsystem: improved robustness | |
| The .qi file is now persisted whenever an existing queue file is fully | |
| written and a new file is begun. This helps with rsyslog aborts, including | |
| the common case where the OS issues kill -9 because of insufficiently | |
| configured termination timout (this is an OS config error, but a frequent | |
| one). Also, a situation where an orphaned empty file could be left in the | |
| queue work directory has been fixed. We expect that this change causes | |
| fewer permanent queue failures. | |
| - bugfix: build failed on some platforms due to missing include files | |
| ------------------------------------------------------------------------------ | |
| Version 8.20.0 [v8-stable] 2016-07-12 | |
| - NEW BUILD REQUIREMENT: librelp, was 1.2.5, now is 1.2.12 | |
| This is only needed if --enable-relp is used. The new version is needed | |
| to support the new timeout parameter in omrelp. | |
| - NEW BUILD SUGGESTION: libfastjson 0.99.3 | |
| while not strictly necessary, previous versions of libfastjson have a bug | |
| in unicode processing that can result in non US-ASCII characters to be | |
| improperly encoded and may (very unlikely) also cause a segfault. | |
| This version will become mandatory in rsyslog 8.23.0 | |
| - omrelp: add configurable connection timeout | |
| Thanks to Nathan Brown for implementing this feature. | |
| - pmrfc3164: add support for slashes in hostname | |
| added parameter "permit.slashesinhostname" to support this, off by default | |
| [Note that the RFC5424 always supported this, as 5424 is a different | |
| standard] | |
| - bugfix omfile: handle chown() failure correctly | |
| If the file creation succeeds, but chown() failed, the file was | |
| still writen, even if the user requested that this should be treated | |
| as a failure case. This is corrected now. | |
| Also, some refactoring was done to create better error messages. | |
| - omfile now better conveys status of unwritable files back to core | |
| - config files recursively including themselfes are now detected | |
| and an error message is emitted in that case; Previously, this | |
| misconfiguration resulted in rsyslog loop and abort during startup. | |
| closes https://github.com/rsyslog/rsyslog/issues/1058 | |
| - refactored code to not emit compiler warnings in "strict mode" | |
| We changed the compiler warning settings to be rather strict and cleaned up | |
| the code to work without generating any warning messages. | |
| This results in an overall even more improved code quality, which will now | |
| also be enforced via our CI systems. | |
| - bugfix: fix some issues with action CommitTransaction() handling | |
| An action that returns an error from CommitTransaction() caused a | |
| loop in rsyslog action processing. Similarly, retry processing was not | |
| properly handled in regard to CommitTransaction(). | |
| This is a first shot at fixing the situation. It solves the | |
| immediate problems, but does not implement the full desired | |
| functionality (like error file). | |
| see also https://github.com/rsyslog/rsyslog/issues/974 | |
| see also https://github.com/rsyslog/rsyslog/issues/500 | |
| - bugfix omqmqp1: connecting to the message bus fails on nonstandard port | |
| Thanks to Ken Giusti for the patch. | |
| see also: https://github.com/rsyslog/rsyslog/pull/1064 | |
| - testbench/CI enhancements | |
| * new tests for RELP components | |
| * new tests for core action processing and retry | |
| * travis tests now also run against all unstable versions of supporting | |
| libraries. This helps to track interdependency problems early. | |
| * new tests for hostname parsing | |
| * new tests for RainerScript comparisons | |
| ------------------------------------------------------------------------------ | |
| Version 8.19.0 [v8-stable] 2016-05-31 | |
| - NEW BUILD REQUIREMENT: autoconf-archive | |
| - omelasticsearch: add option to permit unsigned certs (experimentally) | |
| This adds plumbing as suggested by Joerg Heinemann and Radu Gheorghe, | |
| but is otherwise untested. Chances are good it works. If you use it, | |
| please let us know your experience and most importantly any bug | |
| reports you may have. | |
| closes https://github.com/rsyslog/rsyslog/issues/89 | |
| - imrelp: better error codes on unvailablity of TLS options | |
| Most importantly, we will tell the user in clear words if specific TLS | |
| options are not available due to too-old GnuTLS. | |
| closes https://github.com/rsyslog/rsyslog/issues/1019 | |
| - default stack size for inputs has been explicitely set to 4MiB | |
| for most platforms, this means a reduction from the default of 10MiB, hower | |
| it may mean an increas for micro-libc's (some may have as low as 80KiB by | |
| default). | |
| - testbench: We are now using libfaketime instead of faketime command line | |
| tool. Make sure you have installed the library and not just the binary! | |
| - refactor stringbuf | |
| * use only a single string buffer | |
| ... both for the internal representation as well as the C-String one. | |
| The module originally tried to support embedded NUL characters, which | |
| over time has prooven to be not necessary. Rsyslog always encodes | |
| NUL into escape sequences. | |
| Also, the dual buffers were used inconsistently, which could lead to | |
| subtle bugs. With the single buffer, this does no longer happen and | |
| we also get some improved performance (should be noticable) | |
| and reduced memory use (a bit). | |
| closes https://github.com/rsyslog/rsyslog/issues/1033 | |
| * removed no longer used code | |
| * internal API changes to reflect new needs | |
| * performance improvements | |
| * miscellaneous minor cleanup | |
| - fix: potential misadressing in template config processing | |
| This could cause segfault on startup. Happens when template name shorter | |
| than two chars and outname is not set. Once we are over startup, things | |
| work reliably. | |
| - bugfix omfile: async output file writing does not respect flushing | |
| neither parameter flushInterval nor flushOnTXEnd="on" was respected. | |
| closes https://github.com/rsyslog/rsyslog/issues/1054 | |
| - bugfix imfile: corrupted multi-line message when state data was persisted | |
| see also https://github.com/rsyslog/rsyslog/issues/874 | |
| Thanks to Magnus Hyllander for the analysis and a patch suggestion. | |
| - bugfix imfile: missing newline after first line of multiline message | |
| see also https://github.com/rsyslog/rsyslog/issues/843 | |
| Thanks to Magnus Hyllander for the patch. | |
| - bugfix: dynstats unusedMetricTtl bug | |
| Thanks to Janmejay Singh for fixing this. | |
| - bugfix build system: build was broken on SunOS | |
| Thanks to Filip Hajny for the patch. | |
| - bugfix: afterRun entry point not correctly called | |
| The entry point was called at the wrong spot, only when the thread | |
| had not already terminated by itself. This could cause various | |
| cleanup to not be done. This affected e.g. imjournal. | |
| closes https://github.com/rsyslog/rsyslog/issues/882 | |
| - bugfix dynstats: do not leak file handles | |
| Thanks to Janmejay Singh for the patch. | |
| - bugfix omelasticsearch: disable libCURL signal handling | |
| previously, this could lead to segfaults on connection timeout | |
| see also https://github.com/rsyslog/rsyslog/pull/1007 | |
| Thanks to Sai Ke WANG for the patch. | |
| - bugfix omelasticsearc: some regressions were fixed | |
| * error file was no longer written | |
| * fix for some potential misaddressings | |
| - improved wording: gnutls error message points to potential cause | |
| What GnutTLS returns us is very unspecific and somehwat misleading, so | |
| we point to what it most probably is (broken connect). | |
| see also https://github.com/rsyslog/rsyslog/issues/846 | |
| - some general code improvements | |
| * "fixed" cosmetic memory leaks at shutdown | |
| - build system bugfix: configure can't find gss_acquire_cred on Solaris | |
| Thanks to github user vlmarek for the patch. | |
| - improvements to the CI environment | |
| * improvements on the non-raciness of some tests | |
| * imdiag: avoid races in detecting queue empty status | |
| This reslolves cases where the testbench terminated rsyslog too early, | |
| resulting in potential message loss and test failure. | |
| * omkafka has now dynamic tests | |
| Thanks to Janmejay Singh for implementing them. | |
| * try to merge PR to master and run tests; this guards against cross-PR | |
| regressions and wasn't caught previously. Note that we skip this test | |
| if we cannot successfully merge. So this is not a replacement for a | |
| daily full "all-project integration test run". | |
| * travis has finally enabled elasticsearch tests | |
| ES was unfortunately not being regularly tested for quite a while due to | |
| missing environment. This lead to some regressions becoming undetected. | |
| These were now discovered thanks to the new support on travis. Also, this | |
| guards against future regressions. | |
| * imfile has now additional tests and overall better coverage | |
| * omfile has now additional tests | |
| ------------------------------------------------------------------------------ | |
| Version 8.18.0 [v8-stable] 2016-04-19 | |
| - testbench: When running privdrop tests testbench tries to drop | |
| user to "rsyslog", "syslog" or "daemon" when running as root and | |
| you don't explict set RSYSLOG_TESTUSER environment variable. | |
| Make sure the unprivileged testuser can write into tests/ dir! | |
| - templates: add option to convert timestamps to UTC | |
| closes https://github.com/rsyslog/rsyslog/issues/730 | |
| - omjournal: fix segfault (regression in 8.17.0) | |
| - imptcp: added AF_UNIX support | |
| Thanks to Nathan Brown for implementing this feature. | |
| - new template options | |
| * compressSpace | |
| * date-utc | |
| - redis: support for authentication | |
| Thanks to Manohar Ht for the patch | |
| - omkafka: makes kafka-producer on-HUP restart optional | |
| As of now, omkafka kills and re-creates kafka-producer on HUP. This | |
| is not always desirable. This change introduces an action param | |
| (reopenOnHup="on|off") which allows user to control re-cycling of | |
| kafka-producer. | |
| It defaults to on (for backward compatibility). Off allows user to | |
| ignore HUP as far as kafka-producer is concerned. | |
| Thanks to Janmejay Singh for implementing this feature | |
| - imfile: new "FreshStartTail" input parameter | |
| Thanks to Curu Wong for implementing this. | |
| - omjournal: fix libfastjson API issues | |
| This module accessed private data members of libfastjson | |
| - ommongodb: fix json API issues | |
| This module accessed private data members of libfastjson | |
| - testbench improvements (more tests and more thourough tests) | |
| among others: | |
| - tests for omjournal added | |
| - tests for KSI subsystem | |
| - tests for priviledge drop statements | |
| - basic test for RELP with TLS | |
| - some previously disabled tests have been re-enabled | |
| - dynamic stats subsystem: a couple of smaller changes | |
| they also involve the format, which is slightly incompatible to | |
| previous version. As this was out only very recently (last version), | |
| we considered this as acceptable. | |
| Thanks to Janmejay Singh for developing this. | |
| - foreach loop: now also iterates over objects (not just arrays) | |
| Thanks to Janmejay Singh for developing this. | |
| - improvements to the CI environment | |
| - enhancement: queue subsystem is more robst in regard to some corruptions | |
| It is now detected if a .qi file states that the queue contains more | |
| records than there are actually inside the queue files. Previously this | |
| resulted in an emergency switch to direct mode, now the problem is only | |
| reported but processing continues. | |
| - enhancement: Allow rsyslog to bind UDP ports even w/out specific | |
| interface being up at the moment. | |
| Alternatively, rsyslog could be ordered after networking, however, | |
| that might have some negative side effects. Also IP_FREEBIND is | |
| recommended by systemd documentation. | |
| Thanks to Nirmoy Das and Marius Tomaschewski for the patch. | |
| - cleanup: removed no longer needed json-c compatibility layer | |
| as we now always use libfastjson, we do not need to support old | |
| versions of json-c (libfastjson was based on the newest json-c | |
| version at the time of the fork, which is the newest in regard | |
| to the compatibility layer) | |
| - new External plugin for sending metrics to SPM Monitoring SaaS | |
| Thanks to Radu Gheorghe for the patch. | |
| - bugfix imfile: fix memory corruption bug when appending @cee | |
| Thanks to Brian Knox for the patch. | |
| - bugfix: memory misallocation if position.from and position.to is used | |
| a negative amount of memory is tried to be allocated if position.from | |
| is smaller than the buffer size (at least with json variables). This | |
| usually leads to a segfault. | |
| closes https://github.com/rsyslog/rsyslog/issues/915 | |
| - bugfix: fix potential memleak in TCP allowed sender definition | |
| depending on circumstances, a very small leak could happen on each | |
| HUP. This was caused by an invalid macro definition which did not rule | |
| out side effects. | |
| - bugfix: $PrivDropToGroupID actually did a name lookup | |
| ... instead of using the provided ID | |
| - bugfix: small memory leak in imfile | |
| Thanks to Tomas Heinrich for the patch. | |
| - bugfix: double free in jsonmesg template | |
| There has to be actual json data in the message (from mmjsonparse, | |
| mmnormalize, imjournal, ...) to trigger the crash. | |
| Thanks to Tomas Heinrich for the patch. | |
| - bugfix: incorrect formatting of stats when CEE/Json format is used | |
| This lead to ill-formed json being generated | |
| - bugfix omfwd: new-style keepalive action parameters did not work | |
| due to being inconsistently spelled inside the code. Note that legacy | |
| parameters $keepalive... always worked | |
| see also: https://github.com/rsyslog/rsyslog/issues/916 | |
| Thanks to Devin Christensen for alerting us and an analysis of the | |
| root cause. | |
| - bugfix: memory leaks in logctl utility | |
| Detected by clang static analyzer. Note that these leaks CAN happen in | |
| practice and may even be pretty large. This was probably never detected | |
| because the tool is not often used. | |
| - bugfix omrelp: fix segfault if no port action parameter was given | |
| closes https://github.com/rsyslog/rsyslog/issues/911 | |
| - bugfix imtcp: Messages not terminated by a NL were discarded | |
| ... upon connection termination. | |
| Thanks to Tomas Heinrich for the patch. | |
| ------------------------------------------------------------------------------ | |
| Version 8.17.0 [v8-stable] 2016-03-08 | |
| - NEW REQUIREMENT: libfastjson | |
| see also: | |
| http://blog.gerhards.net/2015/12/rsyslog-and-liblognorm-will-switch-to.html | |
| - new testbench requirement: faketime command line tool | |
| This is used to generate a controlled environment for time-based tests; if | |
| not available, tests will gracefully be skipped. | |
| - improve json variable performance | |
| We use libfastjson's alternative hash function, which has been | |
| proven to be much faster than the default one (which stems | |
| back to libjson-c). This should bring an overall performance | |
| improvement for all operations involving variable processing. | |
| closes https://github.com/rsyslog/rsyslog/issues/848 | |
| - new experimental feature: lookup table suport | |
| Note that at this time, this is an experimental feature which is not yet | |
| fully supported by the rsyslog team. It is introduced in order to gain | |
| more feedback and to make it available as early as possible because many | |
| people consider it useful. | |
| Thanks to Janmejay Singh for implementing this feature | |
| - new feature: dynamic statistics counters | |
| which may be changed during rule processing | |
| Thanks to Janmejay Singh for suggesting and implementing this feature | |
| - new contributed plugin: omampq1 for AMQP 1.0-compliant brokers | |
| Thanks to Ken Giusti for this module | |
| - new set of UTC-based $now family of variables ($now-utc, $year-utc, ...) | |
| - simplified locking when accessing message and local variables | |
| this simlifies the code and slightly increases performance if such | |
| variables are heavily accessed. | |
| - new global parameter "debug.unloadModules" | |
| This permits to disable unloading of modules, e.g. to make valgrind | |
| reports more useful (without a need to recompile). | |
| - timestamp handling: guard against invalid dates | |
| We do not permit dates outside of the year 1970..2100 | |
| interval. Note that network-receivers do already guard | |
| against this, so the new guard only guards against invalid | |
| system time. | |
| - imfile: add "trimlineoverbytes" input paramter | |
| Thanks to github user JindongChen for the patch. | |
| - ommongodb: add support for extended json format for dates | |
| Thanks to Florian Bücklers for the patch. | |
| - omjournal: add support for templates | |
| see also: https://github.com/rsyslog/rsyslog/pull/770 | |
| Thanks to github user bobthemighty for the patch | |
| - imuxsock: add "ruleset" input parameter | |
| - testbench: framework improvement: configs can be included in test file | |
| they do no longer need to be in a separate file, which saves a bit | |
| of work when working with them. This is supported for simple tests with | |
| a single running rsyslog instance | |
| Thanks to Janmejay Singh for inspiring me with a similar method in | |
| liblognorm testbench. | |
| - imptcp: performance improvements | |
| Thanks to Janmejay Singh for implementing this improvement | |
| - made build compile (almost) without warnings | |
| still some warnings are suppressed where this is currently required | |
| - improve interface definition in some modules, e.g. mmanon, mmsequence | |
| This is more an internal cleanup and should have no actual affect to | |
| the end user. | |
| - solaris build: MAXHOSTNAMELEN properly detected | |
| - build system improvement: ability to detect old hiredis libs | |
| This permits to automatically build omhiredis on systems where the | |
| hiredis libs do not provide a pkgconfig file. Previsouly, this | |
| required manual configuration. | |
| Thanks to github user jaymell for the patch. | |
| - rsgtutil: dump mode improvements | |
| * auto-detect signature file type | |
| * ability to dump hash chains for log extraction files | |
| - build system: fix build issues with clang | |
| clang builds often failed with a missing external symbol | |
| "rpl_malloc". This was caused by checks in configure.ac, | |
| which checked for specific GNU semantics. As we do not need | |
| them (we never ask malloc for zero bytes), we can safely | |
| remove the macros. | |
| Note that we routinely run clang static analyer in CI and | |
| it also detects such calls as invalid. | |
| closes https://github.com/rsyslog/rsyslog/issues/834 | |
| - bugfix: unixtimestamp date format was incorrectly computed | |
| The problem happened in leap year from March til then end | |
| of year and healed itself at the begining of the next year. | |
| During the problem period, the timestamp was 24 hours too low. | |
| fixes https://github.com/rsyslog/rsyslog/issues/830 | |
| - bugfix: date-ordinal date format was incorrectly computed | |
| same root cause aus for unixtimestamp and same triggering | |
| condition. During the affected perido, the ordinal was one | |
| too less. | |
| - bugfix: some race when shutting down input module threads | |
| this had little, if at all, effect on real deployments as it resulted | |
| in a small leak right before rsyslog termination. However, it caused | |
| trouble with the testbench (and other QA tools). | |
| Thanks to Peter Portante for the patch and both Peter and Janmejay | |
| Singh for helping to analyze what was going on. | |
| - bugfix tcpflood: did not handle connection drops correct in TLS case | |
| note that tcpflood is a testbench too. The bug caused some testbench | |
| instability, but had no effect on deplyments. | |
| - bugfix: abort if global parameter value was wrong | |
| If so, the abort happened during startup. Once started, | |
| all was stable. | |
| - bugfix omkafka: fix potential NULL pointer addressing | |
| this happened when the topic cache was full and an entry | |
| needed to be evicted | |
| - bugfix impstats: @cee cookie was prefixed to wrong fromat (json vs. cee) | |
| Thanks to Volker Fröhlich for the fix. | |
| - bugfix imfile: fix race during startup that could lead to some duplication | |
| If a to-be-monitored file was created after inotify was initialized | |
| but before startup was completed, the first chunk of data from this | |
| file could be duplicated. This should have happened very rarely in | |
| practice, but caused occasional testbench failures. | |
| see also: https://github.com/rsyslog/rsyslog/issues/791 | |
| - bugfix: potential loss of single message at queue shutdown | |
| see also: https://github.com/rsyslog/rsyslog/issues/262 | |
| - bugfix: potential deadlock with heavy variable access | |
| When making havy use of global, local and message variables, a deadlock | |
| could occur. While it is extremly unlikely to happen, we have at least | |
| seen one incarnation of this problem in practice. | |
| - bugfix ommysql: on some platforms, serverport parameter had no effect | |
| This was caused by an invalid code sequence which's outcome depends on | |
| compiler settings. | |
| - bugfix omelasticsearch: invalid pointer dereference | |
| The actual practical impact is not clear. This came up when working | |
| on compiler warnings. | |
| Thanks to David Lang for the patch. | |
| - bugfix omhiredis: serverport config parameter did not reliably work | |
| depended on environment/compiler used to build | |
| - bugfix rsgtutil: -h command line option did not work | |
| Thanks to Henri Lakk for the patch. | |
| - bugfix lexer: hex numbers were not properly represented | |
| see: https://github.com/rsyslog/rsyslog/pull/771 | |
| Thanks to Sam Hanes for the patch. | |
| - bugfix TLS syslog: intermittent errors while sending data | |
| Regression from commit 1394e0b. A symptom often seen was the message | |
| "unexpected GnuTLS error -50 in nsd_gtls.c:530" | |
| - bugfix imfile: abort on startup if no slash was present in file name param | |
| Thanks to Brian Knox for the patch. | |
| - bugfix rsgtutil: fixed abort when using short command line options | |
| Thanks to Henri Lakk | |
| - bugfix rsgtutil: invalid computation of log record extraction file | |
| This caused verification to fail because the hash chain was actually | |
| incorrect. Depended on the input data set. | |
| closes https://github.com/rsyslog/rsyslog/issues/832 | |
| - bugfix build system: KSI components could only be build if in default path | |
| ------------------------------------------------------------------------------ | |
| Version 8.16.0 [v8-stable] 2016-01-26 | |
| - rsgtutil: Added extraction support including loglines and hash chains. | |
| More details on how to extract loglines can be found in the rsgtutil | |
| manpage. See also: https://github.com/rsyslog/rsyslog/issues/561 | |
| - clean up doAction output module interface | |
| We started with char * pointers, but used different types of pointers | |
| over time. This lead to alignment warnings. In practice, I think this | |
| should never cause any problems (at least there have been no reports | |
| in the 7 or so years we do this), but it is not clean. The interface is | |
| now cleaned up. We do this in a way that does not require modifications | |
| to modules that just use string parameters. For those with message | |
| parameters, have a look at e.g. mmutf8fix to see how easy the | |
| required change is. | |
| - new system properties for $NOW properties based on UTC | |
| This permits to express current system time in UTC. | |
| See also https://github.com/rsyslog/rsyslog/issues/729 | |
| - impstats: support broken ElasticSearch JSON implementation | |
| ES 2.0 no longer supports valid JSON and disallows dots inside names. | |
| This adds a new "json-elasticsearch" format option which replaces | |
| those dots by the bang ("!") character. So "discarded.full" becomes | |
| "discarded!full". | |
| This is a workaroud. A method that will provide more control over | |
| replacements will be implemented some time in the future. For | |
| details, see below-quoted issue tracker. | |
| closes https://github.com/rsyslog/rsyslog/issues/713 | |
| - omelasticsearch: craft better URLs | |
| Elasticsearch is confused by url's ending in a bare '?' or '&'. While | |
| this is valid, those are no longer produced. | |
| Thanks to Benno Evers for the patch. | |
| - imfile: add experimental "reopenOnTruncate" parameter | |
| Thanks to Matthew Wang for the patch. | |
| - bugfix imfile: proper handling of inotify initialization failure | |
| Thanks to Zachary Zhao for the patch. | |
| - bugfix imfile: potential segfault due to improper handling of ev var | |
| This occurs in inotify mode, only. | |
| Thanks to Zachary Zhao and Peter Portante for the patch. | |
| closes https://github.com/rsyslog/rsyslog/issues/718 | |
| - bugfix imfile: potential segfault under heavey load. | |
| This occurs in inotify mode when using wildcards, only. | |
| The root cause is dropped IN_IGNOPRED inotify events which be dropped | |
| in circumstance of high input pressure and frequent rotation, and | |
| according to wikipeida, they can also be dropped in other conditions. | |
| Thanks to Zachary Zhao for the patch. | |
| closes https://github.com/rsyslog/rsyslog/issues/723 | |
| - bugfix ommail: invalid handling of server response | |
| if that response was split into different read calls. Could lead to | |
| error-termination of send operation. Problem is pretty unlikely to | |
| occur in standard setups (requires slow connection to SMTP server). | |
| Thank to github user haixingood for the patch. | |
| - bugfix omelasticsearch: custom serverport was ignored on some platforms | |
| Thanks to Benno Evers for the patch. | |
| - bugfix: tarball did not include some testbench files | |
| Thanks to Thomas D. (whissi) for the patch. | |
| - bugfix: memory misadressing during config parsing string template | |
| This occurred if an (invalid) template option larger than 63 characters | |
| was given. | |
| Thanks to git hub user c6226 for the patch. | |
| - bugfix imzmq: memory leak | |
| Thanks to Jeremy Liang for the patch. | |
| - bugfix imzmq: memory leak | |
| Thanks to github user xushengping for the patch. | |
| - bugfix omzmq: memory leak | |
| Thanks to Jack Lin for the patch. | |
| - some code improvement and cleanup | |
| ------------------------------------------------------------------------------ | |
| Version 8.15.0 [v8-stable] 2015-12-15 | |
| - KSI Lib: Updated code to run with libksi 3.4.0.5 | |
| Also libksi 3.4.0.x is required to build rsyslog if ksi support | |
| is enabled. New libpackages have been build as well. | |
| - KSI utilities: Added option to ser publication url. | |
| Since libksi 3.4.0.x, there is no default publication url anymore. | |
| The publication url has to be set using the --publications-server | |
| Parameter, otherwise the ksi signature cannot be verified. UserID | |
| and UserKey can also be set by parameter now. | |
| Closes https://github.com/rsyslog/rsyslog/issues/581 | |
| - KSI Lib: Fixed wrong TLV container for KSI signatures from 0905 to 0906. | |
| closes https://github.com/rsyslog/rsyslog/issues/587 | |
| - KSI/GT Lib: Fixed multiple issues found using static analyzer | |
| - performance improvement for configs with heavy use of JSON variables | |
| Depending on the config, this can be a very big gain in performance. | |
| - added pmpanngfw: contributed module for translating Palo Alto Networks logs. | |
| see also: https://github.com/rsyslog/rsyslog/pull/573 | |
| Thanks to Luigi Mori for the contribution. | |
| - testbench: Changed valgrind option for imtcp-tls-basic-vg.sh | |
| For details see: https://github.com/rsyslog/rsyslog/pull/569 | |
| - pmciscoios: support for asterisk before timestamp added | |
| thanks to github user c0by for the patch | |
| see also: https://github.com/rsyslog/rsyslog/pull/583 | |
| - solr external output plugin much enhanced | |
| see also: https://github.com/rsyslog/rsyslog/pull/529 | |
| Thanks to Radu Gheorghe for the patch. | |
| - omrabbitmq: improvements | |
| thanks to Luigi Mori for the patch | |
| see also: https://github.com/rsyslog/rsyslog/pull/580 | |
| - add support for libfastjson (as a replacement for json-c) | |
| - KSI utilities: somewhat improved error messages | |
| Thanks to Henri Lakk for the patch. | |
| see also: https://github.com/rsyslog/rsyslog/pull/588 | |
| - pmciscoios: support for some format variations | |
| Thanks to github user c0by for the patch | |
| - support grok via new contributed module mmgrok | |
| Thanks to 饶琛琳 (github user chenryn) for the contribution. | |
| - omkafka: new statistics counter "maxoutqsize" | |
| Thanks to 饶琛琳 (github user chenryn) for the contribution. | |
| - improvments for 0mq modules: | |
| * omczmq - suspend / Retry handling - the output plugin can now recover | |
| from some error states due to issues with plugin startup or message sending | |
| * omczmq - refactored topic handling code for ZMQ_PUB output to be a little | |
| more efficient | |
| * omczmq - added ability to set a timeout for sends | |
| * omczmq - set topics can be in separate frame (default) or part of message | |
| frame (configurable) | |
| * omcmzq - code cleanup | |
| * imczmq - code cleanup | |
| * imczmq - fixed a couple of cases where vars could be used uninitialized | |
| * imczmq - ZMQ_ROUTER support | |
| * imczmq - Fix small memory leak from not freeing sockets when done with them | |
| * allow creation of on demand ephemeral CurveZMQ certs for encryption. | |
| Clients may specify clientcertpath="*" to indicate they want an on | |
| demand generated cert. | |
| Thanks to Brian Knox for the contributions. | |
| - cleanup on code to unset a variable | |
| under extreme cases (very, very unlikely), the old code could also lead | |
| to errornous processing | |
| - omelasticsearch: build on FreeBSD | |
| Thanks to github user c0by for the patch | |
| - pmciscoios: fix some small issues clang static analyzer detected | |
| - testbench: many improvements and some new tests | |
| note that there still is a number of tests which are somewhat racy | |
| - overall code improvements thanks to clang static analyzer | |
| - gnutls fix: Added possible fix for gnutls issue #575 | |
| see also: https://github.com/rsyslog/rsyslog/issues/575 | |
| Thanks to Charles Southerland for the patch | |
| - bugfix omkafka: restore ability to build on all platforms | |
| Undo commit aea09800643343ab8b6aa205b0f10a4be676643b | |
| because that lead to build failures on various important platforms. | |
| This means it currently is not possible to configure the location | |
| of librdkafka, but that will affect far fewer people. | |
| closes: https://github.com/rsyslog/rsyslog/issues/596 | |
| - bugfix omkafka: fix potentially negative partition number | |
| Thanks to Tait Clarridge for providing a patch. | |
| - bugfix: solve potential race in creation of additional action workers | |
| Under extreme circumstances, this could lead to segfault. Note that we | |
| detected this problem thanks to ASAN address sanitzier in combination | |
| with a very exterme testbench test. We do not think that this issue | |
| was ever reported in practice. | |
| - bugfix: potential memory leak in config parsing | |
| Thanks to github user linmujia for the patch | |
| - bugfix: small memory leak in loading template config | |
| This happened when a plugin was used inside the template. Then, the | |
| memory for the template name was never freed. | |
| Thanks to github user xushengping for the fix. | |
| - bugfix: fix extra whitespace in property expansions | |
| Address off-by-one issues introduced in f3bd7a2 resulting in extra | |
| whitespace in property expansions | |
| Thanks to Matthew Gabeler-Lee for the patch. | |
| - bugfix: mmfields leaked memory if very large messages were processed | |
| detected by clang static analyzer | |
| - bugfix: mmfields could add garbagge data to field | |
| this happened when very large fields were to be processed. | |
| Thanks to Peter Portante for reporting this. | |
| - bugfix: omhttpfs now also compiles with older json-c lib | |
| - bugfix: memory leak in (contributed) module omhttpfs | |
| Thanks to git hub user c6226 for the patch. | |
| - bugfix: parameter mismatch in error message for wrap() function | |
| - bugfix: parameter mismatch in error message for random() function | |
| - bugfix: divide by zero if max() function was provided zero | |
| - bugfix: invalid mutex handling in omfile async write mode | |
| could lead to segfault, even though highly unlikely (caught by | |
| testbench on a single platform) | |
| - bugfix: fix inconsistent number processing | |
| Unfortunately, previous versions of the rule engine tried to | |
| support oct and hex, but that wasn't really the case. | |
| Everything based on JSON was just dec-converted. As this was/is | |
| the norm, we fix that inconsistency by always using dec. | |
| Luckly, oct and hex support was never documented and could | |
| probably only have been activated by constant numbers. | |
| - bugfix: timezone() object: fix NULL pointer dereference | |
| This happened during startup when the offset or id parameter was not | |
| given. Could lead to a segfault at startup. | |
| Detected by clang static analyzer. | |
| - bugfix omfile: memory addressing error if very long outchannel name used | |
| Thanks to github user c6226 for the patch. | |
| ------------------------------------------------------------------------------ | |
| Version 8.14.0 [v8-stable] 2015-11-03 | |
| - Added possibility to customize librdkafka location | |
| see also: https://github.com/rsyslog/rsyslog/pull/502 | |
| Thanks to Matthew Wang for the patch. | |
| - add property "rawmsg-after-pri" | |
| - bugfix: potential misadresseing in imfile | |
| Could happen when wildcards were used. | |
| see also https://github.com/rsyslog/rsyslog/issues/532 | |
| see also https://github.com/rsyslog/rsyslog/issues/534 | |
| Thanks to zhangdaoling for the bugfix. | |
| - bugfix: re_extract RainerScript function did not work | |
| Thanks to Janmejay Singh for the patch | |
| ------------------------------------------------------------------------------ | |
| Version 8.13.0 [v8-stable] 2015-09-22 | |
| - ZeroMQ enhancements: | |
| * Added the ability to set a static publishing topic per action as an | |
| alternative to constructing topics with templates | |
| Contributor: Luca Bocassi | |
| * ZMQ_PUB socket now defaults to bind and ZMQ_SUB socket now defaults to | |
| connect - Contributor: Luca Bocassi | |
| - Redis enhancements: | |
| * Can now LPUSH to a Redis list in "queue" mode - Contributor: Brian Knox | |
| * Can now PUBLISH to a Redis channel in "publish" mode | |
| Contributor: Brian Knox | |
| - build requirement for rsyslog/mmnormalize is now liblognorm 1.1.2 or above | |
| - mmnormalize: liblognorm error messages are now emitted via regular | |
| rsyslog error reporting mechanism (aka "are now logged") | |
| This is possible due to a new API in liblognorm 1.1.2; | |
| Note that the amount of error messages depends on the version of | |
| liblognorm used. | |
| - add support for TCP client side keep-alives | |
| Thanks to github user tinselcity for the patch. | |
| - bugfix: imtcp/TLS hangs on dropped packets | |
| see also https://github.com/rsyslog/rsyslog/issues/318 | |
| Thanks to github user tinselcity for the patch. | |
| - bugfix testbench: some tests using imptcp are run if module is disabled | |
| Thanks to Michael Biebl for reporting this | |
| see also https://github.com/rsyslog/rsyslog/issues/524 | |
| - bugfix omkafka: Fixes a bug not accepting new messages anymore. | |
| see also: https://github.com/rsyslog/rsyslog/pull/472 | |
| Thanks to Janmejay Singh | |
| - bugfix: Parallel build issue "cannot find ../runtime/.libs/librsyslog.a: | |
| No such file or directory" (#479) fixed. | |
| Thanks to Thomas D. (Whissi) for the patch. | |
| - bugfix: Added missing mmpstructdata testfiles into makefile. | |
| see also: https://github.com/rsyslog/rsyslog/issues/484 | |
| - bugfix: Reverted FIX for issue #392 as it had unexpected side effects. | |
| The new fix duplicates the Listener object for static files (like | |
| done for dynamic files already), resolving issue #392 and #490. | |
| see also https://github.com/rsyslog/rsyslog/pull/490 | |
| - bugfix: issues in queue subsystem if syncqueuefiles was enabled | |
| * Error 14 was generated on the .qi file directory handle. | |
| As the .qi filestream does not have a directory set, fsync | |
| was called on an empty directory causing a error 14 in debug log. | |
| * When queue files existed on startup, the bSyncQueueFiles | |
| strm property was not set to 1. This is now done in the | |
| qqueueLoadPersStrmInfoFixup function. | |
| - bugfix/testbench: tcpflood tool could abort when random data was added | |
| see also: https://github.com/rsyslog/rsyslog/issues/506 | |
| Thanks to Louis Bouchard for the fix | |
| - rscryutil: Added support to decrypt a not closed log file. | |
| Thanks to wizard1024 for the patch. | |
| ------------------------------------------------------------------------------ | |
| Version 8.12.0 [v8-stable] 2015-08-11 | |
| - Harmonize resetConfigVariables values and defaults | |
| see also https://github.com/rsyslog/rsyslog/pull/413 | |
| Thanks to Tomas Heinrich for the patch. | |
| - GT/KSI: fix some issues in signature file format and add conversion tool | |
| The file format is incompatible to previous format, but tools have been | |
| upgraded to handle both and also an option been added to convert from | |
| old to new format. | |
| - bugfix: ommysql did not work when gnutls was enabled | |
| as it turned out, this was due to a check for GnuTLS functions | |
| with the side-effect that | |
| AC_CHECK_LIB, by default, adds the lib to LIBS, if there is no | |
| explicit action, what was the case here. So everything was now | |
| linked against GnuTLS, which in turn made ommysql fail. | |
| Thanks to Thomas D. (whissi) for the analysis of the ommysql/gnutls | |
| problem and Thomas Heinrich for pointing out that AC_CHECK_LIB might | |
| be the culprit. | |
| - bugfix omfile: potential memory leak on file close | |
| see also: https://github.com/rsyslog/rsyslog/pull/423 | |
| Thanks to Robert Schiele for the patch. | |
| - bugfix omfile: potential race in dynafile detection/creation | |
| This could lead to a segfault. | |
| Thanks to Tomas Heinrich for the patch. | |
| - bugfix omfile: Fix race-condition detection in path-creation code | |
| The affected code is used to detect a race condition in between | |
| testing for the existence of a directory and creating it if it didn't | |
| exist. The variable tracking the number of attempts wasn't reset for | |
| subsequent elements in the path, thus limiting the number of | |
| reattempts to one per the whole path, instead of one per each path | |
| element. | |
| This solution was provided by Martin Poole. | |
| - bugfix parser subsystem: potential misadressing in SanitizeMsg() | |
| could lead to a segfault | |
| Thanks to Tomas Heinrich for the patch. | |
| - imfile: files moved outside of directory are now (properly) handled | |
| - bugfix: imfile: segfault when using startmsg.regex if first log line | |
| doesn't match | |
| Thanks to Ciprian Hacman for the patch. | |
| - bugfix imfile: file table was corrupted when on file deletion | |
| This could happen when a file that was statically configured (not via an | |
| wildcard) was deleted. | |
| - bugfix ompgsql: transaction were improperly handled | |
| now transaction support is solidly disabled until we have enough requests | |
| to implement it again. Module still works fine in single insert mode. | |
| closes https://github.com/rsyslog/rsyslog/issues/399 | |
| - bugfix mmjsonparse: memory leak if non-cee-json message is processed | |
| see also https://github.com/rsyslog/rsyslog/pull/383 | |
| Thanks to Anton Matveenko for the patch | |
| - testbench: remove raciness from UDP based tests | |
| - testbench: added bash into all scripts makign it mandatory | |
| - bugfix testbench: Fixed problem building syslog_caller util when | |
| liblogging-stdlog is not available. | |
| Thanks to Louis Bouchard for the patch | |
| - bugfix rscryutil.1: Added fix checking for generate_man_pages condition | |
| Thanks to Radovan Sroka for the patch | |
| - bugfix freebsd console: \n (NL) is prepended with \r (CR) in console | |
| output on freebsd only. For more details see here: | |
| https://github.com/rsyslog/rsyslog/issues/372 | |
| Thanks to AlexandreFenyo for the patch | |
| ------------------------------------------------------------------------------ | |
| Version 8.11.0 [v8-stable] 2015-06-30 | |
| - new signature provider for Keyless Signature Infrastructure (KSI) added | |
| - build system: re-enable use of "make distcheck" | |
| - add new signature provider for Kesless Signature Infrastructure (KSI) | |
| This has also been added to existing tooling; KSI is kind of v2 of | |
| the Guardtime functionality and has been added in the appropriate | |
| places. | |
| - bugfix imfile: regex multiline mode ignored escapeLF option | |
| Thanks to Ciprian Hacman for reporting the problem | |
| closes https://github.com/rsyslog/rsyslog/issues/370 | |
| - bugfix omkafka: fixed several concurrency issues, most of them related | |
| to dynamic topics. | |
| Thanks to Janmejay Singh for the patch. | |
| - bugfix: execonlywhenpreviousissuspended did not work correctly | |
| This especially caused problems when an action with this attribute was | |
| configured with an action queue. | |
| - bugfix core engine: ensured global variable atomicity | |
| This could lead to problems in RainerScript, as well as probably in other | |
| areas where global variables are used inside rsyslog. I wouldn't outrule | |
| it could lead to segfaults. | |
| Thanks to Janmejay Singh for the patch. | |
| - bugfix imfile: segfault when using startmsg.regex because of empty log line | |
| closes https://github.com/rsyslog/rsyslog/issues/357 | |
| Thanks to Ciprian Hacman for the patch. | |
| - bugfix: build problem on Solaris | |
| Thanks to Dagobert Michelsen for reporting this and getting us up to | |
| speed on the openCWS build farm. | |
| - bugfix: build system strndup was used even if not present | |
| now added compatibility function. This came up on Solaris builds. | |
| Thanks to Dagobert Michelsen for reporting the problem. | |
| closes https://github.com/rsyslog/rsyslog/issues/347 | |
| - bugfix imjournal: do not pass empty messages to rsyslog core | |
| this causes a crash of the daemon | |
| see also https://github.com/rsyslog/rsyslog/pull/412 | |
| Thanks to Tomas Heinrich for the patch. | |
| - bugfix imjournal: cosmetic memory leak | |
| very small and an shutdown only, so did not affect operations | |
| see also https://github.com/rsyslog/rsyslog/pull/411 | |
| Thanks to Tomas Heinrich for the patch. | |
| ------------------------------------------------------------------------------ | |
| Version 8.10.0 [v8-stable] 2015-05-19 | |
| - imfile: add capability to process multi-line messages based on regex | |
| input parameter "endmsg.regex" was added for that purpose. The new | |
| mode provides much more power in processing different multiline-formats. | |
| - pmrfc3164: add new parameters | |
| * "detect.yearAfterTimestamp" | |
| This supports timestamps as generated e.g. by some Aruba Networks | |
| equipment. | |
| * "permit.squareBracesInHostname" | |
| Permits to use "hostnames" in the form of "[127.0.0.1]"; also seen in | |
| Aruba Networks equipment, but we strongly assume this can also happen | |
| in other cases, especially with IPv6. | |
| - supplementary groups are now set when dropping privileges | |
| closes https://github.com/rsyslog/rsyslog/issues/296 | |
| Thanks to Zach Lisinski for the patch. | |
| - imfile: added brace glob expansion to wildcard | |
| Thanks to Zach Lisinski for the patch. | |
| - zmq: add the ability for zeromq input and outputs to advertise their | |
| presence on UDP via the zbeacon API. | |
| Thanks to Brian Knox for the contribution. | |
| - added omhttpfs: contributed module for writing to HDFS via HTTP | |
| Thanks to sskaje for the contribution. | |
| - Configure option "--disable-debug-symbols" added which is disabled per | |
| default. If you set the new option, configure won't set the appropriate | |
| compiler flag to generate debug symbols anymore. | |
| - When building from git source we now require rst2man and yacc (or a | |
| replacement like bison). | |
| That isn't any new requirement, we only added missing configure checks. | |
| - Configure option "--enable-generate-man-pages" is now disabled for non git | |
| source builds per default but enforced when building from git source. | |
| - mmpstrucdata: some code cleanup | |
| removed lots of early development debug outputs | |
| - bugfix imuxsock: fix a memory leak that happened with large messages | |
| ... when annotation was enabled. | |
| Thanks to github user c6226 for the patch | |
| - bugfix omhttpfs: memory leak | |
| Thanks to github user c6226 for the patch | |
| - bugfix imuxsock: fix a crash when setting a hostname | |
| Setting a hostname via the legacy directive would lead to a crash | |
| during shutdown caused by a double-free. | |
| Thanks to Tomas Heinrich for the patch. | |
| - bugfix: memory leak in mmpstrucdata | |
| Thanks to Grégoire Seux for reporting this issue. | |
| closes https://github.com/rsyslog/rsyslog/issues/310 | |
| - bugfix (minor): default action name: assigned number was one off | |
| see also https://github.com/rsyslog/rsyslog/pull/340 | |
| Thanks to Tomas Heinrich for the patch. | |
| - bugfix: memory leak in imfile | |
| A small leak happened each time a new file was monitored based on | |
| a wildcard. Depending on the rate of file creation, this could result | |
| in a serious memory leak. | |
| ------------------------------------------------------------------------------ | |
| Version 8.9.0 [v8-stable] 2015-04-07 | |
| - omprog: add option "hup.forward" to forwards HUP to external plugins | |
| This was suggested by David Lang so that external plugins (and other | |
| programs) can also do HUP-specific processing. The default is not | |
| to forward HUP, so no change of behavior by default. | |
| - imuxsock: added capability to use regular parser chain | |
| Previously, this was a fixed format, that was known to be spoken on | |
| the system log socket. This also adds new parameters: | |
| - sysSock.useSpecialParser module parameter | |
| - sysSock.parseHostname module parameter | |
| - useSpecialParser input parameter | |
| - parseHostname input parameter | |
| - 0mq: improvements in input and output modules | |
| See module READMEs, part is to be considered experimental. | |
| Thanks to Brian Knox for the contribution. | |
| - imtcp: add support for ip based bind for imtcp -> param "address" | |
| Thanks to github user crackytsi for the patch. | |
| - bugfix: MsgDeserialize out of sync with MsgSerialize for StrucData | |
| This lead to failure of disk queue processing when structured data was | |
| present. Thanks to github user adrush for the fix. | |
| - bugfix imfile: partial data loss, especially in readMode != 0 | |
| closes https://github.com/rsyslog/rsyslog/issues/144 | |
| - bugfix: potential large memory consumption with failed actions | |
| see also https://github.com/rsyslog/rsyslog/issues/253 | |
| - bugfix: omudpspoof: invalid default send template in RainerScript format | |
| The file format template was used, which obviously does not work for | |
| forwarding. Thanks to Christopher Racky for alerting us. | |
| closes https://github.com/rsyslog/rsyslog/issues/268 | |
| - bugfix: size-based legacy config statements did not work properly | |
| on some platforms, they were incorrectly handled, resulting in all | |
| sorts of "interesting" effects (up to segfault on startup) | |
| - build system: added option --without-valgrind-testbench | |
| ... which provides the capability to either enforce or turn off | |
| valgrind use inside the testbench. Thanks to whissi for the patch. | |
| - rsyslogd: fix misleading typos in error messages | |
| Thanks to Ansgar Püster for the fixes. | |
| ------------------------------------------------------------------------------ | |
| Version 8.8.0 [v8-stable] 2015-02-24 | |
| - omkafka: add support for dynamic topics and auto partitioning | |
| Thanks to Tait Clarridge for the patches. | |
| - imtcp/imptcp: support for broken Cisco ASA TCP syslog framing | |
| - omfwd: more detailled error messages in case of UDP send error | |
| - TLS syslog: enable capability to turn on GnuTLS debug logging | |
| This provides better diagnostics in hard-to-diagnose cases, | |
| especially when GnuTLS is extra-picky about certificates. | |
| - bugfix: $AbortOnUncleanConfig did not work | |
| - improve rsyslogd -v output and error message with meta information | |
| version number is now contained in error message and build platform in | |
| version output. This helps to gets rid of the usual "which version" | |
| question on mailing list, support forums, etc... | |
| - bugfix imtcp: octet-counted framing cannot be turned off | |
| - bugfix: build problems on Illuminos | |
| Thanks to Andrew Stormont for the patch | |
| - bugfix: invalid data size for iMaxLine global property | |
| It was defined as int, but inside the config system it was declared as | |
| size type, which uses int64_t. With legacy config statements, this could | |
| lead to misadressing, which usually meant the another config variable was | |
| overwritten (depending on memory layout). | |
| closes https://github.com/rsyslog/rsyslog/issues/205 | |
| - bugfix: negative values for maxMessageSize global parameter were permitted | |
| ------------------------------------------------------------------------------ | |
| Version 8.7.0 [v8-stable] 2015-01-13 | |
| - add message metadata "system" to msg object | |
| this permits to store metadata alongside the message | |
| - imfile: add support for "filename" metadata | |
| this is useful in cases where wildcards are used | |
| - imptcp: make stats counter names consistent with what imudp, imtcp uses | |
| - added new module "omkafka" to support writing to Apache Kafka | |
| - omfwd: add new "udp.senddelay" parameter | |
| - mmnormalize enhancements | |
| Thanks to Janmejay Singh for the patch. | |
| - RainerScript "foreach" iterator and array reading support | |
| Thanks to Janmejay Singh for the patch. | |
| - now requires liblognorm >= 1.0.2 | |
| - add support for systemd >= 209 library names | |
| - BSD "ntp" facility (value 12) is now also supported in filter | |
| Thanks to Douglas K. Rand of Iteris, Inc. for the patch. | |
| Note: this patch was released under ASL 2.0 (see email-conversation). | |
| - bugfix: global(localHostName="xxx") was not respected in all modules | |
| - bugfix: emit correct error message on config-file-not-found | |
| closes https://github.com/rsyslog/rsyslog/issues/173 | |
| - bugfix: impstats emitted invalid JSON format (if JSON was selected) | |
| - bugfix: (small) memory leak in omfile's outchannel code | |
| Thanks to Koral Ilgun for reporting this issue. | |
| - bugfix: imuxsock did not deactivate some code not supported by platform | |
| Among potential other problemns, this caused build failure under Solaris. | |
| Note that this build problem just made a broader problem appear that so | |
| far always existed but was not visible. | |
| closes https://github.com/rsyslog/rsyslog/issues/185 | |
| ------------------------------------------------------------------------------ | |
| Version 8.6.0 [v8-stable] 2014-12-02 | |
| NOTE: This version also incorporates all changes and enhancements made for | |
| v8.5.0, but in a stable release. For details see immediately below. | |
| - configuration-setting rsyslogd command line options deprecated | |
| For most of them, there are now proper configuration objects. Some few | |
| will be completely dropped if nobody insists on them. Additional info at | |
| http://blog.gerhards.net/2014/11/phasing-out-legacy-command-line-options.html | |
| - new and enhanced plugins for 0mq. These are currently experimantal. | |
| Thanks to Brian Knox who contributed the modules and is their author. | |
| - empty rulesets have been permitted. They no longer raise a syntax error. | |
| - add parameter -N3 to enable config check of partial config file | |
| Use for config include files. Disables checking if any action exists at | |
| all. | |
| - rsyslogd -e option has finally been removed | |
| It is deprectated since many years. | |
| - testbench improvements | |
| Testbench is now more robust and has additional tests. | |
| - testbench is now by default disabled | |
| To enable it, use --enable-testbench. This was done as the testbench now | |
| does better checking if required modules are present and this in turn | |
| would lead to configure error messages where non previously were if we | |
| would leave --enable-testbench on by default. Thus we have turned it off. | |
| This should not be an issue for those few testbench users. | |
| - add new RainerScript functions warp() and replace() | |
| Thanks to Singh Janmejay for the patch. | |
| - mmnormalize can now also work on a variable | |
| Thanks to Singh Janmejay for the patch. | |
| - new property date options for day ordinal and week number | |
| Thanks to github user arrjay for the patch | |
| - remove --enable-zlib configure option, we always require it | |
| It's hard to envision a system without zlib, so we turn this off | |
| closes https://github.com/rsyslog/rsyslog/issues/76 | |
| - slight source-tree restructuring: contributed modules are now in their | |
| own ./contrib directory. The idea is to make it clearer to the end user | |
| which plugins are supported by the rsyslog project (those in ./plugins). | |
| - bugfix: imudp makes rsyslog hang on shutdown when more than 1 thread used | |
| closes https://github.com/rsyslog/rsyslog/issues/126 | |
| - bugfix: not all files closed on auto-backgrounding startup | |
| This could happen when not running under systemd. Some low-numbered | |
| fds were not closed in that case. | |
| - bugfix: typo in queue configuration parameter | |
| made parameter unusable | |
| Thanks to Bojan Smojver for the patch. | |
| - bugfix: unitialized buffer off-by-one error in hostname generation | |
| The DNS cache used uninitialized memory, which could lead to | |
| invalid hostname generation. | |
| Thanks to Jarrod Sayers for alerting us and provinding analysis and | |
| patch recommendations. | |
| - bugfix imuxsock: possible segfault when SysSock.Use="off" | |
| Thanks to alexjfisher for reporting this issue. | |
| closes https://github.com/rsyslog/rsyslog/issues/140 | |
| - bugfix: RainerScript: invalid ruleset names were accepted | |
| during ruleset defintion, but could of course not be used when | |
| e.g. calling a ruleset. | |
| IMPORTANT: this may cause existing configurations to error out on start, | |
| as they invalid names could also be used e.g. when assigning rulesets. | |
| - bugfix: some module entry points were not called for all modules | |
| callbacks like endCnfLoad() were primarily being called for input | |
| modules. This has been corrected. Note that this bugfix has some | |
| regression potential. | |
| - bugfix omlibdbi: connection was taken down in wrong thread | |
| this could have consequences depending on the driver being used. In | |
| general, it looks more like a cosmetic issue. For example, with | |
| MySQL it lead to a small memory but also an annoying message about | |
| a thread not properly torn down. | |
| - imttcp was removed because it was an incompleted experimental module | |
| - pmrfc3164sd because it was a custom module nobody used | |
| We used to keep this as a sample inside the tree, but whoever wants | |
| to look at it can check in older versions inside git. | |
| - omoracle was removed because it was orphaned and did not build/work | |
| for quite some years and nobody was interested in fixing it | |
| --------------------------------------------------------------------------- | |
| Version 8.5.0 [v8-stable] 2014-10-24 | |
| - imfile greatly refactored and support for wildcards added | |
| - PRI-handling code refactored for more clarity and robustness | |
| - ommail: add support for RainerScript config system [action() object] | |
| This finally adds support for the new config style. Also, we now permit | |
| to set a constant subject text without the need to create a template for | |
| it. | |
| - refactored the auto-backgrounding method | |
| The code is now more robust and also offers possibilities for enhanced | |
| error reporting in the future. This is also assumed to fix some races | |
| where a system startup script hang due to "hanging" rsyslogd. | |
| - make gntls tcp syslog driver emit more error messages | |
| Messages previously emitted only to the debug log are now emitted as | |
| syslog error messages. It has shown that they contain information | |
| helpful to the user for troubleshooting config issues. Note that this | |
| change is a bit experimental, as we are not sure if there are situations | |
| where large amounts of error messages may be emitted. | |
| - bugfix: imfile did not complain if configured file did not exist | |
| closes https://github.com/rsyslog/rsyslog/issues/137 | |
| - bugfix: build failure on systems which don't have json_tokener_errors | |
| Older versions of json-c need to use a different API (which don't exists | |
| on newer versions, unfortunately...) | |
| Thanks to Thomas D. for reporting this problem. | |
| - imgssapi: log remote peer address in some error messages | |
| Thanks to Bodik for the patch. | |
| --------------------------------------------------------------------------- | |
| Version 8.4.3 [v8-stable] 2014-10-?? | |
| - ommail: minor bugfixes & improvements | |
| * timestamps were 1 hour out when using daylight saving times when | |
| viewing emails in most email clients due to incorrect date format | |
| * X-Mailer header had a typo in it | |
| * To: header was duplicated once per recipient (this is permitted, | |
| but an address list is a better choice nowadays) | |
| Thanks to github user cacheus for the patches. | |
| - bugfix imkmsg: infinite loop on OpenVZ VMs | |
| Thanks to github user PaulSD for the patch | |
| closes https://github.com/rsyslog/rsyslog/pull/138 | |
| - bugfix: typo in queue configuration parameter made parameter unusable | |
| Thanks to Bojan Smojver for the patch. | |
| - bugfix: unitialized buffer off-by-one error in hostname generation | |
| The DNS cache used uninitialized memory, which could lead to | |
| invalid hostname generation. | |
| Thanks to Jarrod Sayers for alerting us and provinding analysis and | |
| patch recommendations. | |
| - bugfix imfile: segfault on startup in "inotify" mode | |
| A segfault happened when more than one file was monitored. | |
| - bugfix imfile: could make rsyslog exit in inotify mode | |
| - bugfix: rsgtutil sometimes crashed in verify mode if file did not exist | |
| - bugfix imklog: pri was miscalculated | |
| actually, the pri was totally off the real value for PRIs > 9 | |
| - bugfix imfile:file processing in inotify mode was stalled sometimes | |
| closes https://github.com/rsyslog/rsyslog/issues/134 | |
| - bugfix: imjournal did not build properly | |
| The build succeeded, but the module did not load due to a type in | |
| a support function name, which kept unresolved during load. | |
| - bugfix: mmcount did no longer build | |
| note that this is untested -- users of this module should file a bug if | |
| the new (trivial) code is broken [if there are any users, thus I did not | |
| invest time in testing...] | |
| closes https://github.com/rsyslog/rsyslog/issues/129 | |
| - bugfix imuxsock: possible segfault when SysSock.Use="off" | |
| Thanks to alexjfisher for reporting this issue. | |
| closes https://github.com/rsyslog/rsyslog/issues/140 | |
| --------------------------------------------------------------------------- | |
| Version 8.4.2 [v8-stable] 2014-10-02 | |
| - bugfix: the fix for CVE-2014-3634 did not handle all cases | |
| This is corrected now. | |
| see also: CVE-2014-3683 | |
| - fixed a build problem on some platforms | |
| Thanks to Olaf for the patch | |
| - behaviour change: "msg" of messages with invalid PRI set to "rawmsg" | |
| When the PRI is invalid, the rest of the header cannot be valid. So | |
| we move all of it to MSG and do not try to parse it out. Note that | |
| this is not directly related to the security issue but rather done | |
| because it makes most sense. | |
| --------------------------------------------------------------------------- | |
| Version 8.4.1 [v8-stable] 2014-09-30 | |
| - imudp: add for bracketing mode, which makes parsing stats easier | |
| - permit at-sign in variable names | |
| closes: https://github.com/rsyslog/rsyslog/issues/110 | |
| - bugfix: fix syntax error in anon_cc_numbers.py script | |
| Thanks to github user anthcourtney for the patch. | |
| closes: https://github.com/rsyslog/rsyslog/issues/109 | |
| - bugfix: ompgsql: don't loose uncomitted data on retry | |
| Thanks to Jared Johnson and Axel Rau for the patch. | |
| - bugfix: imfile: if a state file for a different file name was set, | |
| that different file (name) was monitored instead of the configured | |
| one. Now, the state file is deleted and the correct file monitored. | |
| closes: https://github.com/rsyslog/rsyslog/issues/103 | |
| - bugfix: omudpspoof: source port was invalid | |
| Thanks to Pavel Levshin for the patch | |
| - bugfix: build failure on systems which don't have json_tokener_errors | |
| Older versions of json-c need to use a different API (which don't exists | |
| on newer versions, unfortunately...) | |
| Thanks to Thomas D. for reporting this problem. | |
| - bugfix: omelasticsearch does not work with broken/changed ES 1.0+ API | |
| closes: https://github.com/rsyslog/rsyslog/issues/104 | |
| - bugfix: mmanon did not properly anonymize IP addresses starting with '9' | |
| Thanks to defa-at-so36.net for reporting this problem. | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=529 | |
| - bugfix: build problems on SuSe Linux | |
| Thanks Andreas Stieger for the patch | |
| - bugfix: omelasticsearch error file did not work correctly on ES 1.0+ | |
| due to a breaking change in the ElasticSearch API. | |
| see also: https://github.com/rsyslog/rsyslog/issues/104 | |
| - bugfix: potential abort when a message with PRI > 191 was processed | |
| if the "pri-text" property was used in active templates, this could | |
| be abused to a remote denial of service from permitted senders | |
| see also: CVE-2014-3634 | |
| --------------------------------------------------------------------------- | |
| Version 8.4.0 [v8-stable] 2014-08-18 | |
| - this is the new stable branch, which incorporates all enhancements of | |
| rsyslog 8.3. | |
| --------------------------------------------------------------------------- | |
| Version 8.3.5 [v8-devel] 2014-08-05 | |
| - mmjsonparse: support selectable cookie and target containers | |
| This permits to put different meanings into a json formatted syslog | |
| message, e.g. the "traditional" cee or cim data. | |
| - bugfix: mmjsonparse did not build with json-c < 0.10 | |
| This was a regression introduced some time in the past in order to | |
| support API changes in json-c. Now we check for the version and use | |
| proper code. | |
| - omprog: emit error message via syslog() if loading binary fails | |
| This happens after forking, so omprog has no longer access to rsyslog's | |
| regular error reporting functions. Previously, this meant any error | |
| message was lost. Now it is emitted via regular syslog (which may end up | |
| in a different instance, if multiple instances run...) | |
| - couple of patches imported from v7-stable (7.6.4) | |
| --------------------------------------------------------------------------- | |
| Version 8.3.4 [v8-devel] 2014-07-11 | |
| - new pmciscoios parser supporting various Cisco IOS formats | |
| - RFC3164 timestamp parser now accepts timezones and subsecond resolution | |
| ... at least for some common formats and where we could do so without | |
| running risk of breaking proper formats (or introducing regressions) | |
| - new parser config object -- permits to define custom parser definitions | |
| - new tzinfo config object -- permits to define time zone offsets | |
| This is a utility object that currently is being used by some parsers. | |
| - bugfix: mishandling of input modules not supporting new input instances | |
| If they did not support this, accidently the output module part of the | |
| module union was written, leading to unpredictable results. Note: all | |
| core modules do support this interface, but some contributed or very | |
| old ones do not. | |
| - bugfix: double-free when ruleset() parser parameters were used | |
| While unlikely, this could cause stability issues even after the | |
| config phase. | |
| --------------------------------------------------------------------------- | |
| Version 8.3.3 [v8-devel] 2014-06-26 | |
| - unify input object naming | |
| imudp now supports "name" parameter, as other inputs do. "inputname" has | |
| been deprecated, but can still be used. Same applies to "appendport" | |
| subparameter". Thanks to "Nick Syslog" for the suggestion. | |
| - made the missing (contributed) modules build under v8 [import from 8.2.2] | |
| Modules: | |
| * mmrfc5424addhmac | |
| * omrabbitmq | |
| * omgssapi | |
| * omhdfs | |
| * omzmq3 | |
| - added a cleanup process (janitor); permits to close omfile files after a | |
| timeout | |
| - make omgssapi build under v8.3 [import vom v8.2] | |
| note that we could do this to the stable, because there is NO regression | |
| chance at all: only omgssapi was changed, and this module did NOT work | |
| previously. | |
| - removed obsolete --disable-fsstnd configure option | |
| Thanks to Thomas D. for alerting us. | |
| Closes: https://github.com/rsyslog/rsyslog/issues/72 | |
| --------------------------------------------------------------------------- | |
| Version 8.3.2 [v8-devel] 2014-05-02 | |
| - new template options for date extraction: | |
| - year | |
| - month | |
| - day | |
| - wday | |
| - hour | |
| - minute | |
| - second | |
| - tzoffshour | |
| - tzoffsmin | |
| - tzoffsdirection | |
| - wdayname | |
| For string templates, these are property options and they are | |
| prefixed with "date-" (e.g. "date-year", "date-month", ...) | |
| see also: https://github.com/rsyslog/rsyslog/issues/65 | |
| - bugfix: mmexternal remove framing char before processing JSON reply | |
| This did not have any real bad effects, but caused unnecessary | |
| processing, as empty replies were not properly detected. Otherwise, | |
| the bug was not noticible from the user's PoV. | |
| - bugfix: mmexternal segfault due to invalid free in non-json input mode | |
| closes: https://github.com/rsyslog/rsyslog/issues/70 | |
| - bugfix: mmexternal segfault when external plugin sent invalid reply | |
| ... or no reply at all. This happened if the reply was imporper JSON. | |
| Now, we emit an error message in those cases. | |
| see also: https://github.com/rsyslog/rsyslog/issues/69 | |
| - bugfix: mmexternal did potentially pass incomplete data to restarted | |
| external plugin | |
| This could happen if EPIPE was returned "too late", in which case the | |
| beginning of the data could be lost. | |
| - bugfix: mmexternal did not properly process messages over 4KiB | |
| The data to be passed to the external plugin was truncated after 4KiB. | |
| see: https://github.com/rsyslog/rsyslog/issues/64 | |
| - imrelp: added support for per-listener ruleset and inputname | |
| see: https://github.com/rsyslog/rsyslog/pull/63 | |
| Thanks to bobthesecurityguy github user for the patch | |
| --------------------------------------------------------------------------- | |
| Version 8.3.1 [v8-devel] 2014-04-24 | |
| - external message modification interface now support modifying message PRI | |
| - "jsonmesg" property will include uuid only if one was previously generated | |
| This is primarily a performance optimization. Whenever the message uuid | |
| is gotten, it is generated when not already present. As we used the | |
| regular setter, this means that always the uuid was generated, which is | |
| quite time-consuming. This has now been changed so that it only is | |
| generated if it already exists. That also matches more closly the | |
| semantics, as "jsonmesg" should not make modifications to the message. | |
| Note that the same applies to "fulljson" passing mode for external | |
| plugins. | |
| - added plugin to rewrite message facility and/or severity | |
| Name: fac-sever-rewrite.py | |
| - permits to build against json-c 0.12 | |
| Unfortunately, json-c had an ABI breakage, so this is necessary. Note | |
| that versions prior to 0.12 had security issues (CVE-2013-6370, | |
| CVE-2013-6371) and so it is desirable to link against the new version. | |
| Thanks to Thomas D. for the patch. Note that at least some distros | |
| have fixed the security issue in older versions of json-c, so this | |
| seems to apply mostly when building from sources. | |
| - bugfix: using UUID property could cause segfault | |
| - bugfix/mmexternal: memory leak | |
| - bugfix: memory leak when using "jsonmesg" property | |
| - bugfix: mmutf8fix did not detect two invalid sequences | |
| Thanks to Axel Rau for the patch. | |
| - bugfix: build problems with lexer.l on some platforms | |
| For some reason, the strdup() prototype and others are missing. I admit | |
| that I don't know why, as this happens only in 8.3.0+ and there is no | |
| indication of changes to the affected files. In any case, we need to | |
| fix this, and the current solution works at least as an interim one. | |
| --------------------------------------------------------------------------- | |
| Version 8.3.0 [v8-devel] 2014-04-10 | |
| - new plugin for anonymizing credit card numbers | |
| Thanks to Peter Slavov for providing the code. | |
| - external message modification modules are now supported | |
| They are bound via the new native module "mmexternal". Also, a sample | |
| skeleton for an external python message modification module has been | |
| added. | |
| - new $jsonmesg property with JSON representation of whole message object | |
| closes: https://github.com/rsyslog/rsyslog/issues/19 | |
| - improved error message for invalid field extraction in string template | |
| see also: | |
| http://kb.monitorware.com/problem-with-field-based-extraction-t12299.html | |
| - fix build problems on Solaris | |
| - NOTE: a json-c API that we begun to use requires the compiler to be in | |
| c99 mode. By default, we select it automatically. If you modify this and | |
| use gcc, be sure to include "-std=c99" in your compiler flags. This seems | |
| to be necessary only for older versions of gcc. | |
| --------------------------------------------------------------------------- | |
| Version 8.2.3 [v8-stable] 2014-??-?? | |
| - bugfix: ommysql: handle/mem leak upon termination of worker thread | |
| This could become bad if the (instance) worker threads are often | |
| started and terminated. But it takes quite a while to show effect. | |
| --------------------------------------------------------------------------- | |
| Version 8.2.2 [v8-stable] 2014-06-02 | |
| - made the missing (contributed) modules build under v8 | |
| Note that we could do this to the stable, because there is NO regression | |
| chance at all: only the modules themselves were changed, and they did | |
| NOT work at all previously. Please also note that most of these modules | |
| did not yet receive real testing. As we don't have the necessary | |
| environments (easily enough available), we depend on users submitting | |
| error reports and helping to iron out any issues that may arise. | |
| Modules: | |
| * mmrfc5424addhmac | |
| * omrabbitmq | |
| * omgssapi | |
| * omhdfs | |
| * omzmq3 | |
| --------------------------------------------------------------------------- | |
| Version 8.2.1 [v8-stable] 2014-04-17 | |
| - permits to build against json-c 0.12 | |
| Unfortunately, json-c had an ABI breakage, so this is necessary. Note | |
| that versions prior to 0.12 had security issues (CVE-2013-6370, | |
| CVE-2013-6371) and so it is desirable to link against the new version. | |
| Thanks to Thomas D. for the patch. Note that at least some distros | |
| have fixed the security issue in older versions of json-c, so this | |
| seems to apply mostly when building from sources. | |
| - doc is no longer shipped as part of the rsyslog tarball | |
| Instead, the rsyslog-doc project creates its own tarball. This is the | |
| result of a mailing list discussion after the 8.2.0 release with a | |
| tarball-in-tarball approach, which was disliked by almost all distro | |
| maintainers. This move also has the advantage of de-coupling the | |
| release cycles of both projects a bit (which turned out to be a bit | |
| problematic in practice). | |
| - bugfix: mmutf8fix did not detect two invalid sequences | |
| Thanks to Axel Rau for the patch. | |
| --------------------------------------------------------------------------- | |
| Version 8.2.0 [v8-stable] 2014-04-02 | |
| This starts a new stable branch based on 8.1.6 plus the following changes: | |
| - we now use doc from the rsyslog-doc project | |
| As such, the ./doc subtree has been removed. Instead, a cache of the | |
| rsyslog-doc project's files has been included in ./rsyslog-doc.tar.gz. | |
| Note that the exact distribution mode for the doc is still under | |
| discussion and may change in future releases. | |
| This was agreed upon on the rsyslog mailing list. For doc issues | |
| and corrections, be sure to work with the rsyslog-doc project. It is | |
| currently hosted at https://github.com/rsyslog/rsyslog-doc | |
| - add support for specifying the liblogging-stdlog channel spec | |
| new global parameter "stdlog.channelspec" | |
| - add "defaultnetstreamdrivercertfile" global variable to set a default | |
| for the certfile. | |
| Thanks to Radu Gheorghe for the patch. | |
| - omelasticsearch: add new "usehttps" parameter for secured connections | |
| Thanks to Radu Gheorghe for the patch. | |
| - "action resumed" message now also specifies module type | |
| which makes troubleshooting a bit easier. Note that we cannot output all | |
| the config details (like destination etc) as this would require much more | |
| elaborate code changes, which we at least do not like to do in the | |
| stable version. | |
| - add capability to override GnuTLS path in build process | |
| Thanks to Clayton Shotwell for the patch | |
| - better and more consistent action naming, action queues now always | |
| contain the word "queue" after the action name | |
| - bugfix: ompipe did resume itself even when it was still in error | |
| See: https://github.com/rsyslog/rsyslog/issues/35 | |
| Thanks to github user schplat for reporting | |
| - bugfix: ompipe used invalid default template | |
| This is a regression from an old change (didn't track it down precisely, | |
| but over a year ago). It used the Forwarding template instead of | |
| the file template (so we have a full syslog header). This fix corrects | |
| it back to previous behaviour, but new scripts that used the wrong | |
| format may now need to have the RSYSLOG_ForwardingFormat template | |
| explicitely be applied. | |
| closes: https://github.com/rsyslog/rsyslog/issues/50 | |
| --------------------------------------------------------------------------- | |
| Version 8.1.6 [release candidate] 2014-02-20 | |
| - omfile: permit to set global defaults for action parameters | |
| Thanks to Nathan Brown for the patch. | |
| See also: https://github.com/rsyslog/rsyslog/pull/23 | |
| - add capability to escape control characters in the C way of doing it | |
| adds new global parameter "parser.escapeControlCharactersCStyle" | |
| Thanks to Nathan Brown for the patch. | |
| See also: https://github.com/rsyslog/rsyslog/pull/13 | |
| - parser global parameters can now be set using RainerScript global() | |
| Thanks to Nathan Brown for the patch. | |
| See also: https://github.com/rsyslog/rsyslog/pull/23 | |
| - omprog: guard program-to-be-executed against CTL-C | |
| This can frequently happen in debug mode, where rsyslog is terminated | |
| by ctl-c. In any case, SIGINT is not meant to control the child process, | |
| so it should be blocked. | |
| - omprog bugfix: parameter "forceSingleInstance" is NOT mandatory | |
| - add new jsonr property replacer option | |
| Thanks to Nathan Brown for the patch. | |
| - added external plugin interface | |
| - ommongodb: add authentication support (untested) | |
| Thanks to JT for the patch. | |
| See also: https://github.com/rsyslog/rsyslog/pull/17 | |
| - bugfix: json templates are improperly created | |
| Strings miss the terminating NUL character, which obviously can lead | |
| to all sorts of problems. | |
| See also: https://github.com/rsyslog/rsyslog/issues/27 | |
| Thanks to Alain for the analysis and the patch. | |
| - ompgsql bugfix: improper handling of auto-backgrounding mode | |
| If rsyslog was set to auto-background itself (default code behaviour, but | |
| many distros now turn it off for good reason), ompgsql could not | |
| properly connect. This could even lead to a segfault. The core reason | |
| was that a PG session handle was kept open over a fork, something that | |
| is explicitely forbidden in the PG API. | |
| Thanks to Alain for the analysis and the patch. | |
| - bugfix: ommongodb's template parameter was mandatory but should have | |
| been optional | |
| Thanks to Alain for the analysis and the patch. | |
| - bugfix: end of batch processing was not 100% correct. Could lead to | |
| outputs not properly wirting messages. At least omelasticsearch did not | |
| write anything to the database due to this bug. | |
| See: https://github.com/rsyslog/rsyslog/issues/10 | |
| Thanks to Radu Gheorghe for reporting the issue. | |
| --------------------------------------------------------------------------- | |
| Version 8.1.5 [devel] 2014-01-24 | |
| - omprog: ability to execute multiple program instances per action | |
| It can now execute one program instance per worker thread. This is | |
| generally a very good thing the have performance wise. Usually, this | |
| should cause no problems with the invoked program. For that reason, | |
| we have decided to make this the default mode of operation. If not | |
| desired, it can be turned off via the 'forceSingleInstance="on"' | |
| action parameter. | |
| CHANGE OF BEHAVIOUR: previous versions did always execute only one | |
| instance per action, no matter how many workers were active. If | |
| your program has special needs, you need to change your configuration. | |
| - imfile now supports inotify (but must be explicitely turned on) | |
| - imfile no longer has a limit on number of monitored files | |
| - added ProcessInternalMessages global system parameter | |
| This permits to inject rsyslog status messages into *another* main | |
| syslogd or the journal. | |
| - new dependency: liblogging-stdlog (for submitting to external logger) | |
| - bugfix: imuxsock input parameters were not accepted | |
| due to copy&paste error. Thanks to Andy Goldstein for the fix. | |
| --------------------------------------------------------------------------- | |
| Version 8.1.4 [devel] 2014-01-10 | |
| - add exec_template() RainerScript function | |
| - imrelp: support for TCP KEEPALIVE added | |
| - bumped librelp dependency to 1.2.2 to support new KEEPALIVE feature | |
| - Add directives for numerically specifying GIDs/UIDs | |
| The already present directives (FileOwner, FileGroup, DirOwner, | |
| DirGroup) translate names to numerical IDs, which depends on the user | |
| information being available during rsyslog's startup. This can fail if | |
| the information is obtained over a network or from a service such as | |
| SSSD. The new directives provide a way to specify the numerical IDs | |
| directly and bypass the lookup. | |
| Thanks to Tomas Heinrich for the patch. | |
| - bugfix: action commitTransaction() processing did not properly handle | |
| suspended actions | |
| - bugfix: omelasticsearch fail.es stats counter was improperly maitained | |
| --------------------------------------------------------------------------- | |
| Version 8.1.3 [devel] 2013-12-06 | |
| THIS VERSION CAN BE CONSIDERED A "NORMAL" DEVEL RELEASE. It's no longer | |
| highly experimental. This assertion is based on real-world feedback. | |
| - changes to the strgen module interface | |
| - new output module interface for transactional modules | |
| - performance improvements | |
| * reduced number of malloc/frees due to further changes to the | |
| output module interface | |
| * reduced number of malloc/frees during string template processing | |
| We now re-use once allocated string template memory for as long | |
| as the worker thread exists. This saves us from doing new memory | |
| allocs (and their free counterpart) when the next message is | |
| processed. The drawback is that the cache always is the size of | |
| the so-far largest message processed. This is not considered a | |
| problem, as in any case a single messages' memory footprint should | |
| be far lower than that of a whole set of messages (especially on | |
| busy servers). | |
| * used variable qualifiers (const, __restrict__) to hopefully help | |
| the compiler generate somewhat faster code | |
| - failed action detection more precisely for a number of actions | |
| If an action uses string parameter passing but is non-transactional | |
| it can be executed immediately, giving a quicker indicatio of | |
| action failure. | |
| - bugfix: limiting queue disk space did not work properly | |
| * queue.maxdiskspace actually initializes queue.maxfilesize | |
| * total size of queue files was not checked against | |
| queue.maxdiskspace for disk assisted queues. | |
| Thanks to Karol Jurak for the patch. | |
| --------------------------------------------------------------------------- | |
| Version 8.1.2 [experimental] 2013-11-28 | |
| - support for liblognorm1 added - results in performance improvements | |
| Thanks to Pavel Levshin for his work in this regard. | |
| - support for jemalloc added via --enable-jemalloc | |
| Thanks to Pavel Levshin for suggesting jemalloc | |
| Note that build system is experimental at this stage. | |
| - queue defaults have changed | |
| * high water mark is now dynamically 90% of queue size | |
| * low water makr is now dynamically 70% of queue size | |
| * queue.discardMark is now dynamically 98% of queue size | |
| * queue.workerThreadMinimumMessage set to queue.size / num workers | |
| For queues with very low queue.maxSize (< 100), "emergency" defaults | |
| will be used. | |
| - bugfix: disk queues created files in wrong working directory | |
| if the $WorkDirectory was changed multiple times, all queues only | |
| used the last value set. | |
| - bugfix: legacy directive $ActionQueueWorkerThreads was not honored | |
| - bugfix: mmrfc5424addhmac: "key" parameter was not properly processed | |
| --------------------------------------------------------------------------- | |
| Version 8.1.1 [experimental] 2013-11-19 | |
| - bugfix: STOP/discard(~) was mostly NOT honored | |
| This lead to execution of config code that was not meant to be executed. | |
| - bugfix: memory leak on worker thread termination | |
| - bugfix: potential segfault in omfile under heavy load | |
| Thanks to Pavel Levshin for alerting us. | |
| - bugfix: mmsequence: instance mode did not work | |
| Thanks to Pavel Levshin for the patch | |
| - bugfix: segfault on startup when certain script constructs are used | |
| e.g. "if not $msg ..." | |
| - omhiredis: now supports v8 output module interface and works again | |
| Thanks to Pavel Levshin for the patch | |
| - mmaudit: now supports v8 output module interface and work again | |
| - bugfix: potential abort on startup in debug mode | |
| This depends on template type being used. The root cause was a | |
| non-necessary debug output, which were at the wrong spot (leftover from | |
| initial testing). | |
| Thanks to Pavel Levshin for alerting us and providing a patch | |
| proposal. | |
| --------------------------------------------------------------------------- | |
| Version 8.1.0 [experimental] 2013-11-15 | |
| - rewritten core engine for higher performance and new features | |
| In detail: | |
| * completely rewritten rule execution engine | |
| * completely changed output module interface | |
| * remodelled output module interface | |
| * enabled important output modules to support full concurrent | |
| operation | |
| The core engine has been considerably changed and must be considered | |
| experimental at this stage. Note that it does not yet include all | |
| features planned for v8, but is close to this goal. In theory, the | |
| engine should perform much better, especially on complex configurations | |
| and busy servers. Most importantly, actions instances can now be called | |
| concurrently from worker threads and many important output modules | |
| support multiple concurrent action instances natively. | |
| - module omruleset is no longer enabled by default. | |
| Note that it has been deprecated in v7 and been replaced by the "call" | |
| statement. Also, it can still be build without problems, the option must | |
| just explicitely be given. | |
| --------------------------------------------------------------------------- | |
| Version 7.6.8 [v7.6-stable] 2014-10-?? | |
| - bugfix: typo in queue configuration parameter made parameter unusable | |
| Thanks to Bojan Smojver for the patch. | |
| - bugfix imuxsock: possible segfault when SysSock.Use="off" | |
| Thanks to alexjfisher for reporting this issue. | |
| closes https://github.com/rsyslog/rsyslog/issues/140 | |
| - bugfix: unitialized buffer off-by-one error in hostname generation | |
| The DNS cache used uninitialized memory, which could lead to | |
| invalid hostname generation. | |
| Thanks to Jarrod Sayers for alerting us and provinding analysis and | |
| patch recommendations. | |
| - remove zpipe (a testing tool) from --enable-diagtools | |
| This tool is no longer maintained and currently not used inside the | |
| testbench. We keep it in the source tree for the time being in case that | |
| it may be used in the future. | |
| - bugfix: imjournal did not build properly | |
| The build succeeded, but the module did not load due to a type in | |
| a support function name, which kept unresolved during load. | |
| - bugfix imklog: pri was miscalculated | |
| actually, the pri was totally off the real value for PRIs > 9 | |
| - bugfix rsgtutil: sometimes crashed in verify mode if file did not exist | |
| - bugfix rsgtutil: some errors/problems at end of file were not reported | |
| * The verification function in rsgtutil tool did not report deletion of | |
| whole signed blocks of lines from the end of the log file. | |
| * The verification function in rsgtutil tool did not report extra | |
| (unsigned) lines at the end of the log file. | |
| Thanks to Henri Lakk for the patch. | |
| - bugfix: error: json_tokener_errors undeclared when overriding PKGCONFIG | |
| If PKGCONFIG settings for json-c were overriden, presence of | |
| json_tokener_errors was not properly detected. | |
| closes: https://github.com/rsyslog/rsyslog/issues/143 | |
| Thanks to Alex Fisher for alerting us and the patch. | |
| --------------------------------------------------------------------------- | |
| Version 7.6.7 [v7.6-stable] 2014-10-02 | |
| - bugfix: the fix for CVE-2014-3634 did not handle all cases | |
| This is corrected now. | |
| see also: CVE-2014-3683 | |
| - fixed a build problem on some platforms | |
| Thanks to Olaf for the patch | |
| - behaviour change: "msg" of messages with invalid PRI set to "rawmsg" | |
| When the PRI is invalid, the rest of the header cannot be valid. So | |
| we move all of it to MSG and do not try to parse it out. Note that | |
| this is not directly related to the security issue but rather done | |
| because it makes most sense. | |
| --------------------------------------------------------------------------- | |
| Version 7.6.6 [v7.6-stable] 2014-09-30 | |
| - bugfix: potential abort when a message with PRI > 191 was processed | |
| if the "pri-text" property was used in active templates, this could | |
| be abused to a remote denial of service from permitted senders | |
| see also: CVE-2014-3634 | |
| - bugfix: potential segfault on startup on 64 bit systems | |
| This happened immediately on startup during config processing. Once | |
| rsyslog got past this stage, it could not happen. | |
| - bugfix: build problems on SuSe Linux | |
| Thanks Andreas Stieger for the patch | |
| --------------------------------------------------------------------------- | |
| Version 7.6.5 [v7.6-stable] 2014-09-17 | |
| - bugfix: in 7.6.4, pri-based filters did not work correctly | |
| messages were distributed to the wrong bins. | |
| - bugfix: build problems on systems without atomic instructons | |
| e.g. RHEL 5; backport from v8 | |
| --------------------------------------------------------------------------- | |
| Version 7.6.4 [v7.6-stable] 2014-09-12 | |
| - add --enable-generate-man-pages configure switch (default: enabled) | |
| This forces generation of man pages, even if cached ones exists. This | |
| "fixes" a typical release tarball nit. While it is hackish, the | |
| benefit is clear given the history of failed tarball releases since | |
| we changed the cached man page handling. It was just too easy to get | |
| that wrong. | |
| - removed obsolete --disable-fsstnd configure option | |
| Thanks to Thomas D. for alerting us. | |
| Closes: https://github.com/rsyslog/rsyslog/issues/72 | |
| - permits to build against json-c 0.12 | |
| Unfortunately, json-c had an ABI breakage, so this is necessary. Note | |
| that versions prior to 0.12 had security issues (CVE-2013-6370, | |
| CVE-2013-6371) and so it is desirable to link against the new version. | |
| Thanks to Thomas D. for the patch. Note that at least some distros | |
| have fixed the security issue in older versions of json-c, so this | |
| seems to apply mostly when building from sources. | |
| - new omfile default module parameters | |
| * filecreatemode | |
| * fileowner | |
| * fileownernum | |
| * filegroup | |
| * filegroupnum | |
| * dirowner | |
| * dirownernum | |
| * dirgroup | |
| * dirgroupnum | |
| Thanks to Karol Jurak for the patch. | |
| - bugfix: memory leak in TCP TLS mode | |
| - bugfix: imfile: if a state file for a different file name was set, | |
| that different file (name) was monitored instead of the configured | |
| one. Now, the state file is deleted and the correct file monitored. | |
| closes: https://github.com/rsyslog/rsyslog/issues/103 | |
| - bugfix: using UUID property could cause segfault | |
| - bugfix: mmutf8fix did not detect two invalid sequences | |
| Thanks to Axel Rau for the patch. | |
| - bugfix: file descriptor leak with Guardtime signatures | |
| When a .gtstate file is opened it is never closed. This is especially | |
| bad when dynafiles frequently get evicted from dynafile cache and be | |
| re-opened again. | |
| - bugfix: busy loop in tcp listener when running out of file descriptors | |
| Thanks to Susant Sahani for the patch. | |
| - bugfix: mishandling of input modules not supporting new input instances | |
| If they did not support this, accidently the output module part of the | |
| module union was written, leading to unpredictable results. Note: all | |
| core modules do support this interface, but some contributed or very | |
| old ones do not. | |
| - bugfix: double-free when ruleset() parser parameters were used | |
| While unlikely, this could cause stability issues even after the | |
| config phase. | |
| - bugfix: output modules with parameters with multiple passing modes | |
| could caused strange behaviour including aborts | |
| This was due to the fact that the action module only preserved and | |
| processed the last set passing mode. Note that this was not a problem | |
| for the plugins provided by the rsyslog git: none of them uses different | |
| passing modes. | |
| Thanks to Tomas Heinrich for providing a very detailled bug report. | |
| - various fixes after coverty scan | |
| These do not address issues seen in practice but those seen by the tool. | |
| Some of them may affect practical deployments. | |
| Thanks to Tomas Heinrich for the patches. | |
| - bugfix imuxsock: "Last message repeated..." was not emitted at shutdown | |
| The "Last message repeated..." notice didn't get printed if rsyslog was | |
| shut down before the repetition was broken. | |
| Thanks to Tomas Heinrich for the patch. | |
| - bugfix: make dist failed when GUARDTIME or LIBGCRYPT feature was disabled | |
| - bugfix: mmjsonparse did not build with json-c < 0.10 | |
| This was a regression introduced some time in the past in order to | |
| support API changes in json-c. Now we check for the version and use | |
| proper code. | |
| - bugfix: mmanon did not properly anonymize IP addresses starting with '9' | |
| Thanks to defa-at-so36.net for reporting this problem. | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=529 | |
| --------------------------------------------------------------------------- | |
| Version 7.6.3 [v7.6-stable] 2014-03-27 | |
| - add capability to override GnuTLS path in build process | |
| Thanks to Clayton Shotwell for the patch | |
| - support for librelp 1.2.5 | |
| Support new return states of librelp 1.2.5 to emit better error messages | |
| For obvious reasons, librelp 1.2.5 is now required. | |
| - bugfix: ompipe used invalid default template | |
| This is a regression from an old change (didn't track it down precisely, | |
| but over a year ago). It used the Forwarding template instead of | |
| the file template (so we have a full syslog header). This fix corrects | |
| it back to previous behaviour, but new scripts that used the wrong | |
| format may now need to have the RSYSLOG_ForwardingFormat template | |
| explicitely be applied. | |
| closes: https://github.com/rsyslog/rsyslog/issues/50 | |
| - bugfix: ompipe did emit many suspension messages for /dev/xconsole | |
| (hopefully now) closes: https://github.com/rsyslog/rsyslog/issues/35 | |
| When it was present, but nobody reading from it. The problem | |
| is the way the rsyslog v7 engine tries to resolve failures in outputs. | |
| It does some retries, and along those lines some state information gets | |
| lost and it is close to impossible to retain it. However, the actual | |
| root problem is that ompipe does not reliably detect if it is able to | |
| recover. The problem here is that it actually does not know this | |
| before it does an actual write. These two things together mess up the | |
| logic that suppresses invalid resumption/suspension messages | |
| (actually, the plugin switches state really that often). | |
| Nevertheless, the prime problem with /dev/xconsole (and probably | |
| most other pipes as well) is that it gets full. So I have now added | |
| code that checks, during resume processing, if the pipe is writable. | |
| If it is not, resume is deferred. That should address the case. | |
| --------------------------------------------------------------------------- | |
| Version 7.6.2 [v7.6-stable] 2014-03-17 | |
| - support for librelp 1.2.4 | |
| This was necessary due to the problems with librelp 1.2.3 API stability. | |
| We now use the new native 1.2.4 APIs to learn about the state of | |
| librelp's TLS support. | |
| For obvious reasons, librelp 1.2.4 is now required. | |
| --------------------------------------------------------------------------- | |
| Version 7.6.1 [v7.6-stable] 2014-03-13 | |
| - added "action.reportSuspension" action parameter | |
| This now permits to control handling on a per-action basis rather to | |
| the previous "global setting only". | |
| - "action resumed" message now also specifies module type | |
| which makes troubleshooting a bit easier. Note that we cannot output all | |
| the config details (like destination etc) as this would require much more | |
| elaborate code changes, which we at least do not like to do in the | |
| stable version. | |
| - better and more consistent action naming, action queues now always | |
| contain the word "queue" after the action name | |
| - add support for "tls-less" librelp | |
| we now require librelp 1.2.3, as we need the new error code definition | |
| See also: https://github.com/rsyslog/librelp/issues/1 | |
| - build system improvements | |
| * autoconf subdir option | |
| * support for newer json-c packages | |
| Thanks to Michael Biebl for the patches. | |
| - imjournal enhancements: | |
| * log entries with empty message field are no longer ignored | |
| * invalid facility and severity values are replaced by defaults | |
| * new config parameters to set default facility and severity | |
| Thanks to Tomas Heinrich for implementing this | |
| - bugfix: ompipe did resume itself even when it was still in error | |
| See: https://github.com/rsyslog/rsyslog/issues/35 | |
| Thanks to github user schplat for reporting | |
| - bugfix: "action xxx suspended" did report incorrect error code | |
| - bugfix: ommongodb's template parameter was mandatory but should have | |
| been optional | |
| Thanks to Alain for the analysis and the patch. | |
| - bugfix: only partial doc was put into distribution tarball | |
| Thanks to Michael Biebl for alerting us. | |
| see also: https://github.com/rsyslog/rsyslog/issues/31 | |
| - bugfix: async ruleset did process already-deleted messages | |
| Thanks to John Novotny for the patch. | |
| --------------------------------------------------------------------------- | |
| Version 7.6.0 [v7.6-stable] 2014-02-12 | |
| This starts a new stable branch based on 7.5.8 plus the following changes: | |
| - bugfix: imuxsock input parameters were not accepted | |
| due to copy&paste error. Thanks to Andy Goldstein for the fix. | |
| - added ProcessInternalMessages global system parameter | |
| This permits to inject rsyslog status messages into *another* main | |
| syslogd or the journal. | |
| - new dependency: liblogging-stdlog (for submitting to external logger) | |
| - bugfix: json templates are improperly created | |
| Strings miss the terminating NUL character, which obviously can lead | |
| to all sorts of problems. | |
| See also: https://github.com/rsyslog/rsyslog/issues/27 | |
| Thanks to Alain for the analysis and the patch. | |
| - ompgsql bugfix: improper handling of auto-backgrounding mode | |
| If rsyslog was set to auto-background itself (default code behaviour, but | |
| many distros now turn it off for good reason), ompgsql could not | |
| properly connect. This could even lead to a segfault. The core reason | |
| was that a PG session handle was kept open over a fork, something that | |
| is explicitely forbidden in the PG API. | |
| Thanks to Alain for the analysis and the patch. | |
| --------------------------------------------------------------------------- | |
| Version 7.5.8 [v7-release candidate] 2014-01-09 | |
| - add exec_template() RainerScript function | |
| - add debug.onShutdown and debug.logFile global parameters | |
| These enebale the new "debug on shutdown" mode, which can be used to | |
| track hard to find problems that occur during system shutdown. | |
| - Add directives for numerically specifying GIDs/UIDs | |
| The already present directives (FileOwner, FileGroup, DirOwner, | |
| DirGroup) translate names to numerical IDs, which depends on the user | |
| information being available during rsyslog's startup. This can fail if | |
| the information is obtained over a network or from a service such as | |
| SSSD. The new directives provide a way to specify the numerical IDs | |
| directly and bypass the lookup. | |
| Thanks to Tomas Heinrich for the patch. | |
| - actions now report if they suspend and resume themselves | |
| this is by default on and controllable by the action.reportSuspension | |
| global parameter | |
| - bugfix: omelasticsearch fail.es stats counter was improperly maintained | |
| - bugfix: mmrfc5424addhmac: "key" parameter was not properly processed | |
| - add new impstats action counters: | |
| * suspended | |
| * suspended.duration | |
| * resumed | |
| --------------------------------------------------------------------------- | |
| Version 7.5.7 [v7-devel] 2013-11-25 | |
| - queue defaults have changed | |
| * high water mark is now dynamically 90% of queue size | |
| * low water makr is now dynamically 70% of queue size | |
| * queue.discardMark is now dynamically 98% of queue size | |
| * queue.workerThreadMinimumMessage set to queue.size / num workers | |
| For queues with very low queue.maxSize (< 100), "emergency" defaults | |
| will be used. | |
| - worker thread pool handling has been improved | |
| Among others, permits pool to actually shrink (was quite hard with | |
| previous implementation. This will also improve performance and/or | |
| lower system overhead on busy systems. | |
| Thanks to Pavel Levshin for the enhancement. | |
| - bugfix: mmpstrucdata generated inaccessible properties | |
| - bugfix: RainerScript optimizer did not optimize PRI filters | |
| things like "if $syslogfacility-text == "local3"" were not converted | |
| to PRIFILT. This was a regression introduced in 7.5.6. | |
| - bugfix: legacy directive $ActionQueueWorkerThreads was not honored | |
| - bugfix: segfault on startup when certain script constructs are used | |
| e.g. "if not $msg ..." | |
| - bugfix: ommysql lost configfile/section parameters after first close | |
| This means that when a connection was broken, it was probably | |
| re-instantiated with different parameters than configured. | |
| - bugfix: regression in template processing with subtrees in templates | |
| Thanks to Pavel Levshin for the fix | |
| - bugfix: regular worker threads are not properly (re)started if DA | |
| mode is active. | |
| This occurs only under rare conditions, but definitely is a bug that | |
| needed to be addressed. It probably is present since version 4. | |
| Note that this patch has not been applied to v7.4-stable, as it | |
| is very unlikely to happen and the fix itself has some regression | |
| potential (the fix looks very solid, but it addresses a core component). | |
| Thanks to Pavel Levshin for the fix | |
| - now emit warning message if om with msg passing mode uses action queue | |
| These can modify the message, and this causes races. | |
| - bugfix: $SystemLogUseSysTimeStamp/$SystemLogUsePIDFromSystem did not work | |
| Thanks to Tomas Heinrich for the patch. | |
| --------------------------------------------------------------------------- | |
| Version 7.5.6 [devel] 2013-10-29 | |
| - impstats: add capability to bind to a ruleset | |
| - improved performance of RainerScript variable access | |
| by refactoring the whole body of variable handling code. This also | |
| solves some of the anomalies experienced in some versions of rsyslog. | |
| All variable types are now handled in unified code, including | |
| access via templates. | |
| - RainerScript: make use of 64 bit for numbers where available | |
| Thanks to Pavel Levshin for enhancement. | |
| - slight performance optimization if GCC is used | |
| We give branch prediction hints for the frequent RETiRet macro which is | |
| used for error handling. Some slight performance gain is to be expected | |
| from that. | |
| - removed global variable support | |
| The original idea was not well thought out and global variables, as | |
| implemented, worked far different from what anybody would expect. As | |
| such, we consider the current approach as an experiment that did not | |
| work out and opt to removing it, clearing the way for a better future | |
| solution. Note: global vars were introduced in 7.5.3 on Sept, 11th 2013. | |
| - new module mmsequence, primarily used for action load balancing | |
| Thanks to Pavel Levshin for contributing this module. | |
| - bugfix: unset statement always worked on message var, even if local | |
| var was given | |
| - imudp: support for binding to ruleset added | |
| - bugfix: segfault if variable was assigned to non-container subtree | |
| Thanks to Pavel Levshin for the fix | |
| - bugfix: imuxsock did not suport addtl sockets if syssock was disabled | |
| Thanks to Pavel Levshin for the fix | |
| - bugfix: running imupd on multiple threads lead to segfault if recvmmsg | |
| is available | |
| - bugfix: imudp when using recvmmsg could report wrong sender IP | |
| - bugfix: segfault if re_extract() function was used and no match found | |
| - bugfix: omelasticsearch did not compile on platforms without atomic | |
| instructions | |
| - bugfix: potential misadressing on startup if property-filter was used | |
| This could happen if the property name was longer than 127 chars, a case | |
| that would not happen in practice. | |
| - bugfix: invalid property filter was not properly disabled in ruleset | |
| Note: the cosmetic memory leak introduced with that patch in 7.4.5 is | |
| now also fixed. | |
| - imported bugfixes from 7.4.6 stable release | |
| --------------------------------------------------------------------------- | |
| Version 7.5.5 [devel] 2013-10-16 | |
| - imfile: permit to monitor an unlimited number of files | |
| - imptcp: add "defaultTZ" input parameter | |
| - imudp: support for multiple receiver threads added | |
| - imudp: add "dfltTZ" input config parameter | |
| - bugfix: memory leak in mmnormalize | |
| - bugfix: mmutf8fix did not properly handle invalid UTF-8 at END of message | |
| if the very last character sequence was too long, this was not detected | |
| Thanks to Risto Vaarandi for reporting this problem. | |
| - mmanon: removed the check for specific "terminator characters" after | |
| last octet. As it turned out, this didn't work in practice as there | |
| was an enormous set of potential terminator chars -- so removing | |
| them was the best thing to do. Note that this may change behaviour of | |
| existing installations. Yet, we still consider this an important | |
| bugfix, that should be applied to the stable branch. | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=477 | |
| Thanks to Muri Cicanor for initiating the discussion | |
| - now requires libestr 0.1.7 as early versions had a nasty bug in | |
| string comparisons | |
| - bugfix: mmanon did not detect all IP addresses in rewrite mode | |
| The problem occured if two IPs were close to each other and the first one | |
| was shrunk. | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=485 | |
| Thanks to micah-at-riseup.net for reporting this bug | |
| - bugfix: mmanon sometimes used invalid replacement char in simple mode | |
| depending on configuration sequence, the replacement character was set | |
| to 's' instead of the correct value. Most importantly, it was set to | |
| 's' if simple mode was selected and no replacement char set. | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=484 | |
| Thanks to micah-at-riseup.net for reporting this bug | |
| - bugfix: memory leak in mmnormalize | |
| - bugfix: array-based ==/!= comparisions lead to invalid results | |
| This was a regression introduced in 7.3.5 bei the PRI optimizer | |
| --------------------------------------------------------------------------- | |
| Version 7.5.4 [devel] 2013-10-07 | |
| - mmpstrucdata: new module to parse RFC5424 structured data into json | |
| message properties | |
| - change main/ruleset queue defaults to be more enterprise-like | |
| new defaults are queue.size 100,000 max workers 2, worker | |
| activation after 40,000 msgs are queued, batch size 256. These settings | |
| are much more useful for enterprises and will not hurt low-end systems | |
| that much. This is part of our re-focus on enterprise needs. | |
| - omfwd: new action parameter "maxErrorMessages" added | |
| - omfile: new module parameters to set action defaults added | |
| * dirCreateMode | |
| * fileCreateMode | |
| - mmutf8fix: new module to fix invalid UTF-8 sequences | |
| - imuxsock: handle unlimited number of additional listen sockets | |
| - doc: improve usability by linking to relevant web ressources | |
| The idea is to enable users to quickly find additional information, | |
| samples, HOWTOs and the like on the main site. | |
| At the same time, (very) slightly remove memory footprint when | |
| few listeners are monitored. | |
| - bugfix: omfwd parameter streamdrivermmode was not properly handled | |
| it was always overwritten by whatever value was set via the | |
| legacy directive $ActionSendStreamDriverMode | |
| - imtcp: add streamdriver.name module parameter | |
| permits overriding the system default stream driver (gtls, ptcp) | |
| - bugfix: build system: libgcrypt.h needed even if libgrcypt was disabled | |
| Thanks to Jonny Törnbom for reporting this problem | |
| - imported bugfixes from 7.4.4 | |
| --------------------------------------------------------------------------- | |
| Version 7.5.3 [devel] 2013-09-11 | |
| - imfile: support for escaping LF characters added | |
| embedded LF in syslog messages cause a lot of trouble. imfile now has | |
| the capability to escape them to "#012" (just like the regular control | |
| character escape option). This requires new-style input statements to be | |
| used. If legacy configuration statements are used, LF escaping is always | |
| turned off to preserve compatibility. | |
| NOTE: if input() statements were already used, there is a CHANGE OF | |
| BEHAVIOUR: starting with this version, escaping is enabled by | |
| default. So if you do not want it, you need to add | |
| escapeLF="off" | |
| to the input statement. Given the trouble LFs cause and the fact | |
| that the majority of installations still use legacy config, we | |
| considered this behaviour change acceptable and useful. | |
| see also: http://blog.gerhards.net/2013/09/imfile-multi-line-messages.html | |
| - add support for global and local variables | |
| - bugfix: queue file size was not correctly processed | |
| this could lead to using one queue file per message for sizes >2GiB | |
| Thanks to Tomas Heinrich for the patch. | |
| - add main_queue() configuration object to configure main message queue | |
| - bugfix: stream compression in imptcp caused timestamp to be corrupted | |
| - imudp: add ability to specify SO_RCVBUF size (rcvbufSize parameter) | |
| - imudp: use inputname for statistics, if configured | |
| - impstats: add process resource usage counters [via getrusage()] | |
| - impstats: add parameter "resetCounters" to report delta values | |
| possible for most, but not all, counters. See doc for details. | |
| - librelp 1.2.0 is now required | |
| - make use of new librelp generic error reporting facility | |
| This leads to more error messages being passed to the user and | |
| thus simplified troubleshooting. | |
| - bugfix: very small memory leak in imrelp | |
| more or less cosmetic, a single memory block was not freed, but this | |
| only happens immediately before termination (when the OS automatically | |
| frees all memory). Still an annoyance e.g. in valgrind. | |
| - fix compile problem in debug build | |
| - imported fixes from 7.4.4 | |
| --------------------------------------------------------------------------- | |
| Version 7.5.2 [devel] 2013-07-04 | |
| - librelp 1.1.4 is now required | |
| We use API extensions for better error reporting and higher performance. | |
| - omrelp: use transactional mode to make imrelp emit bulk sends | |
| - omrelp: add "windowSize" parameter to set custom RELP window size | |
| - bugfix: double-free in omelasticsearch | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=461 | |
| a security advisory for this bug is available at: | |
| http://www.lsexperts.de/advisories/lse-2013-07-03.txt | |
| CVE: CVE-2013-4758 | |
| PLEASE NOTE: This issue only existed if omelasticsearch was used | |
| in a non-default configuration, where the "errorfile" parameter | |
| was specified. Without that parameter set, the bug could not | |
| be triggered. | |
| Thanks to Markus Vervier and Marius Ionescu for providing a detailled | |
| bug report. Special thanks to Markus for coordinating his security | |
| advisory with us. | |
| - doc: fixed various typos | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=391 | |
| Thanks to Georgi Georgiev for the patch. | |
| --------------------------------------------------------------------------- | |
| Version 7.5.1 [devel] 2013-06-26 | |
| - librelp 1.1.3 is required - older versions can lead to a segfault | |
| - add mmfields, which among others supports easy parsing of CEF messages | |
| - omrelp: | |
| * new parameter "compression.prioritystring" to control encryption | |
| parameters used by GnuTLS | |
| - imrelp: | |
| * new parameter "compression.dhbits" to control the number of | |
| bits being used for Diffie-Hellman key generation | |
| * new parameter "compression.prioritystring" to control encryption | |
| parameters used by GnuTLS | |
| * support for impstats added | |
| * support for setting permitted peers (client authentication) added | |
| * bugfix: potential segfault at startup on invalid config parameters | |
| - imjournal: imported patches from 7.4.1 | |
| - omprog: add support for command line parameters | |
| - added experimental TCP stream compression (imptcp only, currently) | |
| - added BSD-specific syslog facilities | |
| * "console" | |
| * "bsd_security" - this is called "security" under BSD, but that name | |
| was unfortunately already taken by some standard facility. So I | |
| did the (hopefully) second-best thing and renamed it a little. | |
| - imported fixes from 7.4.2 (especially build problems on FreeBSD) | |
| - bugfix: imptcp did not properly initialize compression status variable | |
| could lead to segfault if stream:always compression mode was selected | |
| --------------------------------------------------------------------------- | |
| Version 7.5.0 [devel] 2013-06-11 | |
| - imrelp: implement "ruleset" module parameter | |
| - imrelp/omrelp: add TLS & compression (zip) support | |
| - omrelp: add "rebindInterval" parameter | |
| - add -S command line option to specify IP address to use for RELP client | |
| connections | |
| Thanks to Axel Rau for the patch. | |
| --------------------------------------------------------------------------- | |
| Version 7.4.11 [v7.4-stable] *never released* | |
| - imjournal enhancements: | |
| * log entries with empty message field are no longer ignored | |
| * invalid facility and severity values are replaced by defaults | |
| * new config parameters to set default facility and severity | |
| Thanks to Tomas Heinrich for implementing this | |
| --------------------------------------------------------------------------- | |
| Version 7.4.10 [v7.4-stable] 2014-02-12 | |
| - bugfix: json templates are improperly created | |
| Strings miss the terminating NUL character, which obviously can lead | |
| to all sorts of problems. | |
| See also: https://github.com/rsyslog/rsyslog/issues/27 | |
| Thanks to Alain for the analysis and the patch. | |
| - ompgsql bugfix: improper handling of auto-backgrounding mode | |
| If rsyslog was set to auto-background itself (default code behaviour, but | |
| many distros now turn it off for good reason), ompgsql could not | |
| properly connect. This could even lead to a segfault. The core reason | |
| was that a PG session handle was kept open over a fork, something that | |
| is explicitely forbidden in the PG API. | |
| Thanks to Alain for the analysis and the patch. | |
| --------------------------------------------------------------------------- | |
| Version 7.4.9 [v7.4-stable] 2014-01-22 | |
| - added ProcessInternalMessages global system parameter | |
| This permits to inject rsyslog status messages into *another* main | |
| syslogd or the journal. | |
| - new dependency: liblogging-stdlog (for submitting to external logger) | |
| - bugfix: imuxsock input parameters were not accepted | |
| due to copy&paste error. Thanks to Andy Goldstein for the fix. | |
| - bugfix: potential double-free in RainerScript equal comparison | |
| happens if the left-hand operand is JSON object and the right-hand | |
| operand is a non-string that does not convert to a number (for | |
| example, it can be another JSON object, probably the only case that | |
| could happen in practice). This is very unlikely to be triggered. | |
| - bugfix: some RainerScript Json(Variable)/string comparisons were wrong | |
| --------------------------------------------------------------------------- | |
| Version 7.4.8 [v7.4-stable] 2014-01-08 | |
| - rsgtutil provides better error messages on unfinished signature blocks | |
| - bugfix: guard against control characters in internal (error) messages | |
| Thanks to Ahto Truu for alerting us. | |
| - bugfix: immark did emit messages under kern.=info instead of syslog.=info | |
| Note that his can potentially break exisiting configurations that | |
| rely on immark sending as kern.=info. Unfortunately, we cannot leave | |
| this unfixed as we never should emit messages under the kern facility. | |
| --------------------------------------------------------------------------- | |
| Version 7.4.7 [v7.4-stable] 2013-12-10 | |
| - bugfix: limiting queue disk space did not work properly | |
| * queue.maxdiskspace actually initializes queue.maxfilesize | |
| * total size of queue files was not checked against | |
| queue.maxdiskspace for disk assisted queues. | |
| Thanks to Karol Jurak for the patch. | |
| - bugfix: linux kernel-like ratelimiter did not work properly with all | |
| inputs (for example, it did not work with imdup). The reason was that | |
| the PRI value was used, but that needed parsing of the message, which | |
| was done too late. | |
| - bugfix: disk queues created files in wrong working directory | |
| if the $WorkDirectory was changed multiple times, all queues only | |
| used the last value set. | |
| - bugfix: legacy directive $ActionQueueWorkerThreads was not honored | |
| - bugfix: segfault on startup when certain script constructs are used | |
| e.g. "if not $msg ..." | |
| - bugfix: imuxsock: UseSysTimeStamp config parameter did not work correctly | |
| Thanks to Tomas Heinrich for alerting us and provinding a solution | |
| suggestion. | |
| - bugfix: $SystemLogUseSysTimeStamp/$SystemLogUsePIDFromSystem did not work | |
| Thanks to Tomas Heinrich for the patch. | |
| - improved checking of queue config parameters on startup | |
| - bugfix: call to ruleset with async queue did not use the queue | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=443 | |
| - bugfix: if imtcp is loaded and no listeners are configured (which is | |
| uncommon), rsyslog crashes during shutdown. | |
| --------------------------------------------------------------------------- | |
| Version 7.4.6 [v7.4-stable] 2013-10-31 | |
| - bugfix: potential abort during HUP | |
| This could happen when one of imklog, imzmq3, imkmsg, impstats, | |
| imjournal, or imuxsock were under heavy load during a HUP. | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=489 | |
| Thanks to Guy Rozendorn for reporting the problem and Peval Levhshin for | |
| his analysis. | |
| - bugfix: imtcp flowControl parameter incorrectly defaulted to "off" | |
| This could cause message loss on systems under heavy load and was | |
| a change-of-behaviour to previous version. This is a regression | |
| most probably introduced in 5.9.0 (but did not try hard to find the | |
| exact point of its introduction). | |
| - now requires libestr 0.1.9 as earlier versions lead to problems with | |
| number handling in RainerScript | |
| - bugfix: memory leak in strlen() RainerScript function | |
| Thanks to Gregoire Seux for reportig this bug. | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=486 | |
| - bugfix: buffer overrun if re_extract function was called for submatch 50 | |
| Thanks to Pavel Levshin for reporting the problem and its location. | |
| - bugfix: memleak in re_extract() function | |
| Thanks to Pavel Levshin for reporting this problem. | |
| - bugfix: potential abort in RainerScript optimizer | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=488 | |
| Thanks to Thomas Doll for reporting the problem and Pavel Levshin for | |
| fixing it. | |
| - bugfix: memory leak in omhiredis | |
| Thanks to Pavel Levshin for the fix | |
| - bugfix: segfault if variable was assigned to non-container subtree | |
| Thanks to Pavel Levshin for the fix | |
| --------------------------------------------------------------------------- | |
| Version 7.4.5 [v7.4-stable] 2013-10-22 | |
| - mmanon: removed the check for specific "terminator characters" after | |
| last octet. As it turned out, this didn't work in practice as there | |
| was an enormous set of potential terminator chars -- so removing | |
| them was the best thing to do. Note that this may change behaviour of | |
| existing installations. Yet, we still consider this an important | |
| bugfix, that should be applied to the stable branch. | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=477 | |
| Thanks to Muri Cicanor for initiating the discussion | |
| - now requires libestr 0.1.8 as early versions had a nasty bug in | |
| string comparisons | |
| - omelasticsearch: add failed.httprequests stats counter | |
| - bugfix: invalid property filter was not properly disabled in ruleset | |
| Note that this bugfix introduces a very slight memory leak, which is | |
| cosmetic, as it just holds data until termination that is no longer | |
| needed. It is just the part of the config that was invalid. We will | |
| "fix" this "issue" in the devel version first, as the fix is a bit | |
| too intrusive to do without hard need in the stable version. | |
| - bugfix: segfault if re_extract() function was used and no match found | |
| - bugfix: potential misadressing on startup if property-filter was used | |
| This could happen if the property name was longer than 127 chars, a case | |
| that would not happen in practice. | |
| - bugfix: omelasticsearch: correct failed.http stats counter | |
| - bugfix: omelasticsearch: did not correctly initialize stats counters | |
| - bugfix: omelasticsearch: failed.es counter was only maintained in bulk mode | |
| This usually did not lead to any problems, because they are in static | |
| memory, which is initialized to zero by the OS when the plugin is | |
| loaded. But it may cause problems especially on systems that do not | |
| support atomic instructions - in this case the associated mutexes also | |
| did not get properly initialized. | |
| - bugfix: mmanon did not detect all IP addresses in rewrite mode | |
| The problem occured if two IPs were close to each other and the first one | |
| was shrunk. | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=485 | |
| Thanks to micah-at-riseup.net for reporting this bug | |
| - bugfix: mmanon sometimes used invalid replacement char in simple mode | |
| depending on configuration sequence, the replacement character was set | |
| to 's' instead of the correct value. Most importantly, it was set to | |
| 's' if simple mode was selected and no replacement char set. | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=484 | |
| Thanks to micah-at-riseup.net for reporting this bug | |
| - bugfix: memory leak in mmnormalize | |
| - bugfix: array-based ==/!= comparisions lead to invalid results | |
| This was a regression introduced in 7.3.5 bei the PRI optimizer | |
| - bugfix: omprog blocked signals to executed programs | |
| The made it impossible to send signals to programs executed via | |
| omprog. | |
| Thanks to Risto Vaarandi for the analysis and a patch. | |
| - bugfix: doc: imuxsock legacy param $SystemLogSocketParseTrusted was | |
| misspelled | |
| Thanks to David Lang for alerting us | |
| - bugfix: imfile "facility" input parameter improperly handled | |
| caused facility not to be set, and severity to be overwritten with | |
| the facility value. | |
| Thanks to forum user dmunny for reporting this bug. | |
| - bugfix: small memory leak in imfile when $ResetConfigVariables was used | |
| Thanks to Grégory Nuyttens for reporting this bug and providig a fix | |
| - bugfix: segfault on startup if TLS was used but no CA cert set | |
| - bugfix: segfault on startup if TCP TLS was used but no cert or key set | |
| - bugfix: some more build problems with newer json-c versions | |
| Thanks to Michael Biebl for mentioning the problem. | |
| - bugfix: build system: libgcrypt.h needed even if libgrcypt was disabled | |
| Thanks to Jonny Törnbom for reporting this problem | |
| --------------------------------------------------------------------------- | |
| Version 7.4.4 [v7.4-stable] 2013-09-03 | |
| - better error messages in GuardTime signature provider | |
| Thanks to Ahto Truu for providing the patch. | |
| - make rsyslog use the new json-c pkgconfig file if available | |
| Thanks to the Gentoo team for the patches. | |
| - bugfix: imfile parameter "persistStateInterval" was unusable | |
| due to a case typo in imfile; work-around was to use legacy config | |
| Thanks to Brandon Murphy for reporting this bug. | |
| - bugfix: TLV16 flag encoding error in signature files from GT provider | |
| This fixes a problem where the TLV16 flag was improperly encoded. | |
| Unfortunately, existing files already have the bug and may not properly | |
| be processed. The fix uses constants from the GuardTime API lib to | |
| prevent such problems in the future. | |
| Thanks to Ahto Truu for providing the patch. | |
| - bugfix: slightly malformed SMTP handling in ommail | |
| - bugfix: segfault in omprog if no template was provided (now dflt is used) | |
| - bugfix: segfault in ompipe if no template was provided (now dflt is used) | |
| - bugfix: segfault in omsnmp if no template was provided (now dflt is used) | |
| - bugfix: some omsnmp optional config params were flagged as mandatory | |
| - bugfix: segfault in omelasticsearch when resuming queued messages | |
| after restarting Elasticsearch | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=464 | |
| - bugfix: imtcp addtlframedelimiter could not be set to zero | |
| Thanks to Chris Norton for alerting us. | |
| - doc bugfix: remove no-longer existing omtemplate from developer doc | |
| was specifically mentioned as a sample for creating new plugins | |
| Thanks to Yannick Brosseau for alerting us of this problem. | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=473 | |
| --------------------------------------------------------------------------- | |
| Version 7.4.3 [v7.4-stable] 2013-07-18 | |
| - bugfix: queue file size was not correctly processed | |
| this could lead to using one queue file per message for sizes >2GiB | |
| Thanks to Tomas Heinrich for the patch. | |
| - bugfix: $QHOUR/$HHOUR were always "00" or "01" | |
| regression some time between v5 and here | |
| Thanks to forum user rjmcinty for reporting this bug | |
| - bugfix: testbench tool chkseq did improperly report invalid file | |
| This happened when permitted duplicate values existed in the very | |
| last lines, right before end-of-file. | |
| Thanks to Radu Gheorghe for reporting this bug. | |
| --------------------------------------------------------------------------- | |
| Version 7.4.3 [v7.4-stable] 2013-07-18 | |
| - bugfix: memory leak if disk queues were used and json data present | |
| - bugfix: CEE/json data was lost during disk queue operation | |
| - bugfix: potential segfault during startup on invalid config | |
| could happen if invalid actions were present, which could lead | |
| to improper handling in optimizer. | |
| - bugfix: 100% CPU utilization when DA queue became full | |
| - bugfix: omlibdbi did not properly close connection on some errors | |
| This happened to errors occuring in Begin/End Transaction entry | |
| points. | |
| - cosmetic bugfix: file name buffer was not freed on disk queue destruction | |
| This was an extremely small one-time per run memleak, so nothing of | |
| concern. However, it bugs under valgrind and similar memory debuggers. | |
| - fix build on FreeBSD | |
| Thanks to Christiano Rolim for the patch | |
| --------------------------------------------------------------------------- | |
| Version 7.4.2 [v7.4-stable] 2013-07-04 | |
| - bugfix: in RFC5425 TLS, multiple wildcards in auth could cause segfault | |
| - bugfix: RainerScript object required parameters were not properly | |
| checked - this clould result to segfaults on startup if parameters | |
| were missing. | |
| - bugfix: double-free in omelasticsearch | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=461 | |
| a security advisory for this bug is available at: | |
| http://www.lsexperts.de/advisories/lse-2013-07-03.txt | |
| CVE: CVE-2013-4758 | |
| PLEASE NOTE: This issue only existed if omelasticsearch was used | |
| in a non-default configuration, where the "errorfile" parameter | |
| was specified. Without that parameter set, the bug could not | |
| be triggered. | |
| Thanks to Markus Vervier and Marius Ionescu for providing a detailled | |
| bug report. Special thanks to Markus for coordinating his security | |
| advisory with us. | |
| - bugfix: omrelp potential segfault at startup on invalid config parameters | |
| - bugfix: small memory leak when $uptime property was used | |
| - bugfix: potential segfault on rsyslog termination in imudp | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=456 | |
| - bugfix: lmsig_gt abort on invalid configuration parameters | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=448 | |
| Thanks to Risto Laanoja for the patch. | |
| - imtcp: fix typo in "listner" parameter, which is "listener" | |
| Currently, both names are accepted. | |
| - solved build problems on FreeBSD | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=457 | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=458 | |
| Thanks to Christiano for reproting and suggesting patches | |
| - solved build problems on CENTOS5 | |
| --------------------------------------------------------------------------- | |
| Version 7.4.1 [v7.4-stable] 2013-06-17 | |
| - imjournal: add ratelimiting capability | |
| The original imjournal code did not support ratelimiting at all. We | |
| now have our own ratelimiter. This can mitigate against journal | |
| database corruption, when the journal re-sends old data. This is a | |
| current bug in systemd journal, but we won't outrule this to happen | |
| in the future again. So it is better to have a safeguard in place. | |
| By default, we permit 20,000 messages witin 10 minutes. This may | |
| be a bit restrictive, but given the risk potential it seems reasonable. | |
| Users requiring larger traffic flows can always adjust the value. | |
| - bugfix: potential loop in rate limiting | |
| if the message that tells about rate-limiting gets rate-limited itself, | |
| it will potentially create and endless loop | |
| - bugfix: potential segfault in imjournal if journal DB is corrupted | |
| - bugfix: prevent a segfault in imjournal if state file is not defined | |
| - bugfix imzmq3: potential segfault on startup | |
| if no problem happend at startup, everything went fine | |
| Thanks to Hongfei Cheng and Brian Knox for the patch | |
| --------------------------------------------------------------------------- | |
| Version 7.4.0 [v7.4-stable] 2013-06-06 | |
| This starts a new stable branch based on 7.3.15 plus the following changes: | |
| - add --enable-cached-man-pages ./configure option | |
| permits to build rsyslog on a system where rst2man is not installed. In | |
| that case, cached versions of the man pages are used (they were built | |
| during "make dist", so they should be current for the version in | |
| question. | |
| - doc bugfix: ReadMode wrong in imfile doc, two values were swapped | |
| Thanks to jokajak@gmail.com for mentioning this | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=450 | |
| - imjournal: no longer do periodic wakeup | |
| - bugfix: potential hang *in debug mode* on rsyslogd termination | |
| This ONLY affected rsyslogd if it were running with debug output | |
| enabled. | |
| - bugfix: $template statement with multiple spaces lead to invalid tpl name | |
| If multiple spaces were used in front of the template name, all but one | |
| of them became actually part of the template name. So | |
| $template a,"..." would be name " a", and as such "a" was not | |
| available, e.g. in | |
| *.* /var/log/file;a | |
| This is a legacy config problem. As it was unreported for many years, | |
| no backport of the fix to old versions will happen. | |
| This is a long-standing bug that was only recently reported by forum | |
| user mc-sim. | |
| Reference: http://kb.monitorware.com/post23448.html | |
| - 0mq fixes; credits to Hongfei Cheng and Brian Knox | |
| --------------------------------------------------------------------------- | |
| Version 7.3.15 [beta] 2013-05-15 | |
| - bugfix: problem in build system (especially when cross-compiling) | |
| Thanks to Tomas Heinrich and winfried_mb2@xmsnet.nl for the patch. | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=445 | |
| - bugfix: imjournal had problem with systemd journal API change | |
| - imjournal: now obtain and include PID | |
| - bugfix: .logsig files had tlv16 indicator bit at wrong offset | |
| - bugfix: omrelp legacy config parameters set a timeout of zero | |
| which lead the legacy config to be unusable. | |
| - bugfix: segfault on startup if a disk queue was configure without file | |
| name | |
| Now this triggers an error message and the queue is changed to | |
| linkedList type. | |
| - bugfix: invalid addressing in string class (recent regression) | |
| --------------------------------------------------------------------------- | |
| Version 7.3.14 [beta] 2013-05-06 | |
| - bugfix: some man pages were not properly installed | |
| either rscryutil or rsgtutil man was installed, but not both | |
| Thanks to Marius Tomaschewski for the patch. | |
| - bugfix: potential segfault on startup when builtin module was specified | |
| in module() statement. | |
| Thanks to Marius Tomaschewski for reporting the bug. | |
| - bugfix: segfault due to invalid dynafile cache handling | |
| Accidently, the old-style cache size parameter was used when the | |
| dynafile cache was created in a RainerScript action. If the old-style | |
| size was lower than the one actually set, this lead to misadressing | |
| when the size was overrun, and that could lead to all kinds of | |
| "interesting things", often in segfaults. | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=440 | |
| --------------------------------------------------------------------------- | |
| Version 7.3.13 [beta] 2013-04-29 | |
| - added omrabbitmq module (contributed, untested) | |
| Note: this is unsupported and as such was moved immediately into the | |
| beta version. | |
| Thanks to Vaclav Tomec for providing this module. | |
| - bugfix: build problem when --enable-encryption was not selected | |
| Thanks to Michael Biebl for fixing this. | |
| - doc bugfix: omfile parameter "VeryRobustZip" was documentas as | |
| "VeryReliableZip" | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=437 | |
| Thanks to Thomas Doll for reporting this. | |
| --------------------------------------------------------------------------- | |
| Version 7.3.12 [devel] 2013-04-25 | |
| - added doc for omelasticsearch | |
| Thanks to Radu Gheorghe for the doc contribution. | |
| - omelasticsearch: _id field support for bulk operations | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=392 | |
| Thanks to Jérôme Renard for the idea and patches. | |
| - max number of templates for plugin use has been increased to five | |
| - platform compatibility enhancement: solve compile issue with libgcrypt | |
| do not use GCRY_CIPHER_MODE_AESWRAP where not available | |
| - fix compile on Solaris | |
| Thanks to Martin Carpenter for the patch. | |
| - bugfix: off-by-one error in handling local FQDN name (regression) | |
| A remporary buffer was allocated one byte too small. Did only | |
| affect startup, not actual operations. Came up during routine tests, | |
| and can have no effect once the engine runs. Bug was introduced in | |
| 7.3.11. | |
| - bugfix: build problems on Solaris | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=436 | |
| - bugfix: block size limit was not properly honored | |
| - bugfix: potential segfault in guardtime signature provider | |
| it could segfault if an error was reported by the GuardTime API, because | |
| an invalid free could happen then | |
| --------------------------------------------------------------------------- | |
| Version 7.3.11 [devel] 2013-04-23 | |
| - added support for encrypting log files | |
| - omhiredis: added support for redis pipeline support | |
| Thanks to Brian Knox for the patch. | |
| - bugfix: $PreserveFQDN is not properly working | |
| Thanks to Louis Bouchard for the patch | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=426 | |
| - bugfix: imuxsock aborted due to problem in ratelimiting code | |
| Thanks to Tomas Heinrich for the patch. | |
| - bugfix: imuxsock aborted under some conditions | |
| regression from ratelimiting enhancements - this was a different one | |
| to the one Tomas Heinrich patched. | |
| - bugfix: timestamp problems in imkmsg | |
| --------------------------------------------------------------------------- | |
| Version 7.3.10 [devel] 2013-04-10 | |
| - added RainerScript re_extract() function | |
| - omrelp: added support for RainerScript-based configuration | |
| - omrelp: added ability to specify session timeout | |
| - templates now permit substring extraction relative to end-of-string | |
| - bugfix: failover/action suspend did not work correctly | |
| This was experienced if the retry action took more than one second | |
| to complete. For suspending, a cached timestamp was used, and if the | |
| retry took longer, that timestamp was already in the past. As a | |
| result, the action never was kept in suspended state, and as such | |
| no failover happened. The suspend functionalit now does no longer use | |
| the cached timestamp (should not have any performance implication, as | |
| action suspend occurs very infrequently). | |
| - bugfix: gnutls RFC5425 driver had some undersized buffers | |
| Thanks to Tomas Heinrich for the patch. | |
| - bugfix: nested if/prifilt conditions did not work properly | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=415 | |
| - bugfix: imuxsock aborted under some conditions | |
| regression from ratelimiting enhancements | |
| - bugfix: build problems on Solaris | |
| Thanks to Martin Carpenter for the patches. | |
| --------------------------------------------------------------------------- | |
| Version 7.3.9 [devel] 2013-03-27 | |
| - support for signing logs added | |
| - imudp: now supports user-selectable inputname | |
| - omlibdbi: now supports transaction interface | |
| if recent enough lbdbi is present | |
| - imuxsock: add ability to NOT create/delete sockets during startup and | |
| shutdown | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=259 | |
| - imfile: errors persisting state file are now reported | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=292 | |
| - imfile: now detects file change when rsyslog was inactive | |
| Previosly, this case could not be detected, so if a file was overwritten | |
| or rotated away while rsyslog was stopped, some data was missing. This | |
| is now detected and the new file being forwarded right from the | |
| beginning. | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=228 | |
| - updated systemd files to match current systemd source | |
| - bugfix: imudp scheduling parameters did affect main thread, not imudp | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=409 | |
| - bugfix: build problem on platforms without GLOB_NOMAGIC | |
| - bugfix: build problems on non-Linux platforms | |
| - bugfix: stdout/stderr were not closed on forking | |
| but were closed when running in the forground - this was just reversed | |
| of what it should be. This is a regression of a recent change. | |
| --------------------------------------------------------------------------- | |
| Version 7.3.8 [devel] 2013-03-18 | |
| - imrelp: now supports listening to IPv4/v6 only instead of always both | |
| build now requires librelp 1.0.2 | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=378 | |
| - bugfix: mmanon did not build on some platforms (e.g. Ubuntu) | |
| - bugfix: segfault in expression optimizer | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=423 | |
| - bugfix: imuxsock was missing SysSock.ParseTrusted module parameter | |
| To use that functionality, legacy rsyslog.conf syntax had to be used. | |
| Also, the doc was missing information on the "ParseTrusted" set of | |
| config directives. | |
| - bugfix: include files got included in the wrong order | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=411 | |
| This happens if an $IncludeConfig directive was done on multiple | |
| files (e.g. the distro default of $IncludeConfig /etc/rsyslog.d/*.conf). | |
| In that case, the order of include file processing is reversed, which | |
| could lead to all sorts of problems. | |
| Thanks to Nathan Stratton Treadway for his great analysis of the problem, | |
| which made bug fixing really easy. | |
| --------------------------------------------------------------------------- | |
| Version 7.3.7 [devel] 2013-03-12 | |
| - add support for anonymizing IPv4 addresses | |
| - add support for writing to the Linux Journal (omjournal) | |
| - imuxsock: add capability to ignore messages from ourselfes | |
| This helps prevent message routing loops, and is vital to have | |
| if omjournal is used together with traditional syslog. | |
| - field() function now supports a string as field delimiter | |
| - added ability to configure debug system via rsyslog.conf | |
| - bugfix: imuxsock segfault when system log socket was used | |
| - bugfix: mmjsonparse segfault if new-style config was used | |
| - bugfix: script == comparison did not work properly on JSON objects | |
| - bugfix: field() function did never return "***FIELD NOT FOUND***" | |
| instead it returned "***ERROR in field() FUNCTION***" in that case | |
| --------------------------------------------------------------------------- | |
| Version 7.3.6 [devel] 2013-01-28 | |
| - greatly improved speed of large-array [N]EQ RainerScript comparisons | |
| Thanks to David Lang for a related discussion that inspired the idea | |
| to do this with a much simpler (yet sufficient) approach than orignally | |
| planned for. | |
| - greatly improved speed of DNS cache for large cache sizes | |
| - general performance improvements | |
| - omfile: added stats counters for dynafile caches | |
| - omfile: improved async writing, finally enabled full async write | |
| also fixed a couple of smaller issues along that way | |
| - impstats: added ability to write stats records to local file | |
| and avoid going through the syslog log stream. syslog logging can now | |
| also be turned off (see doc for details). | |
| - bugfix: imklog issued wrong facility in error messages | |
| ...what could lead to problems in other parts of the code | |
| - fix compile problem in imklog | |
| - added capability to output thread-id-to-function debug info | |
| This is a useful debug aid, but nothing of concern for regular users. | |
| --------------------------------------------------------------------------- | |
| Version 7.3.5 [devel] 2012-12-19 | |
| - ommysql: addded batching/transaction support | |
| - enhanced script optimizer to optimize common PRI-based comparisons | |
| These constructs are especially used in SUSE default config files, | |
| but also by many users (as they are more readable than the equivalent | |
| PRI-based filter). | |
| - omudpspoof: add support for new config system | |
| - omudpspoof: add support for packets larger than 1472 bytes | |
| On Ethernet, they need to be transmitted in multiple fragments. While | |
| it is known that fragmentation can cause issues, it is the best choice | |
| to be made in that case. Also improved debug output. | |
| - bugfix: omudpspoof failed depending on the execution environment | |
| The v7 engine closes fds, and closed some of libnet's fds as well, what | |
| lead to problems (unfortunately, at least some libnet versions do not | |
| report a proper error state but still "success"...). The order of libnet | |
| calls has been adjusted to by in sync with what the core engine does. | |
| - bugfix: segfault on imuxsock startup if system log socket is used | |
| and no ratelimiting supported. Happens only during initial config | |
| read phase, once this is over, everything works stable. | |
| - bugfix: mmnormalize build problems | |
| - bugfix: mmnormalize could abort rsyslog if config parameter was in error | |
| - bugfix: no error message for invalid string template parameters | |
| rather a malformed template was generated, and error information emitted | |
| at runtime. However, this could be quite confusing. Note that with this | |
| "bugfix" user experience changes: formerly, rsyslog and the affected | |
| actions properly started up, but the actions did not produce proper | |
| data. Now, there are startup error messages and the actions are NOT | |
| executed (due to missing template due to template error). | |
| - bugfix[minor]: invalid error code when mmnormalize could not access | |
| rulebase | |
| - bugfix(kind of): script optimizer did not work for complex boolean | |
| expressions | |
| - doc bugfix: corrections and improvements in mmnormalize html doc page | |
| - bugfix: some message properties could be garbled due to race condition | |
| This happened only on very high volume systems, if the same message was | |
| being processed by two different actions. This was a regression caused | |
| by the new config processor, which did no longer properly enable msg | |
| locking in multithreaded cases. The bugfix is actually a refactoring of | |
| the msg locking code - we no longer do unlocked operations, as the use | |
| case for it has mostly gone away. It is potentially possible only at | |
| very low-end systems, and there the small additional overhead of doing | |
| the locking does not really hurt. Instead, the removal of that | |
| capability can actually slightly improve performance in common cases, | |
| as the code path is smaller and requires slightly less memory writes. | |
| That probably outperforms the extra locking overhead (which in the | |
| low-end case always happens in user space, without need for kernel | |
| support as we can always directly aquire the lock - there is no | |
| contention at all). | |
| - build system cleanup (thanks to Michael Biebl for this!) | |
| - bugfix: omelasticsearch did not properly compile on some platforms | |
| due to missing libmath. Thanks to Michael Biebl for the fix | |
| --------------------------------------------------------------------------- | |
| Version 7.3.4 [devel] 2012-11-23 | |
| - further (and rather drastically) improved disk queue performance | |
| we now save one third of the IO calls | |
| - imklog: added ParseKernelTimestamp parameter (import from 5.10.2) | |
| Thanks to Marius Tomaschewski for the patch. | |
| - imklog: added KeepKernelTimestamp parameter (import from 5.10.2) | |
| Thanks to Marius Tomaschewski for the patch. | |
| - bugfix: improper handling of backslash in string-type template()s | |
| - bugfix: leading quote (") in string-type template() lead to thight loop | |
| on startup | |
| - bugfix: no error msg on invalid field option in legacy/string template | |
| - bugfix: imklog mistakenly took kernel timestamp subseconds as nanoseconds | |
| ... actually, they are microseconds. So the fractional part of the | |
| timestamp was not properly formatted. (import from 5.10.2) | |
| Thanks to Marius Tomaschewski for the bug report and the patch idea. | |
| --------------------------------------------------------------------------- | |
| Version 7.3.3 [devel] 2012-11-07 | |
| - improved disk queue performance | |
| - bugfix: dynafile zip files could be corrupted | |
| This could happen if a dynafile was destructed before the first write. | |
| In practice, this could happen if few lines were written to a file and | |
| it then became evicted from the dynafile cache. This would probably | |
| look very random, because it depended on the timing in regard to | |
| message volume and dynafile cache size. | |
| --------------------------------------------------------------------------- | |
| Version 7.3.2 [devel] 2012-10-30 | |
| - mmnormalize: support for v6+ config interface added | |
| - mmjsonparse: support for v6+ config interface added | |
| --------------------------------------------------------------------------- | |
| Version 7.3.2 [devel] 2012-10-30 | |
| - totally reworked ratelimiting and "last message repeated n times" | |
| all over rsyslog code. Each of the supported inputs now supports | |
| linux-like ratelimiting (formerly only imuxsock did). Also, the | |
| "last message repeated n times" is now processed at the input side | |
| and no longer at the output side of rsyslog processing. This | |
| provides the basis for new future additions as well as usually more | |
| performance and a much simpler output part (which can be even further | |
| refactored). | |
| - imtcp: support for Linux-Type ratelimiting added | |
| - imptcp: support for Linux-Type ratelimiting added | |
| - imudp enhancements: | |
| * support for input batching added (performance improvement) | |
| * support for Linux-Type ratelimiting added | |
| - permited action-like statements (stop, call, ...) in action lists | |
| - bugfix: segfault on startup when modules using MSG_PASSING mode are used | |
| - omelasticsearch: support for writing data errors to local file added | |
| - omelasticsearch: fix check for bulk processing status response | |
| --------------------------------------------------------------------------- | |
| Version 7.3.1 [devel] 2012-10-19 | |
| - optimized template processing performance, especially for $NOW family | |
| of properties | |
| - change lumberjack cookie to "@cee:" from "@cee: " | |
| CEE originally specified the cookie with SP, whereas other lumberjack | |
| tools used it without space. In order to keep interop with lumberjack, | |
| we now use the cookie without space as well. I hope this can be changed | |
| in CEE as well when it is released at a later time. | |
| Thanks to Miloslav Trmač for pointing this out and a similiar v7 patch. | |
| - bugfix: imuxsock and imklog truncated head of received message | |
| This happened only under some circumstances. Thanks to Marius | |
| Tomaschewski, Florian Piekert and Milan Bartos for their help in | |
| solving this issue. | |
| - bugfix: imuxsock did not properly honor $LocalHostIPIF | |
| --------------------------------------------------------------------------- | |
| Version 7.3.0 [devel] 2012-10-09 | |
| - omlibdbi improvements, added | |
| * support for config load phases & module() parameters | |
| * support for default templates | |
| * driverdirectory is now cleanly a global parameter, but can no longer | |
| be specified as an action parameter. Note that in previous versions | |
| this parameter was ignored in all but the first action definition | |
| - improved omfile zip writer to increase compression | |
| This was achieved by somewhat reducing the robustness of the zip archive. | |
| This is controlled by the new action parameter "VeryReliableZip". | |
| ---------------------------------------------------------------------------- | |
| Version 7.2.8 [v7-stable] 2013-0?-?? | |
| - bugfix: potential segfault on startup when builtin module was specified | |
| in module() statement. | |
| Thanks to Marius Tomaschewski for reporting the bug. | |
| - bugfix: segfault due to invalid dynafile cache handling | |
| Accidently, the old-style cache size parameter was used when the | |
| dynafile cache was created in a RainerScript action. If the old-style | |
| size was lower than the one actually set, this lead to misadressing | |
| when the size was overrun, and that could lead to all kinds of | |
| "interesting things", often in segfaults. | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=440 | |
| ---------------------------------------------------------------------------- | |
| Version 7.2.7 [v7-stable] 2013-04-17 | |
| - rsyslogd startup information is now properly conveyed back to init | |
| when privileges are beging dropped | |
| Actually, we have moved termination of the parent in front of the | |
| priv drop. So it shall work now in all cases. See code comments in | |
| commit for more details. | |
| - If forking, the parent now waits for a maximum of 60 seconds for | |
| termination by the child | |
| - improved debugging support in forked (auto-backgrounding) mode | |
| The rsyslog debug log file is now continued to be written across the | |
| fork. | |
| - updated systemd files to match current systemd source | |
| - bugfix: failover/action suspend did not work correctly | |
| This was experienced if the retry action took more than one second | |
| to complete. For suspending, a cached timestamp was used, and if the | |
| retry took longer, that timestamp was already in the past. As a | |
| result, the action never was kept in suspended state, and as such | |
| no failover happened. The suspend functionalit now does no longer use | |
| the cached timestamp (should not have any performance implication, as | |
| action suspend occurs very infrequently). | |
| - bugfix: nested if/prifilt conditions did not work properly | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=415 | |
| - bugfix: script == comparison did not work properly on JSON objects | |
| [backport from 7.3 branch] | |
| - bugfix: imudp scheduling parameters did affect main thread, not imudp | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=409 | |
| - bugfix: imuxsock rate-limiting could not be configured via legacy conf | |
| Rate-limiting for the system socket could not be configured via legacy | |
| configuration directives. However, the new-style RainerScript config | |
| options worked. | |
| Thanks to Milan Bartos for the patch. | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=390 | |
| - bugfix: using group resolution could lead to endless loop | |
| Thanks to Tomas Heinrich for the patch. | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=310 | |
| - bugfix: $mmnormalizeuseramsg parameter was specified with wrong type | |
| Thank to Renzhong Zhang for alerting us of the problem. | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=420 | |
| - bugfix: RainerScript getenv() function caused segfault when var was | |
| not found. | |
| Thanks to Philippe Muller for the patch. | |
| - bugfix: several issues in imkmsg | |
| see bug tracker: http://bugzilla.adiscon.com/show_bug.cgi?id=421#c8 | |
| - bugfix: imuxsock was missing SysSock.ParseTrusted module parameter | |
| To use that functionality, legacy rsyslog.conf syntax had to be used. | |
| Also, the doc was missing information on the "ParseTrusted" set of | |
| config directives. | |
| - bugfix: parameter action.execOnlyWhenPreviousIsSuspended was accidently | |
| of integer-type. For obvious reasons, it needs to be boolean. Note | |
| that this change can break existing configurations if they circumvented | |
| the problem by using 0/1 values. | |
| - doc bugfix: rsyslog.conf man page had invalid file format info | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=418 | |
| ---------------------------------------------------------------------------- | |
| Version 7.2.6 [v7-stable] 2013-03-05 | |
| - slightly improved config parser error messages when invalid escapes happen | |
| - bugfix: include files got included in the wrong order | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=411 | |
| This happens if an $IncludeConfig directive was done on multiple | |
| files (e.g. the distro default of $IncludeConfig /etc/rsyslog.d/*.conf). | |
| In that case, the order of include file processing is reversed, which | |
| could lead to all sorts of problems. | |
| Thanks to Nathan Stratton Treadway for his great analysis of the problem, | |
| which made bug fixing really easy. | |
| - bugfix: omelasticsearch failed when authentication data was provided | |
| ... at least in most cases it emitted an error message: | |
| "snprintf failed when trying to build auth string" | |
| Thanks to Joerg Heinemann for alerting us. | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=404 | |
| - bugfix: some property-based filter were incorrectly parsed | |
| This usually lead to a syntax error on startup and rsyslogd not actually | |
| starting up. The problem was the regex, which did not care for double | |
| quote characters to follow in the action part - unfortunately something | |
| that can frequently happen with v6+ format. An example: | |
| :programname, isequal, "as" {action(type="omfile" ...) } | |
| Here, the part | |
| :programname, isequal, "as" {action(type="omfile" | |
| was treated as the property filter, and the rest as action part. | |
| Obviously, this did not work out. Unfortunately, such situations usually | |
| resulted in very hard to understand error messages. | |
| ---------------------------------------------------------------------------- | |
| Version 7.2.5 [v7-stable] 2013-01-08 | |
| - build system cleanup (thanks to Michael Biebl for this!) | |
| - bugfix: omelasticsearch did not properly compile on some platforms | |
| due to missing libmath. Thanks to Michael Biebl for the fix | |
| - bugfix: invalid DST handling under Solaris | |
| Thanks to Scott Severtson for the patch. | |
| - bugfix: on termination, actions were incorrectly called | |
| The problem was that incomplete fiter evaluation was done *during the | |
| shutdown phase*. This affected only the LAST batches being processed. No | |
| problem existed during the regular run. Could usually only happen on | |
| very busy systems, which were still busy during shutdown. | |
| - bugfix: very large memory consumption (and probably out of memory) when | |
| FromPos was specified in template, but ToPos not. | |
| Thanks to Radu Gheorghe for alerting us of this bug. | |
| - bugfix: timeval2syslogTime cause problems on some platforms | |
| due to invalid assumption on structure data types. | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=394 | |
| Thanks to David Hill for the patch [under ASL2.0 as per email conversation | |
| 2013-01-03]. | |
| - bugfix: compile errors in im3195 | |
| Thanks to Martin Körper for the patch | |
| - bugfix: doGetFileCreateMode() had invalid validity check ;) | |
| Thanks to Chandler Latour for the patch. | |
| - bugfix: mmjsonparse errornously returned action error when no CEE cookie | |
| was present. | |
| ---------------------------------------------------------------------------- | |
| Version 7.2.4 [v7-stable] 2012-12-07 | |
| - enhance: permit RFC3339 timestamp in local log socket messages | |
| Thanks to Sebastien Ponce for the patch. | |
| - imklog: added ParseKernelTimestamp parameter (import from 5.10.2) | |
| Thanks to Marius Tomaschewski for the patch. | |
| - fix missing functionality: ruleset(){} could not specify ruleset queue | |
| The "queue.xxx" parameter set was not supported, and legacy ruleset | |
| config statements did not work (by intention). The fix introduces the | |
| "queue.xxx" parameter set. It has some regression potential, but only | |
| for the new functionality. Note that using that interface it is possible | |
| to specify duplicate queue file names, which will cause trouble. This | |
| will be solved in v7.3, because there is a too-large regression | |
| potential for the v7.2 stable branch. | |
| - imklog: added KeepKernelTimestamp parameter (import from 5.10.2) | |
| Thanks to Marius Tomaschewski for the patch. | |
| - bugfix: imklog mistakenly took kernel timestamp subseconds as nanoseconds | |
| ... actually, they are microseconds. So the fractional part of the | |
| timestamp was not properly formatted. (import from 5.10.2) | |
| Thanks to Marius Tomaschewski for the bug report and the patch idea. | |
| - bugfix: supportoctetcountedframing parameter did not work in imptcp | |
| - bugfix: modules not (yet) supporting new conf format were not properly | |
| registered. This lead to a "module not found" error message instead of | |
| the to-be-expected "module does not support new style" error message. | |
| That invalid error message could be quite misleading and actually stop | |
| people from addressing the real problem (aka "go nuts" ;)) | |
| - bugfix: template "type" parameter is mandatory (but was not) | |
| - bugfix: some message properties could be garbled due to race condition | |
| This happened only on very high volume systems, if the same message was | |
| being processed by two different actions. This was a regression caused | |
| by the new config processor, which did no longer properly enable msg | |
| locking in multithreaded cases. The bugfix is actually a refactoring of | |
| the msg locking code - we no longer do unlocked operations, as the use | |
| case for it has mostly gone away. It is potentially possible only at | |
| very low-end systems, and there the small additional overhead of doing | |
| the locking does not really hurt. Instead, the removal of that | |
| capability can actually slightly improve performance in common cases, | |
| as the code path is smaller and requires slightly less memory writes. | |
| That probably outperforms the extra locking overhead (which in the | |
| low-end case always happens in user space, without need for kernel | |
| support as we can always directly aquire the lock - there is no | |
| contention at all). | |
| ---------------------------------------------------------------------------- | |
| Version 7.2.3 [v7-stable] 2012-10-21 | |
| - regression fix: rsyslogd terminated when wild-card $IncludeConfig did not | |
| find actual include files. For example, if this directive is present: | |
| $IncludeConfig /etc/rsyslog.d/*.conf | |
| and there are no *.conf files in /etc/rsyslog.d (but rsyslog.d exists), | |
| rsyslogd will emit an error message and terminate. Previous (and expected) | |
| behaviour is that an empty file set is no problem. HOWEVER, if the | |
| directory itself does not exist, this is flagged as an error and will | |
| load to termination (no startup). | |
| Unfortunately, this is often the case by default in many distros, so this | |
| actually prevents rsyslog startup. | |
| ---------------------------------------------------------------------------- | |
| Version 7.2.2 [v7-stable] 2012-10-16 | |
| - doc improvements | |
| - enabled to build without libuuid, at loss of uuid functionality | |
| this enables smoother builds on older systems that do not support | |
| libuuid. Loss of functionality should usually not matter too much as | |
| uuid support has only recently been added and is very seldom used. | |
| - bugfix: omfwd did not properly support "template" parameter | |
| - bugfix: potential segfault when re_match() function was used | |
| Thanks to oxpa for the patch. | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=371 | |
| - bugfix: potential abort of imtcp on rsyslogd shutdown | |
| - bugfix: imzmq3 segfault with PULL subscription | |
| Thanks to Martin Nilsson for the patch. | |
| - bugfix: improper handling of backslash in string-type template()s | |
| - bugfix: leading quote (") in string-type template() lead to thight loop | |
| on startup | |
| - bugfix: no error msg on invalid field option in legacy/string template | |
| - bugfix: potential segfault due to invalid param handling in comparisons | |
| This could happen in RainerScript comparisons (like contains); in some | |
| cases an unitialized variable was accessed, which could lead to an | |
| invalid free and in turn to a segfault. | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=372 | |
| Thanks to Georgi Georgiev for reporting this bug and his great help | |
| in solving it. | |
| - bugfix: no error msg on unreadable $IncludeConfig path | |
| - bugfix: $IncludeConfig did not correctly process directories | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=376 | |
| The testbench was also enhanced to check for these cases. | |
| Thanks to Georgi Georgiev for the bug report. | |
| - bugfix: make rsyslog compile on kfreebsd again | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=380 | |
| Thanks to Guillem Jover for the patch. | |
| - bugfix: garbled message if field name was used with jsonf property option | |
| The length for the field name was invalidly computed, resulting in either | |
| truncated field names or including extra random data. If the random data | |
| contained NULs, the rest of the message became unreadable. | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=374 | |
| - bugfix: potential segfault at startup with property-based filter | |
| If the property name was followed by a space before the comma, rsyslogd | |
| aborted on startup. Note that no segfault could happen if the initial | |
| startup went well (this was a problem with the config parser). | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=381 | |
| - bugfix: imfile discarded some file parts | |
| File lines that were incomplete (LF missing) *at the time imfile polled | |
| the file* were partially discarded. That part of the line that was read | |
| without the LF was discarded, and the rest of the line was submitted in | |
| the next polling cycle. This is now changed so that the partial content | |
| is saved until the complete line is read. Note that the patch affects | |
| only read mode 0. | |
| Thanks to Milan Bartos for providing the base idea for the solution. | |
| ---------------------------------------------------------------------------- | |
| Version 7.2.1 [v7-stable] 2012-10-29 | |
| - bugfix: ruleset()-object did only support a single statement | |
| - added -D rsyslogd option to enable config parser debug mode | |
| - improved syntax error messages by outputting the error token | |
| - the rsyslog core now suspeneds actions after 10 failures in a row | |
| This was former the case after 1,000 failures and could cause rsyslog | |
| to be spammed/ressources misused. See the v6 compatibility doc for more | |
| details. | |
| - ommongodb rate-limits error messages to prevent spamming the syslog | |
| closes (for v7.2): http://bugzilla.adiscon.com/show_bug.cgi?id=366 | |
| ---------------------------------------------------------------------------- | |
| Version 7.2.0 [v7-stable] 2012-10-22 | |
| This starts a new stable branch based on 7.1.12 plus the following changes: | |
| - bugfix: imuxsock did not properly honor $LocalHostIPIF | |
| - omruleset/omdiscard do no longer issue "deprecated" warings, as 7.1 | |
| grammar does not permit to use the replacements under all circumstances | |
| ---------------------------------------------------------------------------- | |
| Version 7.1.12 [beta] 2012-10-18 | |
| - minor updates to better support newer systemd developments | |
| Thanks to Michael Biebl for the patches. | |
| - build system cleanup | |
| Thanks to Michael Biebl for the patch series. | |
| - cleanup: removed remains of -c option (compatibility mode) | |
| both from code & doc and emitted warning message if still used | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=361 | |
| Thanks to Michael Biebl for reporting & suggestions | |
| - bugfix: imklog truncated head of received message | |
| This happened only under some circumstances. Thanks to Marius | |
| Tomaschewski and Florian Piekert for their help in solving this issue. | |
| ---------------------------------------------------------------------------- | |
| Version 7.1.11 [beta] 2012-10-16 | |
| - bugfix: imuxsock truncated head of received message | |
| This happened only under some circumstances. Thanks to Marius | |
| Tomaschewski, Florian Piekert and Milan Bartos for their help in | |
| solving this issue. | |
| - bugfix: do not crash if set statement is used with date field | |
| Thanks to Miloslav Trmač for the patch. | |
| - change lumberjack cookie to "@cee:" from "@cee: " | |
| CEE originally specified the cookie with SP, whereas other lumberjack | |
| tools used it without space. In order to keep interop with lumberjack, | |
| we now use the cookie without space as well. I hope this can be changed | |
| in CEE as well when it is released at a later time. | |
| Thanks to Miloslav Trmač for pointing this out and a similiar v7 patch. | |
| - added deprecated note to omruleset (plus clue to use "call") | |
| - added deprecated note to discard action (plus clue to use "stop") | |
| --------------------------------------------------------------------------- | |
| Version 7.1.10 [beta] 2012-10-11 | |
| - bugfix: m4 directory was not present in release tarball | |
| - bugfix: small memory leak with string-type templates | |
| - bugfix: small memory leak when template was specified in omfile | |
| - bugfix: some config processing warning messages were treated as errors | |
| - bugfix: small memory leak when processing action() statements | |
| - bugfix: unknown action() parameters were not reported | |
| --------------------------------------------------------------------------- | |
| Version 7.1.9 [beta] 2012-10-09 | |
| - bugfix: comments inside objects (e.g. action()) were not properly handled | |
| - bugfix: in (non)equal comparisons the position of arrays influenced result | |
| This behaviour is OK for "contains"-type of comparisons (which have quite | |
| different semantics), but not for == and <>, which shall be commutative. | |
| This has been fixed now, so there is no difference any longer if the | |
| constant string array is the left or right hand operand. We solved this | |
| via the optimizer, as it keeps the actual script execution code small. | |
| --------------------------------------------------------------------------- | |
| Version 7.1.8 [beta] 2012-10-02 | |
| - bugfix: ruleset(){} directive errornously changed default ruleset | |
| much like the $ruleset legacy conf statement. This potentially lead | |
| to statements being assigned to the wrong ruleset. | |
| - improved module doc | |
| - added "parser" parameter to ruleset(), so that parser chain can be | |
| configured | |
| - implemented "continue" RainerScript statement | |
| --------------------------------------------------------------------------- | |
| Version 7.1.7 [devel] 2012-10-01 | |
| - implemented RainerScript "call" statement | |
| - implemented RainerScript array-based string comparison operations | |
| - implemented imtcp "permittedPeers" module-global parameter | |
| - imudp: support for specifying multiple ports via array added | |
| --------------------------------------------------------------------------- | |
| Version 7.1.6 [devel] 2012-09-28 | |
| - implemented RainerScript input() statement, including support for it | |
| in major input plugins | |
| - implemented RainerScript ruleset() statement | |
| --------------------------------------------------------------------------- | |
| Version 7.1.5 [devel] 2012-09-25 | |
| - implemented RainerScript prifield() function | |
| - implemented RainerScript field() function | |
| - added new module imkmsg to process structured kernel log | |
| Thanks to Milan Bartos for contributing this module | |
| - implemented basic RainerScript optimizer, which will speed up script | |
| operations | |
| - bugfix: invalid free if function re_match() was incorrectly used | |
| if the config file parser detected that param 2 was not constant, some | |
| data fields were not initialized. The destructor did not care about that. | |
| This bug happened only if rsyslog startup was unclean. | |
| --------------------------------------------------------------------------- | |
| Version 7.1.4 [devel] 2012-09-19 | |
| - implemented ability for CEE-based properties to be stored in disk queues | |
| - implemented string concatenation in expressions via &-operator | |
| - implemented json subtree copy in variable assignment | |
| - implemented full JSON support for variable manipulation | |
| - introduced "subtree"-type templates | |
| - bugfix: omfile action did not respect "template" parameter | |
| ... and used default template in all cases | |
| - bugfix: MsgDup() did not copy CEE structure | |
| This function was called at various places, most importantly during | |
| "last messages repeated n times" processing and omruleset. If CEE(JSON) | |
| data was present, it was lost as part of the copy process. | |
| - bugfix: debug output indicated improper queue type | |
| --------------------------------------------------------------------------- | |
| Version 7.1.3 [devel] 2012-09-17 | |
| - introduced "set" and "unset" config statements | |
| - bugfix: missing support for escape sequences in RainerScript | |
| only \' was supported. Now the usual set is supported. Note that v5 | |
| used \x as escape where x was any character (e.g. "\n" meant "n" and NOT | |
| LF). This also means there is some incompatibility to v5 for well-know | |
| sequences. Better break it now than later. | |
| - bugfix: invalid property name in property-filter could cause abort | |
| if action chaining (& operator) was used | |
| http://bugzilla.adiscon.com/show_bug.cgi?id=355 | |
| Thanks to pilou@gmx.com for the bug report | |
| --------------------------------------------------------------------------- | |
| Version 7.1.2 [devel] 2012-09-12 | |
| - bugfix: messages were duplicated, sometimes massively | |
| regression from new code in 7.1.1 and reason for early release | |
| - bugfix: remove invalid socket option call from imuxsock | |
| Thanks to Cristian Ionescu-Idbohrn and Jonny Törnbom | |
| - bugfix: abort when invalid property name was configured | |
| in property-based filter | |
| - bugfix: multiple rulesets did no longer work correctly (7.1.1 regression) | |
| --------------------------------------------------------------------------- | |
| Version 7.1.1 [devel] 2012-09-11 | |
| - MAJOR NEW FEATURE: rulengine now fully supports nesting | |
| including if ... then ... else ... constructs. This is a big change | |
| and it obviously has a lot of bug potential. | |
| - BSD-style (filter) blocks are no longer supported | |
| see http://www.rsyslog.com/g/BSD for details and solution | |
| - imuxsock now stores trusted properties by default in the CEE root | |
| This was done in order to keep compatible with other implementations of | |
| the lumberjack schema | |
| Thanks to Miloslav Trmač for pointing to this. | |
| - bugfix: string-generating templates caused abort if CEE field could not | |
| be found | |
| --------------------------------------------------------------------------- | |
| Version 7.1.0 [devel] 2012-09-06 | |
| - added support for hierarchical properties (CEE/lumberjack) | |
| - added pure JSON output plugin parameter passing mode | |
| - ommongodb now supports templates | |
| - bugfix: imtcp could abort on exit due to invalid free() | |
| - imported bugfixes from 6.4.1 | |
| --------------------------------------------------------------------------- | |
| Version 6.6.1 [v6-stable] 2012-10-?? | |
| - bugfix: build problems on some platforms | |
| - bugfix: misaddressing of $mmnormalizeuserawmsg parameter | |
| On many platforms, this has no effect at all. At some, it may cause | |
| a segfault. The problem occurs only during config phase, no segfault | |
| happens when rsyslog has fully started. | |
| - fix API "glitch" in some plugins | |
| This did not affect users, but could have caused trouble in the future | |
| for developers. | |
| - bugfix: no error msg on invalid field option in legacy/string template | |
| - bugfix: no error msg on unreadable $IncludeConfig path | |
| - bugfix: $IncludeConfig did not correctly process directories | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=376 | |
| The testbench was also enhanced to check for these cases. | |
| Thanks to Georgi Georgiev for the bug report. | |
| - bugfix: spurios error messages from imuxsock about (non-error) EAGAIN | |
| Thanks to Marius Tomaschewski for the patch. | |
| - imklog: added $klogParseKernelTimestamp option | |
| When enabled, kernel message [timestamp] is converted for message time. | |
| Default is to use receive time as in 5.8.x and before, because the clock | |
| used to create the timestamp is not supposed to be as accurate as the | |
| monotonic clock (depends on hardware and kernel) resulting in differences | |
| between kernel and system messages which occurred at same time. | |
| Thanks to Marius Tomaschewski for the patch. | |
| - imklog: added $klogKeepKernelTimestamp option | |
| When enabled, the kernel [timestamp] remains at begin of | |
| each message, even it is used for the message time too. | |
| Thanks to Marius Tomaschewski for the patch. | |
| - bugfix: imklog mistakenly took kernel timestamp subseconds as nanoseconds | |
| ... actually, they are microseconds. So the fractional part of the | |
| timestamp was not properly formatted. | |
| Thanks to Marius Tomaschewski for the bug report and the patch idea. | |
| - bugfix: hostname set in rsyslog.conf was not picked up until HUP | |
| which could also mean "never" or "not for a very long time". | |
| Thanks to oxpa for providing analysis and a patch | |
| - bugfix: some message properties could be garbled due to race condition | |
| This happened only on very high volume systems, if the same message was | |
| being processed by two different actions. This was a regression caused | |
| by the new config processor, which did no longer properly enable msg | |
| locking in multithreaded cases. The bugfix is actually a refactoring of | |
| the msg locking code - we no longer do unlocked operations, as the use | |
| case for it has mostly gone away. It is potentially possible only at | |
| very low-end systems, and there the small additional overhead of doing | |
| the locking does not really hurt. Instead, the removal of that | |
| capability can actually slightly improve performance in common cases, | |
| as the code path is smaller and requires slightly less memory writes. | |
| That probably outperforms the extra locking overhead (which in the | |
| low-end case always happens in user space, without need for kernel | |
| support as we can always directly aquire the lock - there is no | |
| contention at all). | |
| - bugfix: invalid DST handling under Solaris | |
| Thanks to Scott Severtson for the patch. | |
| --------------------------------------------------------------------------- | |
| Version 6.6.0 [v6-stable] 2012-10-22 | |
| This starts a new stable branch, based on the 6.5.x series, plus: | |
| - bugfix: imuxsock did not properly honor $LocalHostIPIF | |
| --------------------------------------------------------------------------- | |
| Version 6.5.1 [beta] 2012-10-11 | |
| - added tool "logctl" to handle lumberjack logs in MongoDB | |
| - imfile ported to new v6 config interface | |
| - imfile now supports config parameter for maximum number of submits | |
| which is a fine-tuning parameter in regard to input baching | |
| - added pure JSON output plugin parameter passing mode | |
| - ommongodb now supports templates | |
| - bugfix: imtcp could abort on exit due to invalid free() | |
| - bugfix: remove invalid socket option call from imuxsock | |
| Thanks to Cristian Ionescu-Idbohrn and Jonny Törnbom | |
| - added pure JSON output plugin parameter passing mode | |
| - ommongodb now supports templates | |
| - bugfix: imtcp could abort on exit due to invalid free() | |
| - bugfix: missing support for escape sequences in RainerScript | |
| only \' was supported. Now the usual set is supported. Note that v5 | |
| used \x as escape where x was any character (e.g. "\n" meant "n" and NOT | |
| LF). This also means there is some incompatibility to v5 for well-know | |
| sequences. Better break it now than later. | |
| - bugfix: small memory leaks in template() statements | |
| these were one-time memory leaks during startup, so they did NOT grow | |
| during runtime | |
| - bugfix: config validation run did not always return correct return state | |
| - bugfix: config errors did not always cause statement to fail | |
| This could lead to startup with invalid parameters. | |
| --------------------------------------------------------------------------- | |
| Version 6.5.0 [devel] 2012-08-28 | |
| - imrelp now supports non-cancel thread termination | |
| (but now requires at least librelp 1.0.1) | |
| - implemented freeCnf() module interface | |
| This was actually not present in older versions, even though some modules | |
| already used it. The implementation was now done, and not in 6.3/6.4 | |
| because the resulting memory leak was ultra-slim and the new interface | |
| handling has some potential to seriously break things. Not the kind of | |
| thing you want to add in late beta state, if avoidable. | |
| - added --enable-debugless configure option for very high demanding envs | |
| This actually at compile time disables a lot of debug code, resulting | |
| in some speedup (but serious loss of debugging capabilities) | |
| - added new 0mq plugins (via czmq lib) | |
| Thanks to David Kelly for contributing these modules | |
| - bugfix: omhdfs did no longer compile | |
| - bugfix: SystemLogSocketAnnotate did not work correctly | |
| Thanks to Miloslav Trmač for the patch | |
| - $SystemLogParseTrusted config file option | |
| Thanks to Milan Bartos for the patch | |
| - added template config directive | |
| - added new uuid message property | |
| Thanks to Jérôme Renard for the idea and patches. | |
| Note: patches were released under ASL 2.0, see | |
| http://bugzilla.adiscon.com/show_bug.cgi?id=353 | |
| --------------------------------------------------------------------------- | |
| Version 6.4.3 [V6-STABLE/NEVER RELEASED] 2012-??-?? | |
| This version was never released as 6.6.0 came quickly enough. Note that | |
| all these patches here are present in 6.6.0. | |
| - cleanup: removed remains of -c option (compatibility mode) | |
| both from code & doc and emitted warning message if still used | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=361 | |
| Thanks to Michael Biebl for reporting & suggestions | |
| - bugfix: imuxsock and imklog truncated head of received message | |
| This happened only under some circumstances. Thanks to Marius | |
| Tomaschewski, Florian Piekert and Milan Bartos for their help in | |
| solving this issue. | |
| - change lumberjack cookie to "@cee:" from "@cee: " | |
| CEE originally specified the cookie with SP, whereas other lumberjack | |
| tools used it without space. In order to keep interop with lumberjack, | |
| we now use the cookie without space as well. I hope this can be changed | |
| in CEE as well when it is released at a later time. | |
| Thanks to Miloslav Trmač for pointing this out and a similiar v7 patch. | |
| - bugfix: comments inside objects (e.g. action()) were not properly handled | |
| - bugfix: sysklogd-emulating standard template was no longer present in v6 | |
| This was obviously lost during the transition to the new config format. | |
| Thanks to Milan Bartos for alerting us and a patch! | |
| - bugfix: some valid legacy PRI filters were flagged as errornous | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=358 | |
| This happend to filters of the style "local0,local1.*", where the | |
| multiple facilities were comma-separated. | |
| - bugfix: imuxsock did not properly honor $LocalHostIPIF | |
| --------------------------------------------------------------------------- | |
| Version 6.4.2 [V6-STABLE] 2012-09-20 | |
| - bugfix: potential abort, if action queue could not be properly started | |
| This most importantly could happen due to configuration errors. | |
| - bugfix: remove invalid socket option call from imuxsock | |
| Thanks to Cristian Ionescu-Idbohrn and Jonny Törnbom | |
| - bugfix: missing support for escape sequences in RainerScript | |
| only \' was supported. Now the usual set is supported. Note that v5 | |
| used \x as escape where x was any character (e.g. "\n" meant "n" and NOT | |
| LF). This also means there is some incompatibility to v5 for well-know | |
| sequences. Better break it now than later. | |
| - bugfix: config validation run did not always return correct return state | |
| --------------------------------------------------------------------------- | |
| Version 6.4.1 [V6-STABLE] 2012-09-06 | |
| - bugfix: multiple main queues with same queue file name were not detected | |
| This lead to queue file corruption. While the root cause is a config | |
| error, it is a bug that this important and hard to find config error | |
| was not detected by rsyslog. | |
| - bugfix: "jsonf" property replacer option did generate invalid JSON | |
| in JSON, we have "fieldname":"value", but the option emitted | |
| "fieldname"="value". Interestingly, this was accepted by a couple | |
| of sinks, most importantly elasticsearch. Now the correct format is | |
| emitted, which causes a remote chance that some things that relied on | |
| the wrong format will break. | |
| Thanks to Miloslav Trmač for the patch | |
| - change $!all-json did emit an empty (thus non-JSON) string if no libee | |
| data was present. It now emits {} and thus valid JSON. There is a | |
| small risk that this may break some things that relied on the previous | |
| inconsistency. | |
| Thanks to Miloslav Trmač for the patch | |
| - bugfix: omusrsmsg incorrect return state & config warning handling | |
| During config file processing, Omusrmsg often incorrectly returned a | |
| warning status, even when no warning was present (caused by | |
| uninitialized variable). Also, the core handled warning messages | |
| incorrectly, and treated them as errors. As a result, omusrmsg | |
| (most often) could not properly be loaded. Note that this only | |
| occurs with legacy config action syntax. This was a regression | |
| caused by an incorrect merge in to the 6.3.x codebase. | |
| Thanks to Stefano Mason for alerting us of this bug. | |
| - bugfix: Fixed TCP CheckConnection handling in omfwd.c. Interface needed | |
| to be changed in lower stream classes. Syslog TCP Sending is now resumed | |
| properly. Unfixed, that lead to non-detection of downstate of remote | |
| hosts. | |
| --------------------------------------------------------------------------- | |
| Version 6.4.0 [V6-STABLE] 2012-08-20 | |
| - THIS IS THE FIRST VERSION OF THE 6.4.x STABLE BRANCH | |
| It includes all enhancements made in 6.3.x plus what is written in the | |
| ChangeLog below. | |
| - omelasticsearch: support for parameters parent & dynparent added | |
| - bugfix: imtcp aborted when more than 2 connections were used. | |
| Incremented pthread stack size to 4MB for imtcp, imptcp and imttcp | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=342 | |
| - bugfix: imptcp aborted when $InputPTCPServerBindRuleset was used | |
| - bugfix: problem with cutting first 16 characters from message with | |
| bAnnotate | |
| Thanks to Milan Bartos for the patch. | |
| --------------------------------------------------------------------------- | |
| Version 6.3.12 [BETA] 2012-07-02 | |
| - support for elasticsearch via omelasticsearch added | |
| Note that this module has been tested quite well by a number of folks, | |
| and this is why we merge in new functionality in a late beta stage. | |
| Even if problems would exist, only users of omelasticsearch would | |
| experience them, making it a pretty safe addition. | |
| - bugfix: $ActionName was not properly honored | |
| Thanks to Abby Edwards for alerting us | |
| --------------------------------------------------------------------------- | |
| Version 6.3.11 [BETA] 2012-06-18 | |
| - bugfix: expression-based filters with AND/OR could segfault | |
| due to a problem with boolean shortcut operations. From the user's | |
| perspective, the segfault is almost non-deterministic (it occurs when | |
| a shortcut is used). | |
| Thanks to Lars Peterson for providing the initial bug report and his | |
| support in solving it. | |
| - bugfix: "last message repeated n times" message was missing hostname | |
| Thanks to Zdenek Salvet for finding this bug and to Bodik for reporting | |
| --------------------------------------------------------------------------- | |
| Version 6.3.10 [BETA] 2012-06-04 | |
| - bugfix: delayble source could block action queue, even if there was | |
| a disk queue associated with it. The root cause of this problem was | |
| that it makes no sense to delay messages once they arrive in the | |
| action queue - the "input" that is being held in that case is the main | |
| queue worker, what makes no sense. | |
| Thanks to Marcin for alerting us on this problem and providing | |
| instructions to reproduce it. | |
| - bugfix: invalid free in imptcp could lead to abort during startup | |
| - bugfix: if debug message could end up in log file when forking | |
| if rsyslog was set to auto-background (thus fork, the default) and debug | |
| mode to stdout was enabled, debug messages ended up in the first log file | |
| opened. Currently, stdout logging is completely disabled in forking mode | |
| (but writing to the debug log file is still possible). This is a change | |
| in behaviour, which is under review. If it causes problems to you, | |
| please let us know. | |
| Thanks to Tomas Heinrich for the patch. | |
| - bugfix: --enable-smcustbindcdr configure directive did not work | |
| closes: http://bugzilla.adiscon.com/show_bug.cgi?id=330 | |
| Thanks to Ultrabug for the patch. | |
| - bugfix: made rsyslog compile when libestr ist not installed in /usr | |
| Thanks to Miloslav Trmač for providing patches and suggestions | |
| --------------------------------------------------------------------------- | |
| Version 6.3.9 [BETA] 2012-05-22 | |
| - bugfix: imtcp could cause hang during reception | |
| this also applied to other users of core file tcpsrv.c, but imtcp was | |
| by far the most prominent and widely-used, the rest rather exotic | |
| (like imdiag) | |
| - added capability to specify substrings for field extraction mode | |