Log Drops

[aerkaya1]

Important notices

Before you add a new report, we ask you kindly to acknowledge the following:

• [x ] I have read the contributing guide lines at https://github.com/opnsense/core/blob/master/CONTRIBUTING.md
• [x ] I am convinced that my issue is new after having checked both open and closed issues at https://github.com/opnsense/core/issues?q=is%3Aissue

Describe the bug

I switched to opnsense at my company. I am using SentiLOG(SiberSAN) as remote log server. SiberSAN company reported missing logs. When I examined in detail in the tests we conducted with SiberSAN company, I saw that opnsense was missing logs in the filter log files.

To Reproduce

To fully understand the issue, I set up a test environment like this:

I wrote a script file on our Debian server:

now=$(date)
curl=$(curl -s -o /dev/null -w "%{http_code}" -k https://10.*.*9.1)
echo "$now - Firewall gui curl http response code: $curl" >> /root/log.ae

I have configured this script file to run every minute with crontab.

After a while, I compared this /root/log.ae file with OPNsense's /var/log/filter/latest.log file and saw that there was a log loss in OPNsense.

We encountered the same problem in external tests by the SiberSAN (SentiLOG) company.

Expected behavior

There should be no log loss.

Describe alternatives you considered

No.

Screenshots

Relevant log files

https://aerkaya.com/log/log.ae
https://aerkaya.com/log/opnsenselog.txt

Additional context

Environment

Software version used and hardware type if relevant, e.g.:

OPNsense 22.7.7.6-amd64
FreeBSD 13.1-RELEASE-p2
OpenSSL 1.1.1q 5 Jul 2022
32 Virtual Core
64GB Virtual Memory
Host Server: Intel(R) Xeon(R) Gold 6348 CPU @ 2.60GHz

[aerkaya1]

We provide free public internet service. log is very important to us. do you have any advice?

[AdSchellevis]

Could be different things (firewall rules, states not being closed properly, log exhaustion), but likely not really community support. Our forum (https://forum.opnsense.org) might be a better place to discuss use-cases and implementation issues.

[OPNsense-bot]

This issue has been automatically timed-out (after 180 days of inactivity).

For more information about the policies for this repository,
please read https://github.com/opnsense/core/blob/master/CONTRIBUTING.md for further details.

If someone wants to step up and work on this issue,
just let us know, so we can reopen the issue and assign an owner to it.