Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

flowd_aggregate crash #3715

Closed
DonConto opened this issue Sep 20, 2019 · 4 comments
Closed

flowd_aggregate crash #3715

DonConto opened this issue Sep 20, 2019 · 4 comments
Assignees
Labels
cleanup Low impact changes
Milestone

Comments

@DonConto
Copy link

Netflow crashes after a minute or two. Not sure, but the problem occurs after adding an additional interface via "Interfaces: Assignments" for ovpns1. Maybe there is a 'corpse' in a config file now?!

Output:

root@OPNsense:~ # /usr/local/opnsense/scripts/netflow/flowd_aggregate.py --console
Traceback (most recent call last):
File "/usr/local/opnsense/scripts/netflow/flowd_aggregate.py", line 224, in
Main()
File "/usr/local/opnsense/scripts/netflow/flowd_aggregate.py", line 136, in init
self.run()
File "/usr/local/opnsense/scripts/netflow/flowd_aggregate.py", line 160, in run
aggregate_flowd(self.config, do_vacuum)
File "/usr/local/opnsense/scripts/netflow/flowd_aggregate.py", line 68, in aggregate_flowd
for flow_record in parse_flow(prev_recv, config.flowd_source):
File "/usr/local/opnsense/scripts/netflow/lib/parse.py", line 74, in parse_flow
for flow_record in FlowParser(filename, recv_stamp):
File "/usr/local/opnsense/scripts/netflow/lib/flowparser.py", line 139, in iter
data_fields=ntohl(header[3])
File "/usr/local/opnsense/scripts/netflow/lib/flowparser.py", line 118, in _parse_binary
raw_data[raw_data_idx:raw_data_idx + fsize]
struct.error: unpack requires a buffer of 8 bytes
root@OPNsense:~ #

I tried to reset and repair via GUI and also a rm of the sqlite files. But nothing helped.

@AdSchellevis AdSchellevis self-assigned this Sep 20, 2019
@AdSchellevis
Copy link
Member

@DonConto 01d8fb2 should catch these errors.

To test, use the opnsense-patch 01d8fb2 on a console (and restart the flowd_aggregate service).

@fichtner fichtner added the cleanup Low impact changes label Sep 23, 2019
@fichtner fichtner added this to the 20.1 milestone Sep 23, 2019
@DonConto
Copy link
Author

Netflow service is now stable. Thank you for your support.

@AdSchellevis
Copy link
Member

@DonConto thanks for letting us know!

fichtner pushed a commit that referenced this issue Sep 29, 2019
…record doesn't match standards. closes #3715

(cherry picked from commit 01d8fb2)
@NigelWhatling
Copy link

This worked for me too. 👍

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cleanup Low impact changes
Development

No branches or pull requests

4 participants