Skip to content

Feature/memory_map_flows#32

Merged
AKOrojo merged 2 commits intomainfrom
feature/memory_map_flows
Mar 5, 2026
Merged

Feature/memory_map_flows#32
AKOrojo merged 2 commits intomainfrom
feature/memory_map_flows

Conversation

@AKOrojo
Copy link
Contributor

@AKOrojo AKOrojo commented Mar 5, 2026

Add PcapNG read/write with auto-detection so rdpcap(), PcapReader, and extract_flows() transparently handle both PCAP and PcapNG formats. wrpcap() auto-selects PcapNG when the path ends in .pcapng, and a new wrpcapng() function is available for explicit PcapNG writing.

Add memory-budgeted streaming flow extraction: extract_flows() now streams packets from disk one at a time instead of loading all into memory. When a memory_budget is set in FlowConfig, TCP reassembly buffers automatically spill to memory-mapped temp files (via memmap2) when RAM usage exceeds the budget, and are read back on demand. Temp files are cleaned up via RAII (NamedTempFile).

Also fixes pre-existing MqttSn builder test compilation errors (missing imports) and updates README with new features and protocol documentation.

AKOrojo added 2 commits March 4, 2026 22:59
Add PcapNG read/write with auto-detection so rdpcap(), PcapReader, and
extract_flows() transparently handle both PCAP and PcapNG formats.
wrpcap() auto-selects PcapNG when the path ends in .pcapng, and a new
wrpcapng() function is available for explicit PcapNG writing.

Add memory-budgeted streaming flow extraction: extract_flows() now
streams packets from disk one at a time instead of loading all into
memory. When a memory_budget is set in FlowConfig, TCP reassembly
buffers automatically spill to memory-mapped temp files (via memmap2)
when RAM usage exceeds the budget, and are read back on demand. Temp
files are cleaned up via RAII (NamedTempFile).

Also fixes pre-existing MqttSn builder test compilation errors (missing
imports) and updates README with new features and protocol documentation.
@AKOrojo AKOrojo merged commit 6062f91 into main Mar 5, 2026
1 check passed
@AKOrojo AKOrojo deleted the feature/memory_map_flows branch March 5, 2026 05:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant