Assets 2

This release introduces support for low-overhead packet queues between Snabb processes within the same process group, as well as a software-based “Receive Side Scaling” (RSS) app to pair with it. Dill also comes with basic pattern restriction support in lib.yang, a better in-band packet tap app that records Pcap data, and—as usual—various bug fixes and miscellaneous improvements.

Changes

  • #1263 Adds basic support for pattern restrictions to lib.yang
  • #1288 Adds a pair of apps (apps.interlink.transmitter and apps.interlink.receiver) that enable efficient packet I/O between Snabb processes within the same process group (inter-process links)
  • #1309 Adds a software-based “Receive Side Scaling” (RSS) app
  • #1315 Introduces the new snabbco/raptorjit integration branch
  • #1320 Adds an in-band packet tap app that logs to Pcap data as a more efficient and featureful alternative to PcapWriter
  • #1327 Fixes a bug in lib.protocol.tcp
  • #1338 Fixes a bug in ljsyscall’s lseek wrapper

Contributors

Alexander Gall (5):

  • 3495fc7: Add a RSS app
  • 41bd845: apps.rss: add selftest
  • 3114c5a: apps.rss: cosmetic changes
  • c8318aa: apps.rss: remove unused variable from selftest
  • 39d2f12: rss.lua: fix bug in selftest

Andy Wingo (3):

  • 468a9a9: Add pcap packet tap
  • 1d90c3e: Revert inadvertant removal of PcapReader / PcapWriter docs
  • bf4307d: Make "offset" arg to lseek a signed integer

Luke Gorrie (3):

  • e7f63d6: doc/branches.md: Add snabbco/raptorjit integration branch
  • e22e683: .version: Bump to 2018.06
  • cf4a5dc: Revert "Merge 'eugeneia/numa-selftest-nonnuma' into wingo-next"

Max Rottenkolber (70):

  • 5100c5d: wip: MCRingBuffer for packets.
  • 3ddb3f3: manual batching
  • 86a6ee9: balance packets
  • 293892b: apps/test
  • 9cdd697: worker
  • 322b61c: factor
  • 6306ed7: core.worker: include si_status in status
  • 4e538cf: fix init race
  • 626c8b6: reorg
  • ac886ba: global max
  • 06053f6: lib.interlink: fix initialization race.
  • 2e32f83: core.worker: include si_status in status
  • 47d8792: lib.interlink: specialized inter-process links
  • 7318cc0: apps.interlink: name apps
  • 8dff93b: apps.interlink: use robust setup/teardown routine, add sensible memory barriers
  • 4486728: apps.interlink.receiver: don’t forward packets until connected
  • db61756: extract lib.print_object from lib.store_config
  • a60a42b: lib.xsd_regexp: port MaxPC to lib.maxpc, implement regular expression parser
  • 204f21e: lib.xsd_regexp: implement basic regexp compiler
  • 6f41966: lib.maxpc: add input_class argument to parse / use classes for input objects
  • 660ae79: Revert "lib.maxpc: add input_class argument to parse / use classes [...]"
  • ba37cd8: lib.maxpc: decode UTF-8 input
  • d3cacc6: lib.maxpc: fix bug in match._not
  • b6cc1a6: lib.maxpc: port digit/number parsers
  • 5fd0198: lib.xsd_regexp: implement unicode ranges
  • 7de7fd3: lib.ucd: supporting Unicode database for lib.xsd_regexp
  • f62c95a: lib.xsd_regexp: implement limited category escapes
  • 5eaf4ac: lib.xsd_regexp: remove support for block escapes, copy in GC predicates
  • ba292f0: lib.xsd_regexp: remove obsolete match.digit
  • ba818b9: Revert "lib.ucd: supporting Unicode database for lib.xsd_regexp"
  • b26d5fc: Revert "lib.xsd_regexp: implement unicode ranges"
  • 6fcebb8: Revert "lib.maxpc: decode UTF-8 input", revert lib.xsd_regexp to ASCII-only
  • 1187fc7: lib.xsd_regexp: implement \i, \I, \c, and \C
  • 074ff0c: lib.xsd_regexp: implement backtracking
  • 1be3a55: lib.yang.schema: fix parse_range
  • de468cb: lib.yang.data: implement range and pattern restrictions
  • e54b5f6: lib.yang.data: do not compile pattern validator for empty set of patterns
  • 88cbeb0: lib.yang.data: only run pattern validator on string values
  • d1a7409: lib.yang.schema: fix bug in selftest (range can have multiple intervals)
  • e577721: program.lwaftr.tests.propbased.genyang: adapt to new range format
  • 090d617: lib.numa: skip selftest if running on a non-NUMA machine
  • 2ece0c1: lib.numa: more fine grained approach to 090d617
  • 6783dac: lib.interlink: use attribute((packet, aligned(64))) to align s
  • cae2554: apps/interlink: turn test.lua into Snabb script selftest.snabb
  • 022ab0c: apps.interlink: add duration parameter to selftest.snabb
  • d1adbcb: process group: rebalance packets exchanged across process boundaries
  • 9f0694f: core.packet: extract packet.account_free from packet.free
  • 756255c: DynASM: add CMPXCHG instruction
  • d05da38: core.sync: add atomic compare-and-swap primitive based on CMPXCHG
  • 9dfa543: interlink: adapt interlink and related apps to group freelist
  • 020a9fd: core.sync: consolidate core.spinlock into core.sync
  • 302f952: core.app: pass app name as second argument to :new in start_app
  • 4686cbf: apps.interlink: use app name to derive SHM interlink path
  • cb9250f: lib.interlink: fix life-time fsm design and implementation bugs
  • 274ea4b: core.packet: do not count packets reclaimed from group_fl as freed
  • 59caa02: apps.interlink: shutdown handler to release stale attachments
  • b1472e8: lib.interlink: integrate with shm.open_frame for snabb top
  • 5ac340e: core.shm: explicitly open shm objects read-only in open_frame
  • 95de704: lib.interlink: fix outdated comments
  • 154d63c: lib.interlink / core.main: fix shutdown bugs
  • 72aadf7: lib.interlink: take advantage of non-excl shm.create semantics
  • 44b4cdf: core.packet: use ffi init argument to initialize packet_fl
  • 5ac6e7b: core.packet: enable group freelist only on demand
  • 02bdf78: apps.interlink.*: add user-facing documentation.
  • be6c657: lib.maxpc: fix backtracking “zero or more” combinator match.all
  • c583ac7: apps.interlink: fix documentation bugs
  • 5fbe79e: apps.interlink: avoid engine/appname kludge by attaching in :link()
  • a083487: Revert "core.app: pass app name as second argument to :new in start_app"
  • 00acc77: apps.rss: include documentation in genbook.sh
  • b699d7e: apps.interlink: allow specifying queue name per config

R. Matthew Emerson (1):

  • c888a86: Simple spinlock implementation based on xchg instruction.

hepeng (2):

@eugeneia eugeneia released this Apr 30, 2018 · 99 commits to master since this release

Assets 2

This release includes the newest version of Igalia’s lwAFTR, as well as a powerful new load testing tool. Also in the mix is an easy way to test Snabb on platforms that support Docker such as OS X, a new “unhexdump” tool that synthesizes packets from hexadecimal encodings, and significant performance and stability improvements. As usual, Edamame also includes assorted bug fixes.

Changes

  • #1328 #1330 #1331 merge Snabb lwAFTR releases up to 2018.04, this includes a new program loadtest which gauges maximum sustainable load of a networking function, as well as fixes to lib.ptree
  • #1326 improves intel_mp selftest more reliability
  • #1289 adds a minimal Docker image that eases testing on e.g. OS X
  • #1274 adds snabb unhexdump tool
  • #1300 fixes a race condition during supervisor setup
  • #1287 optimizes breathe loop by removing unsunk allocations
  • #1271 adds a showcase program that implements DNS service discovery
  • #1308 #1272 include various bug fixes and improvements

Contributors

Alexander Gall (1):

  • 279aa38: core.app: remove garbage when using pace_breathing

Andy Wingo (53):

  • 3e7d2b5: Fix "snabb lwaftr run" after lib.scheduling refactor
  • 47588b9: Split YANG getter-at-path out to own module
  • 667b843: Move generic data-at-path utilities to lib.yang.path_data
  • feab012: Rename program.config.json to lib.ptree.json
  • a83a827: "snabb config listen" more lenient about missing paths
  • bd689ff: "snabb config listen" can take schema / revision from directives
  • 8798307: Add ability for ptree manager to record incoming RPCs
  • 9572bde: Wire up --trace for "snabb ptree" and document
  • fe328da: Wire up a --trace argument for the lwaftr
  • 9662280: Reduce memory use for get-config RPC
  • 008a4b8: Increase response length limit from leader from 100M to 1G chars
  • bd9a8da: Improve speed of yang qstring parser.
  • 3e2fecb: Fix ptree trace selftest
  • 7136c24: changelog
  • ee03a98: Fix data_grammar_from_schema for empty cases
  • 631357c: Rewrite random YANG path selector and value generator
  • c752d1d: Remove unused imports
  • cf61265: Simplify test
  • 8ce8872: Add "snabb unhexdump" tool
  • 383fd83: Process tree runs data-plane processes with busywait=true by default
  • c6d0e22: Pcap savefile writer records frame sizes
  • 3cf4cda: Sizes for "packetblaster lwaftr" are frame sizes
  • c55199b: Fix up packetblaster lwaftr selfchecks
  • fe08efb: Address review nit
  • 2876c6e: Revert "Pcap savefile writer records frame sizes"
  • 75ee990: Regenerate packetblaster lwaftr test files
  • 87c4263: Regenerate packetblaster lwaftr test files
  • d9b6512: Fix next-hop discovery with multiple devices
  • b38ae3a: Remove early lwAFTR NUMA affinity check
  • 05bffbc: Move "loadtest" command out of lwaftr
  • 09ce69e: Fix ctable resizing logic
  • 3142fad: Fix sense of ctable resize limit
  • db8b2c4: Make minimum ctable size uniform
  • f31e840: Add limit-finding loadtester.
  • 047018a: Add find-limit --exec to README
  • da3a2f8: Make supervisor setup more reliable
  • 459ee99: Make supervisor setup more reliable
  • 0736ffd: Fix out-of-bounds write in ctable test suite
  • 55bf2e3: Promptly close util.ls() dir fd; fix bug with deleted entries
  • 828641f: Remove lib.files_in_directory
  • f133f7f: Promptly close fd in random_bytes_from_dev_urandom
  • 1e6f852: Fix modification to lib.hardware.pci.scan_devices
  • 65cbc01: Set SNABB_RANDOM_SEED for intel_mp tests
  • a5bed82: Claim name in central lwaftr ptree manager function
  • 703f1a9: "snabb config" tests wait until ptree manager socket is available
  • 69f545b: Revert lwAFTR-specific version change for merge to upstream
  • a1efb46: Harmonize style in changelog
  • d51d0d5: Changelog for lwAFTR v2018.04.01
  • 99ffe31: Fix removal of v2018.01.2.1 header
  • bb63b39: Fix missing closing backtick
  • 54a5402: Flip sense of conditional-skip of IPsec end-to-end test
  • f03ba1b: Test on presence of SNABB_IPSEC_ENABLE_E2E_TEST, not value
  • 3f94ce5: Bash programming is known to the State of California to cause confusion

Diego Pino Garcia (23):

  • 459a936: Fix property-based test stall
  • ea5228c: Fix lwaftr selftest run
  • f57c75e: Rework alarms timestamping logic
  • 73caaaf: Add DNS-SD program
  • 3c9edf0: Show error if running on loop-back interface
  • 373b42b: Enable alarm notification
  • dca505c: Fix variable name
  • 191e655: Fix error message
  • 77f7abc: Fix path to transient README
  • cb68e08: Check status code in monitor test
  • 9e2f5da: Temporarily disable ipsec selftest
  • b4629a7: Snabb lwAFTR v2018.01.2.1
  • 1ad64e4: Changelog 2018.01.2.1
  • 8010951: XPath formater fixes
  • c55b21b: Fix tests
  • 25c8ad6: Implement alarm shelving
  • 7f6791d: Add failsafe parameter to common.parse_args
  • 76d0a89: Refactor argument parsing
  • 419c943: Fix error message
  • 5cd8b1b: Update README
  • aa31d24: Implement table_is_empty
  • d35cdd5: Rename 'failsafe' to 'allow_extra_args'
  • 2e8a5f9: Fix undefined variable

Jessica Tallon (6):

  • 468e72c: Fix small mistake in arp documentation.
  • d9ac366: Fix find-limit by checking actual throughput rather than requested.
  • 6e07332: Extend find-limit to support multiple NICs.
  • aa435ba: Support the old argument format and fix nits
  • d10a840: Remove unused fatal function
  • bcda559: Fix a few more minor nits :)

Luke Gorrie (2):

  • e9ee18a: README.md: Add link to Slack auto-invite page
  • 72b9b3c: .version: bump to 2018.04

Marcel Wiget (11):

  • 7d44865: [wip] use socker server mode
  • 7fce594: undo previous wip
  • c81176e: build snabb docker container
  • 3337ae8: make clean before build to avoid using binaries built outside of docker
  • dff8877: adding container build and run instructions
  • ba390ec: src/snabb wrapper when building container snabb
  • 3a4015c: document snabb wrapper script
  • b9ae0d7: adjust if statement to work in dash too
  • a095968: merging launch-docker-container.sh with dock.sh
  • d806fe0: use separate docker run commands
  • b7f6ab2: run container privileged and build src

Max Rottenkolber (4):

  • 2468f7c: intel_app: run selftest even though its not the default driver anymore
  • 35539ec: Correct/extend doc/snabblab.md
  • 58883b1: snabb top: minor formatting fixes
  • 664f378: intel_app: fix skipped message with regard to 2468f7c

@eugeneia eugeneia released this Mar 6, 2018 · 261 commits to master since this release

Assets 2

This is another bugfix release that amends Daikon with #1294, which works around some unreliable CI tests.

@eugeneia eugeneia released this Feb 13, 2018 · 264 commits to master since this release

Assets 2

This is a bugfix release for Daikon that fixes numerous CI failures introduced by it. It includes: #1280 #1277 #1273 #1283

Contributors

Andy Wingo (1):

  • 0c295ba: Fix "snabb lwaftr run" after lib.scheduling refactor

Diego Pino Garcia (2):

  • 5121fe8: Fix property-based test stall
  • 3b78121: Fix lwaftr selftest run

Max Rottenkolber (3):

  • 636bb65: apps.ipv4.reassemble: fix a copy paste error at end of selftest
  • af47642: apps.ipv6.reassemble: same for ipv6
  • f4b9e86: doc/branches.md: take over fixes maintainership from lukego

Michael G (4):

  • ddd90d2: Naive i350 fixes
  • 818c8b7: queue_registers, not registers
  • 68f0cd5: Fixed bits() on RO register
  • 19b5620: Detect PCI -> port mapping

@eugeneia eugeneia released this Feb 2, 2018 · 286 commits to master since this release

Assets 2

This release includes a new fleshed out version of Igalia’s YANG based
configuration subsystem—now known as lib.ptree, for “process tree”, as well as
Alexander Gall’s l2vpn, a virtual multi-port Ethernet switch on top of a plain
IPv6. Additionally, lib.ipsec now support ESP in tunnel mode. As usual, Daikon
also includes assorted bug fixes.

Major Changes

  • #1257 Reworked multi-process reconfigurable network functions
  • #1261 Upstreamed Alexander Gall’s l2vpn
  • #1266 lib.ipsec: add support for ESP in tunnel mode

Minor Changes

  • #1220 lib.ipsec: added IPsec ESP interoperability test with Linux
  • #1259 core.link: free packets during link.free
  • #1260 snabb top: fixed a bug; should have improved performance

Contributors

Alexander Gall (64):

  • a4acb5f: Add a Snabb program to construct a complete L2VPN endpoint
  • cd89bed: Fix identification of proper p2p VPN
  • c4cc025: Add documentation
  • a9d1ca8: Untabify apps/intel/intel1g.lua
  • 2ebacf2: Fix regression introduced by 11a19ce
  • b06fbb6: Amend the list of devices supported by the Intel i210 driver
  • f2f400a: Add configurable MTU to intel1g.lua
  • cf6e415: Add SNMP support to intel1g.lua
  • 8777c5f: Fix bridge post_config() call
  • 3a3f81e: Use /tmp to store test data in pseudowire selftest
  • b68519d: Fix ifSpeed in intel10g and intel1g
  • 5886ebc: Use logger:can_log() in l2vpn tunnel modules
  • 57848e7: Improve performance of the VLAN multiplexer
  • 53e930b: Set ifAlias, ifDescr in intel drivers
  • 0f5f76e: Add oversized packets counter to ifInDiscards for intel10g
  • 244b0a2: Add app for static ND
  • 32b8767: Add VLAN support to the l2vpn program
  • a6032d6: Remove MAC addresses from pseudowire app
  • aac33d4: Allow per-PW control-channel disable override
  • 1a55b0e: Add missing image files
  • c38a501: Fix bug in l2vpn
  • 93f94f8: Remove SNMP code from Intel drivers
  • e5f14ce: Extract physical MAC address in intel10g
  • 47eaceb: Make ND apps reconfigurable
  • 771f7a4: Fixes for new packet API
  • d7e9c39: Fixes/enhancements for iftable_mib.lua
  • 31d6911: Streamline SNMP config in l2vpn
  • 7e9fba1: De-couple SNMP setup from ND reconfig
  • fed01a8: Add SIOCGIF{FLAGS,MTU,HWADDR} ioctls to ljsyscall
  • f71c64f: Augment stats counters for apps.tap.tap
  • d59c806: Properly count the number of pseudowires
  • 134b4ce: Disable interrupts in intel10g
  • f920867: Make waiting for link-up optional in intel{1,10}g
  • 5e7f8dc: nd_light: add option to reduce verbosity
  • 9365ce3: Fix program/l2vpn/pseudowire selftest
  • c821bf2: Fix l2vpn pseudowire for new packet semantics
  • 47fa2ce: Fix tap after merge
  • e912fa3: intel1g: replace lib.timer by lib.throttle
  • b3c1b6b: nd_light: add "quiet" option to config template
  • 7e4f8d3: inetl_app: add "wait_for_link" option to config template
  • 4fdd530: l2vpn: switch to intel_mp drivers
  • 916f6c8: l2vpn: add extra_config to driver configuration
  • 2833f21: l2vpn/README.md: Fix indention
  • e498067: l2vpn: document new extra_config driver configuration item
  • c9bbb85: l2vpn: use intel_mp in README throughout
  • 5f763e1: Remove intel1g driver
  • 22d5ebb: Revert intel_app, inetl10g to upstream/master
  • 4400bbf: intel_mp: move shm initialization to constructor
  • 3b0c82f: iftable_mib: streamline processing
  • 9bec79f: Tap: add support for MTU, operational status
  • 47aee50: l2vpn: access interface counters via read-only shm frames
  • f094f74: apps.vlan: use config parser, update README
  • b61c4b0: nd_light: add optional option local_mac
  • dd0a91c: nd_light: fix bug in NS validation
  • a9c0ddf: program.l2vpn.l2vpn: only use nd_light
  • 23ffbb5: l2vpn: support dynamic reconfiguration
  • 50ba67d: core.app: fix bug in reconfiguration
  • da5346b: l2vpn: add port-mirroring option
  • d5960dc: apps.vlan.vlan: remove assert in VlanMux link()
  • a886ed3: apps.ipv6: document quiet option of nd_light
  • 54b99f8: l2vpn: re-write of app network construction
  • 8c5ea03: l2vpn: fix bug in app links generation
  • 96026fd: Fix bug in p2p optimization
  • 821fd8d: Add -jopt option to l2vpn program to set JIT options

Andy Wingo (215):

  • dd73f5a: Fix structural typing of YANG data
  • 34a0dc4: Worker processes have useful process name
  • 950d2b2: lwaftr: main process should not run at 100% CPU
  • 1163af7: yang: Mark list keys as mandatory after expansion
  • 354a18c: Better support for identity in YANG schemas
  • 4e9b818: yang: Attach default prefix to identityref type nodes.
  • 09e7267: Enable YANG data range and length validation
  • 71345f3: Fix schema test for range representation change
  • 0439614: Remove unused code
  • b231028: Adapt property-based test generation for range change.
  • 4f6de01: Leader should poll follower for its channel. (#866)
  • 8291a3a: Remove Ethernet-specific code from lwAFTR app
  • c0abcf0: Move NDP app to ndp.lua
  • 22af99d: Inline helper function only used by NDP app
  • df58830: NDP assigns random MAC addr if needed, stamps MAC on outgoing packets
  • 7d71c27: Localize more functions in ndp.lua
  • fbbc1f7: Fix bugs in migrated NDP app, add test
  • d300df6: Use more structs in NDP implementation
  • 3d9ad9a: Convert advertisement part of NDP app to FFI style
  • ae714b6: Finish refactoring NDP to FFI style
  • 5931f63: Finish cleanup of NDP app
  • 581589e: Fix NDP nits.
  • a6cc106: Fix errors constructing NDP packets
  • 0995226: Remove backpressure from IPv4 ping responder
  • 3930a04: Reindent lib.yang.state
  • 3d26a46: More robust lib.yang.state find_counters routine
  • 6fe8424: YANG schema inherit-config phase gives all nodes config property
  • 9da160e: Separate YANG grammars for config and state data
  • 42d4e34: Fix grammar generation
  • 45ab10c: Unify lwAFTR and other state query around YANG
  • 49c7c81: Lwcounter module uses YANG to know available counters
  • 259ffdb: Attempt to fix snabbvmx check
  • 4f1fc20: README reformatting to trigger CI
  • 40d4373: Fix snabbvmx some more
  • 37268cc: Revert change to snabbvmx lwaftr
  • d66184a: Add YANG docs to documentation build.
  • 6c9af14: Fix YANG doc link.
  • b00485e: Snabb lwAFTR version is Snabb version
  • d75381a: Fix bugs in generate-binding-table.
  • a3557d9: Release Snabb lwAFTR 2017.07.01
  • d8fd1c0: Fix typo.
  • 745b5b2: More robust name-to-PID mapping in query test
  • 08d30f7: Work around race condition in query tests
  • 7fd3622: Beginning of separating out IPv4 reassembly app
  • cd90b37: Remove unused vlan capability from fragmentation tests
  • 64bfbb5: Further work to separate IPv4 reassembly from lwAFTR
  • d01a489: Style cleanups in reassembly tests
  • d999ef0: Tighten packet generation for reassembly tests
  • c294c2c: Use fragmenting app, not library, when testing reassembly app
  • dbd18ad: Simplify reassembly test
  • 03e9e6a: Inline reassembly test into reassemble.lua
  • d719cfa: Clean up reassembly header
  • f2bad7a: Rewrite reassembly tests to be exhaustive
  • 839e9ea: Remove global state in reassembler
  • 62203fa: Beginning of moving reassembly to FFI style
  • 0b6a8d4: Finish moving reassembly to FFI style
  • 896c5ae: CTable random eviction wrapper uses ctable API
  • 1cbc626: ctable add method returns pointer to entry, not index
  • 01efd22: Inline reassembly handling
  • fa75b19: Inline more reassembly helpers
  • 781dd8a: Minor reassembly cleanups
  • 5a95294: Reassembler embeds struct packet
  • 5b04a44: More small reassembly cleanups
  • c7b8b69: Tighten up validation of reassembly input packets
  • 232fe4c: Reassemble app uses SHM frame to open counters
  • 4fe94b7: Rename reassembler config params
  • e90371e: Add IPv4 reassembler documentation
  • 90b9c54: ctable:add() should return a pointer, not a reference
  • 597f744: IPv4 reassembly: Periodically update counters
  • 366d3b8: Fix IPv4 reassembly bugs
  • 707c1e7: Adapt counters to new IPv4 reassembly table size
  • 087d3b8: IPv4 reassembly passes through non-IPv4 packets
  • 673d48c: Update README
  • 260fc85: Update reassembly counter expectations
  • a1781e7: Begin extracting IPv6 reassembler out of lwaftr
  • 033ccb8: Add IPv6 reassembly tests
  • ca370fd: IPv6 reassembler: finish converting to FFI style
  • 48485f3: IPv6 reassembler passes through non-IPv6 traffic
  • 15e7ec8: lwcounter avoids creating counters for IPv6 reassembly
  • b80b7c9: Update IPv6 reassembly counter memory use expectations
  • 05ad9d6: Begin extracting IPv4 fragmenter from lwAFTR
  • 1483c6d: Add exhaustive IPv4 fragmentation tests
  • 6a53389: Add fragmentation comment
  • 97cd285: Fix IPv4 reassembly when last fragment is full MTU
  • e6c3bc2: Start to convert IPv4 fragmenter to FFI style
  • f077775: Inline fragmentation code into app
  • f7b87d8: IPv4 fragments and transmits directly
  • d54d4ed: Only test valid MTUs for IPv6 reassembly
  • a11da97: Port IPv6 fragmenter to new style.
  • b3a873f: Fix nondeterminacy in "snabb lwaftr check"
  • 045ff0c: Fix previous patch
  • 136fdc6: Move fragmentation-disabled drop counters back to lwAFTR
  • 8673288: Fix unintentional hairpinning in lwaftr config_test.
  • 520d5db: Convert lwAFTR to "shm frame" mechanism
  • 107c999: Fix whitespace issue
  • 44515e7: Extract ICMP echo responders from lwAFTR
  • da223f5: Inline some ICMP helpers into their use modules
  • 5de181e: Minor ICMPv4 echo responder refactors
  • 4b484e6: Port ICMPv4 echo responder over to FFI style
  • 0729fce: Rewrite ICMPv6 echo responder into FFI style.
  • 7e64823: Add documentation for ICMP echo responders
  • 5522091: Remove "snabb lwaftr run-nohw"
  • 2f2a912: Remove run-nohw test.
  • bab1b8a: Remove apps.lwaftr.conf
  • d9988f6: Remove unused apps.lwaftr.dump
  • 0c6862b: Remove unused apps.lwaftr.generator
  • 5fa5807: Fix "snabb snabbvmx lwaftr"
  • 9223f80: Fix snabbvmx again
  • a7bd117: Comment to force CI to run again
  • b506394: Add needed import
  • b68815f: Fix needed import.
  • 293e50d: Remove a couple of unused imports
  • d95799c: Convert lwAFTR to use methods
  • bfa07ee: Inline lwAFTR helper ICMP library into lwaftr.lua
  • 10dca61: Inline lwheader.lua into lwaftr.lua
  • 82236b8: Remove unused lwtypes includes
  • d2022fb: Remove unused definitions from lwtypes
  • 99e5b0f: Inline lwtypes into lwaftr.lua
  • 57c1f00: More consistent naming of FFI types in lwaftr
  • c8d5d48: More minor lwAFTR style refactorings
  • 3abe151: Shorten names in write_ipv6_header
  • 471b69a: Fix error introduced by refactoring
  • 67873f1: Repeater apps have push functions instead of pull functions
  • b097e4b: Stabilize breathe order
  • 4f12e09: Allow LPM self-tests to complete even if no CPU affinity
  • e673303: Restart CI
  • a77330d: Add -j option to "snabb lwaftr run" and "bench"
  • c59e2e3: Add documentation
  • fa9f31a: Ingress drop timer doesn't count drops in the 10 seconds after a flush
  • 97910f3: Snabb lwAFTR v2017.08.01 release
  • c28e111: Add cpuset module
  • 6d2050b: Allow multiple CPUs via --cpu
  • 154163c: Print out the CPU to which we bind data plane processes
  • dc1e667: Add lwAFTR changelog for v2017.08.02
  • 9630c34: Snabb lwAFTR v2017.08.02
  • 080e5ea: Use false instead of "off" to disable intel_mp txq/rxq
  • b45149e: ChangeLog for v2017.08.03
  • 8f93a85: Snabb lwAFTR v2017.08.03
  • 4d73be0: RSS queue ID in examples is 0, not 1
  • fb18030: lwaftr run migrates configs in place
  • 326ebd9: Simplify parsing of single-instance lwaftr configurations
  • 5a279a3: Set queue ID as RSS queue ID
  • c5df53c: Add dedicated copier for YANG data
  • 70d2dd2: Produce one worker config per device and queue
  • b2d006f: Worker ids built using RSS id, not containing struct
  • 1286b07: Fix error in snabbvmx setup
  • 31b2084: Fix another error in snabbvmx setup
  • d6974ca: Another friggin snabbvmx error
  • c133476: Zero out synthesized lwaftr packets
  • 9d30c3c: Update benchdata/ packets to match test configurations
  • 940f0db: Fix bug printing error in config leader
  • edb15dd: Fix accessing first queue
  • 1cccf7a: Fix sparse cltable value serialization
  • 0e73d94: Fix insertion into sparse cltables
  • 293838e: Fix serialization of sparse arrays, again
  • e29810f: Fix yet another sparse cltable serialization problem (!)
  • b5de0d5: Update configuration.md to discuss RSS.
  • 5e159f0: Fix inconsistencies in documentation.
  • 59dec82: Reflow text
  • dd5c53b: lwAFTR always uses pool 0.
  • 2ea981c: Change log for Snabb lwAFTR v2017.08.04.
  • 72f2fe3: Snabb lwAFTR v2017.08.04
  • d3b3c87: Use different pool numbers for on-a-stick VMDq interfaces
  • 9f769e0: Ignore unexpected ARP replies
  • e15b305: Workers can communicate next-hop MAC address between themselves
  • c72c6c2: Workers can communicate next-hop MAC address between themselves (NDP)
  • f66b085: lwAFTR configures ARP and NDP with shared_next_mac_key
  • bc41ec3: Give snabb-softwire-v2 a different namespace from snabb-softwire-v1
  • 59fcb91: Avoid leaking shared next MAC key in ARP
  • 8216ef6: Avoid leaking shared next MAC key in NDP
  • 1fbb5a9: Update lwAFTR reconfiguration docs for new YANG schema
  • 709470a: Add snabb alarms documentation
  • 9ba052a: Prepare for Snabb lwAFTR v2017.08.05
  • bc32917: Add new ietf-softwire-br, ietf-softwire-common schemas
  • 878f1d4: Implement "refine" support for YANG schemas.
  • 9467691: Fix typo
  • d153c4c: Fix ietf-softwire-br by lifting per-instance state into traffic-stat.
  • 4631a6f: Fix querying config or state data by path when choices are involved
  • 14dd544: Fix "snabb config get-state" for foreign schemas
  • 27703e0: Add support for new ietf-softwire-br
  • 46a30ee: Remove support for ietf-softwire; ietf-softwire-br now default
  • d28efc9: Fix typo
  • 55ad468: Fix nits
  • d0cd819: Snabb lwAFTR v2017.08.06
  • bd9609e: Fix bug in cpuset:release()
  • fde3434: Copy app.config to lib.ptree ("process tree")
  • 3704987: Rename lib.ptree.leader to lib.ptree.manager
  • 3619ac2: Rename lib.ptree.follower to lib.ptree.worker
  • 90b7c2f: Add lib.scheduling
  • 67e44e8: Rework ptree manager to handle worker scheduling
  • aaeac1b: Make worker app private
  • 49651f8: Rework ptree worker to be library, not app
  • 7473408: Refactor ptree manager to be lib, not app
  • d49eb7d: Ptree manager stop() method shuts down workers too
  • 356d34e: Ptree worker refactors
  • 9490757: Add ptree manager log facility; fix manager main function
  • 9511c0b: Update ptree worker comment
  • 7c0d1a1: Ptree manager runs timers
  • 3c5f169: Ptree manager has "state change listener" facility
  • 6080eca: Timers can be cancelled
  • 5c3600a: Port lwAFTR over to use lib.ptree
  • cb72a6e: Remove apps.config
  • 27280f4: Add facility to add yang schemas to Snabb's database.
  • 9420075: Rename lib.ptree.manager to lib.ptree.ptree
  • d6e0229: Add "snabb ptree" program
  • 7ee2983: Update ptree documentation
  • a77867a: Add programs.inc to gitignore
  • 68d70ba: Fix example ptree setup.lua
  • 378701c: More useful cpuset
  • 4e96594: Fix NUMA node in cpuset warning
  • 42191ac: Return ptree manager socket name to old name
  • afe2fbd: If "snabb config" doesn't have a schema, fetch remotely
  • f034af8: Remove debugging printout
  • ee6537f: Enhance ptree readme with multi-process example
  • 024b3ed: Finish "snabb ptree" docs

Asumu Takikawa (5):

  • 25090ca: Adjust how intel_mp VMDq enabled state is checked
  • ff12ba8: Adjust how VMDq pool selection works
  • 74da3fe: Allow either 32/64 pools depending on queuing mode
  • 66d38f3: Fix pool selection coordination for manual case
  • fbdb671: Canonicalize PCI addresses for intel_mp shm refs

Diego Pino Garcia (129):

  • d41ff02: Sanitize YANG lists
  • 33dd33c: Snabb lwAFTR v3.1.8 change log
  • 4a2f332: Support type 'ipv4-prefix'
  • 1b199b7: Remove undeclared variable 'program_name'
  • 05c1e7b: Implement identity lookup and validator
  • b459d51: Add IETF Yang Alarms module
  • 1000d46: Parse Yang version as 1 or 1.1
  • 125a2fc: Add support for empty type
  • 1056e53: Addressed review comments
  • 38d943f: Enumerations should be treated as strings when compiling to binary
  • 3f6cf3f: Add binary compilation of enumerations test
  • ad69902: Add enum validator
  • 6effb2f: Add enum initializator
  • 6571b3d: Remove one value attribute from enumerations definition
  • d6b3442: Address review comments
  • 90163b9: Fix enums validation
  • c0ef6c9: Assign type.unions in typedefs
  • 1536479: Print 'wrote compiled configuration' message only if succeed
  • e18c327: Upgrade ietf-alarms YANG module
  • b3f926c: Add leafref to types table
  • 2241347: Do not modify a map while iterating over it
  • 471e88c: Print out schema information in parents
  • e0eedbb: Add binary serialization support for identity-ref
  • e3eb9de: Add option to print out default values in 'config get' and 'config get-state'
  • 0a09031: Update README
  • 9ee004a: Update config/README documenting --print-default knob
  • 2b7702e: Improve parsing of snabb config query paths
  • a6c86a8: Replace missing function 'table_count' for 'table_size'
  • 7f3be77: Implement XPath data printer
  • fbe4a9c: Support xpath-printer knob
  • 61c7279: Update docs
  • 5204ea5: Rename xpath-format to format
  • d124052: Print out table in XPath format
  • be73854: Fix key composition
  • 0a47c05: Handle special cases when root path includes trailing slash
  • 2b0cf7f: Support print out of arrays in XPath format
  • cf8a7ef: Append accumulated path when print a struct keyword
  • a516bf8: Top printers should print absolute path too
  • 9eb95fb: Support print_default in scalar top_printer
  • a79af52: Remove trailing semicolon
  • a81c331: Allow a string argument to be empty
  • 6cdb03c: Implement alarm_codec
  • 87bf337: Basic alarms channel mechanism
  • 03240ca: Decompress paramaters individually in raise-alarm and clear-alarm encoding/decoding
  • 24d9d41: Group decompressed arguments into key and args
  • 4e9d594: Notify raise and clear alarms in ARP app
  • 45848b2: Create alarms-channel if it doesn't exist
  • 2b4184d: Emit alarm notification in ARP app only if set
  • 3aa3868: Encode raise-alarm and clear-alarm directly
  • 2912b6c: Make alarm_notification flag a local
  • ed7f5b4: Move function set to core/lib.lua
  • 2bf2021: Document lib.set
  • e002498: Implement YANG empty datatype
  • 4fde7bc: Compile empty leaves as a boolean flag
  • 801a493: Substitute references to leafref datatype for string
  • 4212073: Comment use of instance-identifier as it's not currently supported
  • 52751f2: Add alarms capabilities
  • fa69e91: Extend snabb-softwire-v2 with alarms containers
  • 1723026: Load alarm inventory and fetch alarm state
  • 22379b8: Apps add their own alarms to the global alarm repository
  • 27c6bef: Implement declare alarms
  • 7f94090: Enable alarms in NDP app
  • e84e158: Implement raise alarm logic
  • 8210939: Implement clear alarm logic
  • 64974da: Fix nits
  • 974b3bd: Add encode:maybe_string
  • 60174c0: Make alarm_list:copy private
  • b07a44a: Fix unroll of sparse table
  • 8ae762d: Fix followers iteration
  • 57e5b28: Break tail call in htonl
  • 93b4818: Optimize creation of psid_map
  • 7601615: Documented need of parenthesis in htonl and htons
  • 0fd4236: Adapt requires_splitter to new configuration format
  • 6764c62: Implement set-operator-state
  • c6f9b9d: Implement RPC set-operator-state
  • b116e30: Rename set_operator_state to set_alarm_operator_state
  • 2710a04: Raise error on set_alarm_state
  • 1cc027b: Update README
  • 46660fa: Rework argument parsing
  • 3c49cfe: Add set-alarm-operator-state to README.md
  • 750221c: Implement purge-alarms
  • 506c4f0: Add RPC definition of purge-alarms
  • 27874ea: Fix nits
  • 3c45df9: Implement compress-alarms
  • 0a5b4d9: Implement RPC compress-alarms
  • f5887c1: Fix format of compress-alarms command
  • 80b7fa9: Missing statements in snabb-softwire-v2 schema
  • 5699643: Implement alarm summary
  • 6643388: Decouple alarms declaration
  • 16299e2: Remove tabs
  • a7d8bac: Move apps.lwaftr.alarms to program.lwaftr.alarms
  • 3053ee8: Remove alarms container from snabb-softwire-v2
  • 0e297f2: Add subprogram to fetch alarms state
  • d411ec2: Do not append alarms state in lib.yang.state
  • 7035b2b: Add alarms module
  • 97f918e: Assert schema is 'ietf-alarms'
  • 8d9eb5b: Move alarms related subprograms from config to alarms module
  • ef46bec: Rename set_alarms_operator_state subcommand to set_operator_state
  • c052080: Modify README
  • eb73690: Adjust alarms related programs
  • 631f73a: Customize usage for each alarms command
  • 68002b1: Make alarm_type.resource a single data type
  • 444cc70: Rename 'alarm_codec.parse_args' to 'alarm_codec.to_alarm'
  • d296d40: Temporarily deactive alarms overwritten by lwaftr
  • 41096e7: Make add_to_inventory a message passing command
  • ebeca50: Make declare_alarm a message passing command
  • 162caff: Replace ARP resource identifier for PID
  • c84e156: Add alarms API method to set default alarms
  • fe969b2: Preserve previously defined resources
  • 558bbf9: Replace NDP resource identifier for PID
  • 8458d8c: Return '' if empty string
  • 672a32c: Fix alarm_codec test
  • 42e946c: Check default alarm exists before accessing it
  • 6ec0eb2: Fix lib.yang.alarms test
  • 8d20ddc: Clear alarm only if it previously existed
  • 833abd7: Raise alarms if bad-softwires matches go over threshold
  • 60ef3c9: Move alarm checks to beginning of push function
  • b6102f0: Implement ingress/egress IPv4 and IPv6 filter alarms
  • 1123663: Raise alarm if incoming IPv4 fragments reaches limit
  • 921e7bd: Raise alarm if incoming IPv6 fragments reaches limit
  • 4a896e4: Raise alarm if outgoing IPv4 fragments reaches limit
  • fbe86c1: Raise alarm if outgoing IPv6 fragments reaches limit
  • c5c8cf9: Alarm helper class for querying expressions
  • 85a7bd4: Implement ingress bandwith and packet-rate alarms
  • b9fad56: Implement ingress packet drops alarm
  • 887d048: lwAFTR specific alarms documentation
  • 226d8af: Rename ExprAlarm to CallbackAlarm
  • 57621f3: Fix typo in require
  • b0fe977: Do not print out counters which are not defined

Jessica Tallon (116):

  • 854d1bc: #683 Add version 2 of snabb-softwire yang file
  • 47db93b: #683 Add config migration for snabb-schema-v2
  • 32fc3d4: #683 Convert the lwaftr test configs to v2
  • ea1be8a: #683 Update generate_binding_table.lua for config v2
  • b194d4a: #683 - Fix typos in generate_binding_table.lua
  • fbd45f3: #683 - Fix snabb-softwire-v2 module name & add revision
  • 942c8e1: #683 - Add mandatory to br-address leaf in snabb-softwire-v2
  • 644564a: #683 - Convert codebase to use snabb-softwire-v2
  • 4eff4d4: #683 - Generalize migration and fix for printing
  • 5755a1d: #683 - Convert config commands to snabb-softwire-v2
  • 2cb1ee7: #683 - Convert documentation and some tests to snabb-softwire-v2
  • e20dd82: #683 - Migrate snabbvmx configs and some more tests
  • d587d2c: #683 - Migrate lwaftr's vlan test configs
  • 1d1e6fb: #683 - Correct the version number for config migration
  • 650b0ff: Fixes problem with large migration files
  • 9d188e0: Remove comments and br_address list
  • 6af4025: Add new version to migrate-configuration README
  • 4e8deea: Remove unused local variable
  • 5a9cd59: Retrigger tests to run
  • 086bf1f: Updates the test for br-address on softwire
  • 0bf92ba: Fix small nit in config test
  • 98ade9e: Move psidmap onto softwire in snabb-softwire-v2
  • 2e4b581: Add migration for psidmap on softwire
  • b759e1f: Convert lwaftr's data files to 3.2.0.1
  • 8a9aad4: Convert v2 migration to handle 3.2.0 and 3.2.0.1
  • 163438a: Update revision statement to include new port-set
  • 24407a2: Support new softwire in support and binding table
  • 8f62c22: Change binding table's psid map to ctable
  • 7d419bf: Add ability to add psid entries and update tests
  • f22b67a: Remove validate_config and validate_update
  • d69ed40: Fix migration to 3.2.0
  • 020659c: Update snabbvmx tests to the psid-map on softwires
  • 9e463a3: Fix a test to use snabb-softwire-v2 schema
  • 7cb536a: Fix a few more tests and remove redundent tests
  • 3f4d908: Fix config translation layer for ietf-softwire
  • c2408ff: Fix small nits
  • a1a3425: Update documentation for new schema
  • 7776572: Fix typo nit in docs
  • c96875f: Remove shift and padding parameters
  • 5eb7126: Update test data for removal of shift and padding
  • 6635dd4: Update migration for removal of shift and padding
  • 6db0b08: Update snabbvmx configs to remove shift too
  • c833507: Fix migration to handle larger files and add padding leaf
  • c7cb145: Convert the binding table to use rangemap
  • d49aaf7: Fix small documentation and other nits
  • 35e23c4: Add test for lwaftr's generate-binding-table subcommand
  • 985359a: Fix small nit in generate_binding_table_test.py
  • c48d6af: Update generate-binding-table for new schema changes
  • 10c5029: Fix small performance nit
  • 43bfb5d: Update migrations fixing the port-set definition.
  • fc8980b: Fix lwaftr's migrate-configuration.
  • f27f70a: Fix lwaftr's test vlan configs
  • eac7acf: Fix some small nits
  • c295c2c: Add selftest for YANG choice type
  • 7699f77: Fix #835 - Support YANG choice statement
  • ef66b7d: Fix small nit in parser definition
  • efd24f7: Add choice statement printer for YANG data
  • 8b07e1e: Add YANG binary data emitter for choice statements
  • 5488770: Fix potential problem modifying a table during iteration
  • 725a915: Add test for choice support for YANG binary compilation
  • acb6707: Include the round which binary choice test fails
  • 0eb00d3: Fix bug where choice statements where not being written out correctly
  • 3f9ab2e: Add multiprocess support to snabb-softwire-v2
  • 37b5b13: Change instance list to have a list for RSS queues
  • 3f2d3e3: Addresses feedback on multiprocess changes
  • 6d8106e: Fix some small problems in YANG schema
  • ec7ec0f: Add migration for multiprocess snabb-softwire-v2
  • 48a7687: Migrate lwaftr testing config files
  • 27d7c7e: Convert lwaftr bench to multiprocess config for non --reconfigurable
  • 9bbf115: Add support for snabb-softwire-v3 for reconfigurable
  • 1dfb7e6: Convert test data from fixed PCI device to JIT based
  • 2d8f87f: Update tests and migration
  • 5f7c950: Add missed snabbvmx configs
  • ea311f6: Fix nit in snabbvmx setup
  • 127dcb8: Add checks for PCI devices and feed single instance configs to lwaftr
  • 0b73e25: Fix vlan tagging in new configuration
  • 049126c: Update documentation for multiprocess snabbs-softwire-v2 schema
  • 237a541: Update the version number to new format used by thew lwAFTR
  • 6b527a9: Fix a couple of typos and nits from review
  • 0444c7e: Restore --v4 and --v6 flags to lwaftr run command.
  • 737bf47: Fix small bug in retriving instance config
  • 27a6fc5: Fix small nit in documentation
  • ade39da: Fix some small nits
  • 9db1f51: Remove redundnet JIT files in selftest.sh
  • 096de03: Fix incorrect call to produce_instance_configs in snabbvmx
  • c626e21: Move back produce_instance_configs to lwutil
  • a3868d2: Fix testcases as manual migration is not needed.
  • 4e0efcf: Fix #876 - Improve config migration by chaining together
  • 5f5c257: Add selftests for snabb lwaftr migrate-configuration
  • 6f778a7: Reduce memory footprint of migration
  • d7abf53: This fixes the memory issues with util.string_output_file
  • 176906c: Deprecate reconfigurable flag
  • 95c1e4e: Fix few nits with depreaction of --reconfigurable
  • 65e447c: Start worker processes from leader
  • 9503b7d: Cleanup setup.lua to remove produce_instance_configs calls
  • 380df1e: Fixes Leader update configuration
  • a1a98c2: Maintain a single in_place_dependencies
  • c7b918c: Fix nits in variable names and comments
  • 0bd6d0c: Improve variable name clarity and make timer repeating
  • 0c4b0f8: Move sampling to setup
  • 7a64163: Support starting and stopping instances via snabb config
  • 155269b: Update ietf-softwire translation layer for multiproc
  • 44c0e36: Improve error handling in multiprocess tests
  • 949be79: Add empty.conf data for lwaftr
  • edc1e75: Shutdown the follower properly when removing
  • 0b742d1: Stop csv stats outputting for stale instances
  • f9b12ab: Only check for stale followers if one has been shutdown
  • ede1f8c: Fix nit
  • 8aec912: Add test for migration using --on-a-stick command
  • 71a0f9d: Appropriately choose on-a-stick or bump-in-the-wire
  • 34a2f63: Fix typo nits
  • 278501c: Fix get-state for multiprocesses in lwaftr
  • c893cbc: Add tests for multiprocess get-state
  • 8b8a244: Change default schema to ietf-softwire
  • 0d70e22: Fix indent nit
  • e0c037f: Fix tests

Kristian Larsson (1):

  • 74cfd80: Remove mandatory statement for list keys

Luke Gorrie (1):

  • a8a805a: .version: bump to v2018.01

Max Rottenkolber (20):

  • 879af86: core.packet: resize should return the packet like the other functions
  • 0a67162: lib.ipsec.esp: add support for tunnel mode
  • 1df5f63: program/snabbnfv/selftest.sh: move some functions to test_env for reuse
  • add01dc: Cleanup ipsec esp linux interoperability test.
  • cb28b63: apps/ipsec/selftest.sh: remove leftovers
  • 1600fcb: lib.ipsec.esp.decrypt_payload: properly handle packet underflow
  • b3072ab: lib.ipsec.aes_128_gcm: use consttime_memequal to compare HMAC
  • beab39c: lib.ipsec.aes_128_gcm: use fixed length ASM routine instead of consttime_memequal
  • d95d1cb: apps/ipsec/selftest.sh: add environment variable for skipping the e2e test
  • ae09895: lib.ipsec.esp.decrypt_payload: remove redundant bounds/spi checks
  • 2794f6a: core.link: free any packets left in link when freeing link
  • ac7c5e0: top: fix bug where counters were redundantly reopened
  • 413b661: lib.ipsec: update documentation w/r to tunnel mode and new interface
  • f0b2060: src/README.md: improve docs of core packet ops that clobber their input value
  • ee6cd0d: apps.ipsec: fixup incompatibilities introduces in esp-tunnel branch
  • 0faa510: Revert "src/README.md: improve docs of core packet ops that clobber their input value"
  • 73e88bf: lib.ipsec.esp: paddle back on "freeing" vs "ownership" in documentation.
  • da5293d: lib.lpm.lpm4: skip intensive test by default
  • 2c71c23: lib.numa: skip selftest if running on a non-NUMA machine
  • fcf0ff1: Revert "lib.numa: skip selftest if running on a non-NUMA machine"

Nicola Larosa (3):

  • 00af632: Allow running just one lwaftr test file (#859)
  • b04b85a: Stop the lwaftr monitor test from hanging (#858)
  • a5fa676: Improve the generate-binding-table test (#863)

Timo Buhrmester (2):

  • 28bb896: Fix minor things that crossed my path
  • 20a9c3e: ipsec test vs qemu works with vanfstd/snabblab-nixos:ipsec-linux-test (aad3824a2a703ff01bd44a5f065faee7d430cc2e) command: nix-build -K jobsets/ipsec.nix -A tests --arg snabbSrc /path/to/snabb
Jan 9, 2018
Version 9
   * Merge with snabb v2017.11.
   * Add -jopt option to l2vpn program

@eugeneia eugeneia released this Dec 12, 2017 · 1002 commits to master since this release

Assets 2

This release introduces a driver-agnostic interface to network interface cards
(NIC), and switches over to the new intel_mp driver as the default choice. In
addition, some efforts of making LuaJIT’s compiler more predictable have been
back-ported from RaptorJIT to Snabb. Endive also includes various bug fixes as
usual.

Major Changes

  • #1229 Implemented VMDq, VLAN insert/remove for intel_mp driver
  • #1199 #1234 #1236 #1248 Implemented driver-agnostic I/O interface
  • #1237 Prefer intel_mp as the default driver
  • #1242 Introduced jit.tracebarrier() primitive, to delimit JIT compiler
    traces
  • #1244 luajit: Record calls to blacklisted functions the same way as calls to
    uncompiled functions (this fixes a pathological case where a blacklisting
    could cause cascading failures of the JIT compiler)

Minor Changes

  • #1225 lib.hash.siphash: avoid ctype diversity for hash functions
  • #1230 #1247 #1190 Various intel_mp improvements
  • #1228 Fixed a bug in the wrapper of get_mempolicy(2) in ljsyscall
  • #1245 In case of a segmentation fault, we now log various interesting details
    about the faulting address before exiting
  • #1235 #1240 #1254 Minor bug fixes and enhancements

Contributors

Alexander Gall (2):

  • 35cb3ad: intel_mp: move shm initialization to constructor
  • fb46309: siphash: avoid ctype diversity for hash functions

Andy Wingo (24):

  • be89a9d: intel_mp app relies on lib.parse to supply default values
  • 824af9f: Rename "ndescriptors" intel_mp config arg to "ring_buffer_size"
  • 2b551c1: Old intel10g driver supports ring_buffer_size initarg
  • 16a16fb: Fix intel1g snabbmark for intel_mp link names
  • 125c0f8: Add "rx" and "tx" elements to PCI device info
  • 770b536: Update virtual_ether_mux to take NIC link names from PCI info
  • aabbaed: Update SnabbVMX lwAFTR setup to take link names from PCI driver
  • 2f4ca31: Unconditionally enable VMDq for lwAFTR packetblaster
  • 8037e47: Update packetblaster lwaftr to take NIC link names from PCI driver
  • a9f39db: Unconditionally turn on VMDq for LISPer
  • 9a4c329: Allow LISPer to use any PCI device that has a Snabb driver
  • 3f5d3ef: Make snabbnfv traffic resilient regarding NIC link names
  • 38b1ef6: Update comment in Snabb NFV's "fuzz" command
  • 3260ca9: Update comment in virtio/net_device.lua to point to intel_mp
  • 2ec03c0: Standardize on "app:rxdrop()" instead of "app:ingress_packet_drops()"
  • c1f3a41: Remove "snabb lwaftr transient"
  • 2745c61: Add CSVStatsTimer compatibility hack
  • 86f912e: Unconditionally turn on VMDq for the lwAFTR
  • dae0c48: Fix SnabbVMX setup for driver independence
  • 34a8156: Switch PCI driver to intel_mp
  • 60336e3: Port firehose program over to intel_mp
  • b9d1d5d: Attempt to fix apps/intel_mp/test_1g_sw_sem.snabb
  • 63295d7: Fix adaptation of "snabb snabbnfv traffic" to be driver-agnostic
  • 617e157: Early error on incompatible vlan/macaddr/vmdq settings in virtual ether mux

Asumu Takikawa (87):

  • efbb5e7: First attempt at VMDq for intel_mp
  • 60474bc: Fix up VMDq mode so that it actually runs
  • 19edfb1: First attempt at tests for VMDq mode
  • 70bd72d: Try testing different MAC addrs with VMDq
  • 284ba9f: Fix MAC address registration in VMDq mode
  • 70968dd: Add comment explaining some RSS code
  • 32857a2: Enable RSS queues via PSRTYPE properly for VMDq
  • aca0bf3: Use :bits to set the VMDq RSS mode properly
  • cc02601: Remove RSS bit check for setting RETA
  • 12a55f0: Fix RTTPCS bit set that had a wrong length arg
  • 162eac0: Adjust test to test that both vmdq pools get pkts
  • 97e3634: Move MAC pool enable code and make it cross-NIC
  • 09c3bc6: Adjust the VMDq initialization assertions
  • 6240e9a: Error when the max number of MAC addresses is reached
  • cf044c7: Add code for enabling VLAN filtering/tagging
  • e314237: Refactor vmdq test script
  • 88c0810: Enable VLAN takedown code for VMDq
  • c3b58d0: Refactor intel_mp recv test scripts to reduce duplication
  • 6991cce: Enable VLAN tag stripping in VMDq mode
  • 432e35a: Adjust VLAN test to also test tag insertion
  • ec0c436: VMDq settings for transmit queues
  • c303d30: Add a test for VLAN tag insertion & VMDq tx
  • 45a7494: Set registers needed to make Tx test work
  • e8a1c36: Fix assertion for Rx queue num to allow nil
  • e1766fb: Adjust intel_mp to error with VMDq on non-82599
  • 8e07ff3: Remove unnecessary helper function
  • 67420dd: Fix permissions on two intel_mp tests
  • e6f2b05: Fix 1q vmdq test and testrecv.lua
  • 5dc4dcd: Adjust VLAN test to avoid testing tag insertion
  • 590e2ca: Add waits to avoid race conditions in vmdq tests
  • c0558d6: Add documentation for new vmdq-related parameters
  • f83c609: Refactor vmdq-related assertions
  • f31b29a: Adjust VMDq test for 82599 to be more robust
  • 871494e: Add VMDq consistency check for intel_mp apps
  • 31229a6: Allow mirroring in VMDq mode
  • 59deb35: Avoid use of bits function in hot code
  • 2d288c1: Avoid pairs in more places in intel_mp
  • 656ce13: Fix mistake in commit d1b0a87
  • f2e8e30: Sort keys in debug prinouts for easier reading
  • 5de384a: Fix offsets for QBTC/QPTC registers
  • ddf0a24: Add rxcounter support in intel_mp
  • 37b7c2b: Add txcounter support in intel_mp
  • 142896d: Port Tx rate limit and priority code to intel_mp
  • 1cf3239: Fix silly typo in method call
  • 071290a: Add code from intel10g for discarding unsent pkts
  • 87e0d45: Fix some buggy app teardown code in intel_mp
  • d276077: Fix teardown test for this branch
  • a236d29: Rename limit field to rate_limit
  • ce2e400: Fix another typo in VLAN code
  • f13aa50: Make rx queue numbers relative to the pool number
  • 475cc80: Disable MTU check that intel10g disables
  • 24ced23: Make txq number relative to the pool number too
  • 20bc39c: Adjust the max Rx/Tx queue numbers in VMDq mode
  • 0c23646: Fix VLAN tag setting after a NIC app is restarted
  • eaab2ef: Shuffle code and refactor check_vmdq method
  • 98cecb6: Automatically select available pools in VMDq mode
  • 6ea7eeb: Add a test where VMDq pools are auto selected
  • 15e4865: Revise intel_mp poolnum docs
  • 9007754: Add a fine-grained test for intel_mp auto pools
  • ddf3e26: Fix pool lock cleanup for intel_mp
  • 5596eab: Minor fixes in intel_mp vmdq code
  • e9b8153: Move comment to avoid conflict with newline
  • 19e6434: Rename some test files .sh -> .snabb
  • c00adf8: Minor improvements to pool selection code
  • ee0ce1d: Protect against race conditions in VMDq config
  • 9f3074d: Add test ensuring MAC/VLAN indices are set right
  • b0b0daa: Adjust sleep time and add wait to intel_mp test
  • 76b3c34: Fix fd cleanup in intel_mp
  • 702d01b: Use conf defaults explicitly for consistency
  • 4f27b28: Add option to disable rxq/txq in intel_mp
  • b9a04a0: Explicitly disable rxq/txq for intel_mp test
  • ac2e60c: Update intel_mp README with diagram & methods
  • 790786f: Update intel_mp README with all ported config options
  • aa81c54: Fix documented max pools/queues in intel_mp README
  • f2c673f: Add a reconfig method to intel_mp
  • 5ed8e4f: Clear ETQF/ETQS registers on init
  • c91f004: Fix RXPBSIZE initialization
  • 6823705: Set packet buffer size to max (16KB) via SRRCTL
  • ee98e2f: Only sync stats in push if rxq is disabled
  • ecb74d3: Cache functions imported from link module
  • f858e48: Enable VM TX loopback in VMDq mode
  • 033f657: Revert "Add a reconfig method to intel_mp"
  • 9c7763c: Add comments and delete commented code in intel_mp
  • 67e1776: Adjust ctable selftest to avoid assertion failure
  • 8c36d0b: Allow snabbwall to use any NIC that has a Snabb driver
  • a0591b4: Make lwaftr loadtest work with any PCI device
  • f21e800: Port packetblaster over to intel_mp

Diego Pino Garcia (3):

  • 245e0f0: Set mask.size equals to MAX_NUMNODES if lower
  • a2fd55f: Rewrite get_maxnumnodes function to not depend on a fixed filesize
  • 776601a: Rework readfile function and add comment on how to calculate maxnumnodes

Fabian Bonk (1):

Luke Gorrie (6):

  • c2da4ae: Add jit.tracebarrier() primitive
  • bfc8612: core.engine: jit.tracebarrier() before each app callback
  • e8c0808: core.engine: jit.tracebarrier() after each app callback too
  • 1862084: lj_record.c: Record IFUNC/IFUNCV the same as FUNC/FUNCV
  • 0cc1ad9: .version: bump to 2017.11
  • 50ced99: engine: Remove jit.barrier() calls around apps (too expensive)

Max Rottenkolber (2):

  • e2ef66a: core/memory: log segfault address to stderr for unhandled SIGSEGV
  • 7c98e06: core/memory: also log instruction and stack pointers as well as si_errno

Nicola 'tekNico' Larosa (19):

  • 6b321ac: Make intel_mp tests run even when either 1G or 10G cards are not present
  • a13a385: Disable VMDq check if not in VMDq mode
  • 34d2612: Add default for number of pools
  • a9d7c31: Remove redundant poolnum check
  • 07baa18: Remove another redundant check on poolnum
  • 4138072: Replace intel1g with intel_mp in comments and strings
  • 9615f89: Remove tabs from testrecv.lua
  • 7217501: Remove redundant checks for link in push and pull methods
  • 50fcf69: Fix txdesc bug in intel_mp driver
  • ae707ce: Allow 64 pools instead of 32, and 2 queues per pool instead of 4
  • 0574ad6: Undo wrong change
  • 5a6177f: Fix intel_mp test
  • fd6e310: Remove duplicate require line
  • 31e625e: Add the poll-follower-for-channel fix
  • a58fa28: Typo fix to make CI run again
  • 299a5a8: Add config defaults for txq and rxq
  • d936934: Add default for number of pools (revised)
  • 9c0547d: Make IPFIX use generic pci.device_info to load drivers
  • c8df78d: Allow lwAFTR to use any Snabb-supported PCI device

krawthekrow (1):

  • e45ba27: include ipv4/ipv6 in gre inner protocol list

@eugeneia eugeneia released this Nov 10, 2017 · 1174 commits to master since this release

Assets 2

This release merges recent changes to SnabbWall, a layer-7 network flow
detector and firewall application built using Snabb. It also includes various
minor bug fixes and documentation updates.

Changes

Contributors

Andy Wingo (1):

  • 199c0ce: Allow LPM self-tests to complete even if no CPU affinity

Asumu Takikawa (2):

  • 7eaf4aa: Refactor snabbwall test script, remove temp files
  • f5cb8be: Change upstream branch of snabbwall to wingo-next

Ben Agricola (1):

  • 0508572: Fix Unix socket EOF handling

Diego Pino Garcia (7):

  • 0ad67c7: Add Apache License header
  • 7521960: Rename variables
  • 4aa32da: Explain filtering rules
  • e56e9f8: List 'filter' program in wall help
  • cef61c2: Show up filtering examples in 'filter' help
  • 1140397: Require root permission
  • 2198cea: Add Snabbwall copyright notice

Luke Gorrie (1):

  • 6cb8f46: .version: bump to 2017.09

ikdc (1):

  • 0afaa40: Correct name of Intel 82599 app in docs
Oct 23, 2017
Version 8
Fix bugs in l2vpn.lua introduced with 54b99f8.

@eugeneia eugeneia released this Aug 30, 2017 · 1199 commits to master since this release

Assets 2

This release adds a library of LPM routines for IPv4 addresses. Endive also includes many various improvements and fixes, including direct access to CPU PMU hardware, MTU support for apps.tap, improved performance for apps.vlan, and extended configuration options for apps.ipv6.nd_light.

Changes

  • #1136 lib.lpm: Longest Prefix Match library for IPv4 addresses
  • #1170 lib.pmu: Enable RDPMC via /sys/devices/cpu/rdpmc
  • #1178 lib.protocol.header: Return nil instead of asserting when a header is too big to overlay
  • #1189 apps.tap: support MTU, augment stats
  • #1191 apps.vlan: improve performance, configurable encapsulation
  • #1193 apps.ipv6.nd_light: added two new configuration options (remote_mac, quit)
  • #1208 Fixes a bug in the IPFIX app's netflow v9 mode
  • #1174 #1176 #1179 #1142 Minor bug fixes and improvements

Contributors

Alexander Gall (8):

  • 20d5958: Tap: support MTU, augment stats
  • d26fd86: Fixes/enhancements for iftable_mib.lua
  • ee18964: iftable_mib: streamline processing
  • c6befb8: nd_light: make app reconfigurable
  • acc3260: nd_light: add option to reduce verbosity
  • a12ac85: nd_light: add optional option local_mac
  • ccbe810: nd_light: fix bug in NS validation
  • da4f98b: apps.vlan: improve performance, configurable encapsulation

Andy Wingo (46):

  • f601fcf: intel_mp: Poll more frequently for linkup
  • bf9baa2: Re-introduce 82599 reset into linkup wait loop.
  • d60b166: Use default hash in IPFIX cache
  • 9c01453: Minor comment fix in ipfix exporter
  • ce65fd9: Split IPv4 and IPv6 collector data paths
  • e6b1d36: Small IPFIX elements parsing cleanup
  • 47a6188: IPFIX: Refactor template computation
  • 87945ec: Add anonymous counters and links
  • 10d7c6f: IPFIX exporter logic now independent of record types
  • 331840c: Rename flow key/value to match standard IEs
  • a7d3db1: Join IPFIX apps together
  • fb959e7: Use generated types in ipfix cache
  • 4aa22c5: Better mocking for ipfix test
  • 318bac7: Join IPFIX meter and exporter apps
  • 4608a95: Implicitly create cache, and expire records directly
  • 4b9874d: IPFIX app has single input again
  • 1daf62d: Separate IPFIX templates into separate file
  • a17a0e9: Fix IPFIX leak
  • 2a9efb6: Revert anonymous links
  • 03d4075: Pare down info collected by default IPFIX flow sets
  • 26da117: Try different expiry mechanism
  • ba10cc3: Remove unused variable
  • 0115e5d: Configurable template refresh interval
  • 2887322: Remove IPFIX utils module
  • 72bddd8: Clean up IPFIX file header
  • 56914f9: Clean up FlowSet initialization.
  • c5a9f3e: Add comments; use float seconds more generally.
  • 734501a: More IPFIX cleanup
  • 6ac2bf2: Make set of templates configurable
  • 16830a3: Add README.md
  • 1d2d633: Initial import of lwAFTR IPv4 apps to apps/ipv4
  • ed64366: Inline needed bits of ipv4_apps into arp.lua
  • 93e1f2d: Add ARP test
  • d426e2f: Break ARP app off from lwaftr
  • e8e2f30: Switch lwAFTR over to new ARP app
  • 5d57a65: ARP can assign itself a local MAC address; stamps outgoing traffic
  • e2f5f31: Add ARP README.md
  • 3c57080: Add ARP documentation to the doc build
  • 41c49f2: Fix nits
  • 8880f5e: Remove unwanted tabs
  • adbd63c: Integrate ARP into IPFIX
  • b949911: Remove Ethernet details from IPFIX app
  • 9155b53: Simplify "probe" interface to rely on ARP
  • e31bace: Add missing imports
  • 6e5a979: Add documentation for ipfix probe
  • e7bf90e: Fix nits

Asumu Takikawa (70):

  • b5bfcec: Initial draft of netflow app
  • b6759d3: Add a selftest, support transport ports properly
  • b07d1f0: Start to implement V9/IPFIX communication code
  • a304284: Can now export flow records at a very basic level
  • b35fb6b: Fix uptime calculation for v9 packets
  • e30dc7d: Fix IP checksum computation for exports
  • f2f3421: Make the exporter slightly more configurable
  • d2eed9a: Rename apps/program to avoid netflow confusion
  • 4d9965e: Account for MTU in constructing record packets
  • 2953d56: Make sure to free ignored packets
  • 415b353: Make selftest pass again
  • 5952427: Rewrite timer-based code in flow_export
  • 6e4e411: Print a message when selftest succeeds
  • 787fc48: Add a sanity check for flow exporter's ctable
  • 41e023a: Improve selftest with random packet processing
  • d2c82eb: Improve selftest by checking number of flows
  • 33f293e: Fix variables that should have been renamed
  • 4da54b2: Fix flow timestamp code to use the right clock
  • 332c9ee: Enable idle flow timeout now that it works
  • 1b77271: Reformat FFI cdefs for flow key/record
  • 1008f5b: Restructure flow data structures for efficiency
  • ca47cb6: Add an IPv6 test and fix address fields in key
  • 11543f2: Modify IPFIX code to use IANA assignment CSV
  • b6171d6: Fix uptime computation that got out of sync
  • 3374a65: Add debug printing for flow expiration
  • 4320295: Fix silly boolean/number confusion in ipfix.lua
  • abe9d9e: Fix typo in ipfix.lua
  • a1f866a: Improve debug printouts, set it via environment
  • acdb106: Swap idle and active timeouts
  • 8f890ae: Improve debug messages with datestamp, abstract it
  • 735493b: Fix active timeout calculation
  • 80026f4: Fix padding bytes and do a minor refactoring
  • 833d141: Progress towards a robust snabb flow_export run
  • 6481093: Make flow timeouts configurable via program flags
  • 8091ffe: Refactor IPFIX code to use a class & methods
  • 3175097: Adjust flow export code to allow IPFIX v10 messages
  • b0acf2c: Refactor write_header arguments in ipfix
  • 6a9d1b2: Adjust default MTU to 512 octets per RFC7011
  • 21f7e93: Adjust default template refresh per RFC5153
  • 43d2b60: Packets should always be freed at the end
  • d3d0062: Adjust selftest for recent config changes
  • 37f879d: Use a consistent UDP src port per "session"
  • 0d11dae: Fix record data order and do minor refactoring
  • 0582024: Do a major refactoring of the flow exporter into two apps
  • 3805894: Rename flow export app/program to ipfix
  • 4467041: Add a selftest for apps.ipfix.export
  • ef4e93f: Move record expiry function back into the meter
  • 38b96ad: Expire records incrementally instead of on a timer
  • e2243ce: Rewrite meter code to avoid using header libraries
  • 62a550d: Improve 'snabb ipfix probe' for benchmarking
  • a0ccddb: Avoid allocation of flow keys for old flows
  • af63e7e: Fix bugs in the last commit, zero out the key
  • 3ac87e2: Pre-allocate both keys and record variables
  • 59d5017: Reduce number of timestamp computations
  • bd89b4d: Save some space in the flow key representation
  • 8271e42: Use a different hash function for performance
  • 53e04f6: Use dynasm to speed up the hash function
  • c760913: Use slightly nicer assembly for hash
  • 9b89c94: Avoid indirection through wrapper methods in cache
  • 79126df: Fix debug prints that broke from some optimization
  • 60e1a0c: Add a basic benchmark script for the IPFIX app
  • d8b4cb1: Fix pcap output for ipfix probe
  • fc5f8eb: Fix typo in ipfix probe
  • 2f5c77f: Fix app configuration in ipfix probe
  • 5233987: Add tap IO option for ipfix probe
  • 7ce48da: Don't read southbound packets until ARP resolved
  • b824190: Add timeout options to ipfix probe docs
  • 78bdcae: Add an ipfix test script that uses a collector
  • 4c9c4b8: Improve ipfix collector test
  • 17ac209: Fix typo in IPFIX v9 mode

Diego Pino Garcia (1):

  • d718130: Remove src/core/version.lua from .gitignore

Luke Gorrie (5):

  • d01f416: lib.pmu: Enable RDPMC via /sys/devices/cpu/rdpmc
  • 5fc8a77: .version: Bump to 2017.08
  • fabac14: virtual_ether_mux: Treat vlan=0 as vlan=nil
  • 290c139: Revert "virtual_ether_mux: Treat vlan=0 as vlan=nil"
  • ebd0aa9: apps.vlan: Allow vlan=0

Nicola 'tekNico' Larosa (4):

  • 1f1da1b: Avoid the most repetitive output in tests
  • e2aba33: Reintroduce deterministic seed report, but only when it is a new one
  • 104502f: Remove broken attempt to filter output
  • 3b86679: Relax the check on max_displacement in selftest

Pete Bristow (1):

  • 52b6308: initial import of lib.lpm* longest prefix matching lookup routines for IPv4 addresses

ikdc (6):

  • 13aa49a: Return nil instead of asserting when a header is too big to overlay.
  • 06a42e6: free new header if size is too small
  • 3b35912: document that new_from_mem can return nil
  • 2e0d952: check that new_from_mem returns non-nil in header subclasses
  • 20a1f19: assert TLV options
  • 22fa8c8: assert miscellaneous uses of new_from_mem