nhrp: NAT fixes #8240

reubendowle · 2021-03-12T03:23:08Z

This series of changes fixes a bunch of errors in handling NAT extensions, causing multiple problems. Especially when inter operating with Cisco routers, the previous code was very broken.

Now NAT handling is tested and working with any combination of:

FRR as spoke or Hub
Spoke-Spoke with either FRR or Cisco peer
The FRR device and/or the other device behind NAT

LabN-CI · 2021-03-12T04:55:20Z

Outdated results 💚

Basic BGPD CI results: SUCCESS, 0 tests failed

_	_
Result	SUCCESS git merge/8240 `9e3a806`
Date	03/11/2021
Start	23:15:49
Finish	23:55:18
Run-Time	39:29
Total	1815
Pass	1815
Fail	0
Valgrind-Errors	0
Valgrind-Loss	0
Details	vncregress-2021-03-11-23:15:49.txt
Log	autoscript-2021-03-11-23:16:56.log.bz2
Memory	477 514 430

For details, please contact louberger

nhrpd/zbuf.c

nhrpd/nhrp_peer.c

nhrpd/nhrp_shortcut.c

nhrpd/nhrp_peer.c

Jafaral · 2021-03-12T05:59:03Z

Excellent work @reubendowle, thanks for fixing nhrp!

NetDEF-CI · 2021-03-12T06:47:22Z

Continuous Integration Result: FAILED

See below for issues.
CI System Testrun URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17598/

This is a comment from an automated CI system.
For questions and feedback in regards to this CI system, please feel free to email
Martin Winter - mwinter (at) opensourcerouting.org.

Get source / Pull Request: Successful

Building Stage: Successful

Basic Tests: Failed

Topotests Ubuntu 18.04 arm8 part 7: Failed (click for details)

Topotests Ubuntu 18.04 arm8 part 7: No useful log found

Topotests Ubuntu 16.04 i386 part 6: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPO6U16I386-17598/test

Topology Tests failed for Topotests Ubuntu 16.04 i386 part 6:

2021-03-12 05:05:45,543 ERROR: assert failed at "test_bgp_snmp_mplsvpn/test_r1_mplsvpn_rte_table": mplsL3VpnVrfRteInetCidrMetric4 should be ['-1', '-1', '-1', '-1', '-1', '-1', '-1'] oids ['86.82.70.45.97.1.10.5.5.5.32.0.0.1.192.168.100.10', '86.82.70.45.97.1.10.7.7.7.32.0.0.1.192.168.200.10', '86.82.70.45.97.1.192.168.34.0.24.0.0.1.10.4.4.4', '86.82.70.45.97.1.192.168.100.0.24.0.0.1.192.168.100.10', '86.82.70.45.97.1.192.168.100.0.24.0.1.0', '86.82.70.45.97.1.192.168.200.0.24.0.0.1.192.168.200.10', '86.82.70.45.97.1.192.168.200.0.24.0.1.0'] full dict ({'86.82.70.45.97.1.10.7.7.7.32.0.0.1.192.168.200.10': '-1', '86.82.70.45.97.1.192.168.200.0.24.0.1.0': '-1', '86.82.70.45.97.1.192.168.100.0.24.0.1.1.192.168.100.10': '-1', '86.82.70.45.97.1.192.168.34.0.24.0.0.1.10.4.4.4': '-1', '86.82.70.45.97.1.192.168.200.0.24.0.0.1.192.168.200.10': '-1', '86.82.70.45.97.1.10.5.5.5.32.0.0.1.192.168.100.10': '-1', '86.82.70.45.97.1.192.168.100.0.24.0.0.0': '-1'}, ['-1', '-1', '-1', '-1', '-1', '-1', '-1']):
assert False
*** defaultIntf: warning: r1 has no interfaces
2021-03-12 05:06:37,482 ERROR: 'router_json_cmp' failed after 1.42 seconds
2021-03-12 05:06:37,484 ERROR: assert failed at "test_bgp_suppress_fib/test_bgp_route": "r3" JSON output mismatches
assert Generated JSON diff error report:
  
  > $->40.0.0.0/8: d2 has the following element at index 0 which is not present in d1: 
  
  	{
  	    "distance": 20,
  	    "destSelected": true,
  	    "protocol": "bgp",
  	    "internalFlags": 8,
  	    "metric": 0,
  	    "selected": true,
  	    "installed": true,
  	    "internalNextHopNum": 1,
  	    "prefix": "40.0.0.0/8",
  	    "table": 254,
  	    "internalNextHopActiveNum": 1,
  	    "internalStatus": 16,
  	    "nexthops": [
  	        {
  	            "interfaceName": "r3-eth0",
  	            "ip": "10.0.0.9",
  	            "interfaceIndex": 2,
  	            "fib": true,
  	            "flags": 3,
  	            "active": true,
  	            "afi": "ipv4"
  	        }
  	    ]
  	}
  
  	Closest match in d1 is at index 0 with the following errors: 
  
  	> $->40.0.0.0/8[0]->nexthops: d2 has the following element at index 0 which is not present in d1: 
  	
  		{
  		    "interfaceName": "r3-eth0",
  		    "ip": "10.0.0.9",
  		    "interfaceIndex": 2,
  		    "fib": true,
  		    "flags": 3,
  		    "active": true,
  		    "afi": "ipv4"
  		}
  	
  		Closest match in d1 is at index 0 with the following errors: 
  	
  		> $->40.0.0.0/8[0]->nexthops[0]->interfaceIndex: d1 has element with value '5' but in d2 it has value '2'
  	
  
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17598/artifact/TOPO6U16I386/ErrorLog/log_topotests.txt

Topotests Ubuntu 18.04 amd64 part 7: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPO7U18AMD64-17598/test

Topology Tests failed for Topotests Ubuntu 18.04 amd64 part 7:

2021-03-12 03:59:46,007 ERROR: 'router_json_cmp' failed after 83.18 seconds
2021-03-12 03:59:46,010 ERROR: assert failed at "test_isis_lsp_bits_topo1/test_rib_ipv4_step1": "rt5" JSON output mismatches the expected result
assert Generated JSON diff error report:
  
  > $->10.0.4.0/24: d2 has the following element at index 0 which is not present in d1: 
  
  	{
  	    "distance": 115,
  	    "prefix": "10.0.4.0/24",
  	    "protocol": "isis",
  	    "metric": 20,
  	    "nexthops": [
  	        {
  	            "ip": "10.0.4.3",
  	            "interfaceName": "eth-rt3",
  	            "interfaceIndex": 2,
  	            "afi": "ipv4"
  	        }
  	    ]
  	}
  
  	Closest match in d1 is at index 0 with the following errors: 
  
  	> $->10.0.4.0/24[0]->nexthops: d2 has the following element at index 0 which is not present in d1: 
  	
  		{
  		    "ip": "10.0.4.3",
  		    "afi": "ipv4",
  		    "interfaceName": "eth-rt3",
  		    "interfaceIndex": 2
  		}
  	
  		Closest match in d1 is at index 0 with the following errors: 
  	
  		> $->10.0.4.0/24[0]->nexthops[0]->interfaceIndex: d1 has element with value '5' but in d2 it has value '2'
  	
  
  > $->10.0.6.0/24: d2 has the following element at index 0 which is not present in d1: 
  
  	{
  	    "distance": 115,
  	    "prefix": "10.0.6.0/24",
  	    "protocol": "isis",
  	    "metric": 20,
  	    "nexthops": [
  	        {
  	            "ip": "10.0.6.4",
  	            "interfaceName": "eth-rt4",
  	            "interfaceIndex": 3,
  	            "afi": "ipv4"
  	        }
  	    ]
  	}
  
  	Closest match in d1 is at index 0 with the following errors: 
  
  	> $->10.0.6.0/24[0]->nexthops: d2 has the following element at index 0 which is not present in d1: 
  	
  		{
  		    "ip": "10.0.6.4",
  		    "afi": "ipv4",
  		    "interfaceName": "eth-rt4",
  		    "interfaceIndex": 3
  		}
  	
  		Closest match in d1 is at index 0 with the following errors: 
  	
  		> $->10.0.6.0/24[0]->nexthops[0]->interfaceIndex: d1 has element with value '6' but in d2 it has value '3'
  	
  
2021-03-12 04:09:03,931 WARNING: ['Area 1:', ' Interface: r1-eth1, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.1.1/24', ' IPv6 Link-Locals:', ' fe80::884c:16ff:fee6:550/64', '', ' Interface: r1-eth2, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.2.1/24', ' IPv6 Link-Locals:', ' fe80::c060:ceff:fee0:59b9/64']
2021-03-12 04:09:03,931 WARNING: {'1': {'r1-eth1': [{'metric': '10', 'level': 'Level-1'}], 'r1-eth2': [{'metric': '10', 'level': 'Level-1'}]}}
2021-03-12 04:09:04,086 WARNING: ['Area 1:', ' Interface: r2-eth1, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.1.2/24', ' IPv6 Link-Locals:', ' fe80::1010:23ff:fe12:258/64', '', ' Interface: r2-eth2, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.3.2/24', ' IPv6 Link-Locals:', ' fe80::6ceb:fbff:fecd:e074/64']
2021-03-12 04:09:04,086 WARNING: {'1': {'r2-eth1': [{'metric': '10', 'level': 'Level-1'}], 'r2-eth2': [{'metric': '10', 'level': 'Level-1'}]}}
2021-03-12 04:09:04,231 WARNING: ['Area 1:', ' Interface: r3-eth1, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.2.3/24', ' IPv6 Link-Locals:', ' fe80::e086:fff:fe3b:41f6/64', '', ' Interface: r3-eth2, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.3.3/24', ' IPv6 Link-Locals:', ' fe80::785a:acff:fe76:f75/64']
2021-03-12 04:09:04,231 WARNING: {'1': {'r3-eth2': [{'metric': '10', 'level': 'Level-1'}], 'r3-eth1': [{'metric': '10', 'level': 'Level-1'}]}}
2021-03-12 04:09:17,400 WARNING: ['Area 1:', ' Interface: r1-eth1, State: Config, Active, Circuit Id: 0x0', ' Type: Unknown, Level: L1', ' Level-1 Information:', ' Metric: 16777214, Active neighbors: 0', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', '', ' Interface: r1-eth2, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.2.1/24', ' IPv6 Link-Locals:', ' fe80::c060:ceff:fee0:59b9/64']
2021-03-12 04:09:17,400 WARNING: {'1': {'r1-eth1': [{'metric': '16777214', 'level': 'Level-1'}], 'r1-eth2': [{'metric': '10', 'level': 'Level-1'}]}}
2021-03-12 04:09:17,568 WARNING: ['Area 1:', ' Interface: r2-eth1, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 16777214, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.1.2/24', ' IPv6 Link-Locals:', ' fe80::1010:23ff:fe12:258/64', '', ' Interface: r2-eth2, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.3.2/24', ' IPv6 Link-Locals:', ' fe80::6ceb:fbff:fecd:e074/64']
2021-03-12 04:09:17,569 WARNING: {'1': {'r2-eth1': [{'metric': '16777214', 'level': 'Level-1'}], 'r2-eth2': [{'metric': '10', 'level': 'Level-1'}]}}
2021-03-12 04:09:17,711 WARNING: ['Area 1:', ' Interface: r3-eth1, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.2.3/24', ' IPv6 Link-Locals:', ' fe80::e086:fff:fe3b:41f6/64', '', ' Interface: r3-eth2, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.3.3/24', ' IPv6 Link-Locals:', ' fe80::785a:acff:fe76:f75/64']
2021-03-12 04:09:17,711 WARNING: {'1': {'r3-eth2': [{'metric': '10', 'level': 'Level-1'}], 'r3-eth1': [{'metric': '10', 'level': 'Level-1'}]}}
2021-03-12 04:09:33,164 WARNING: ['Area 1:', ' Interface: r1-eth1, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.1.1/24', ' IPv6 Link-Locals:', ' fe80::884c:16ff:fee6:550/64', '', ' Interface: r1-eth2, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.2.1/24', ' IPv6 Link-Locals:', ' fe80::c060:ceff:fee0:59b9/64']
2021-03-12 04:09:33,164 WARNING: {'1': {'r1-eth1': [{'metric': '10', 'level': 'Level-1'}], 'r1-eth2': [{'metric': '10', 'level': 'Level-1'}]}}
2021-03-12 04:09:33,313 WARNING: ['Area 1:', ' Interface: r2-eth1, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.1.2/24', ' IPv6 Link-Locals:', ' fe80::1010:23ff:fe12:258/64', '', ' Interface: r2-eth2, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.3.2/24', ' IPv6 Link-Locals:', ' fe80::6ceb:fbff:fecd:e074/64']
2021-03-12 04:09:33,313 WARNING: {'1': {'r2-eth1': [{'metric': '10', 'level': 'Level-1'}], 'r2-eth2': [{'metric': '10', 'level': 'Level-1'}]}}
2021-03-12 04:09:33,453 WARNING: ['Area 1:', ' Interface: r3-eth1, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.2.3/24', ' IPv6 Link-Locals:', ' fe80::e086:fff:fe3b:41f6/64', '', ' Interface: r3-eth2, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.3.3/24', ' IPv6 Link-Locals:', ' fe80::785a:acff:fe76:f75/64']
2021-03-12 04:09:33,453 WARNING: {'1': {'r3-eth2': [{'metric': '10', 'level': 'Level-1'}], 'r3-eth1': [{'metric': '10', 'level': 'Level-1'}]}}
2021-03-12 04:09:48,084 WARNING: ['Area 1:', ' Interface: r1-eth1, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 16777214, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.1.1/24', ' IPv6 Link-Locals:', ' fe80::884c:16ff:fee6:550/64', '', ' Interface: r1-eth2, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.2.1/24', ' IPv6 Link-Locals:', ' fe80::c060:ceff:fee0:59b9/64']
2021-03-12 04:09:48,084 WARNING: {'1': {'r1-eth1': [{'metric': '16777214', 'level': 'Level-1'}], 'r1-eth2': [{'metric': '10', 'level': 'Level-1'}]}}
2021-03-12 04:09:48,227 WARNING: ['Area 1:', ' Interface: r2-eth1, State: Config, Active, Circuit Id: 0x0', ' Type: Unknown, Level: L1', ' Level-1 Information:', ' Metric: 16777214, Active neighbors: 0', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', '', ' Interface: r2-eth2, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.3.2/24', ' IPv6 Link-Locals:', ' fe80::6ceb:fbff:fecd:e074/64']
2021-03-12 04:09:48,227 WARNING: {'1': {'r2-eth1': [{'metric': '16777214', 'level': 'Level-1'}], 'r2-eth2': [{'metric': '10', 'level': 'Level-1'}]}}
2021-03-12 04:09:48,437 WARNING: ['Area 1:', ' Interface: r3-eth1, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.2.3/24', ' IPv6 Link-Locals:', ' fe80::e086:fff:fe3b:41f6/64', '', ' Interface: r3-eth2, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.3.3/24', ' IPv6 Link-Locals:', ' fe80::785a:acff:fe76:f75/64']
2021-03-12 04:09:48,437 WARNING: {'1': {'r3-eth2': [{'metric': '10', 'level': 'Level-1'}], 'r3-eth1': [{'metric': '10', 'level': 'Level-1'}]}}
2021-03-12 04:10:04,638 WARNING: ['Area 1:', ' Interface: r1-eth1, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.1.1/24', ' IPv6 Link-Locals:', ' fe80::884c:16ff:fee6:550/64', '', ' Interface: r1-eth2, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.2.1/24', ' IPv6 Link-Locals:', ' fe80::c060:ceff:fee0:59b9/64']
2021-03-12 04:10:04,639 WARNING: {'1': {'r1-eth1': [{'metric': '10', 'level': 'Level-1'}], 'r1-eth2': [{'metric': '10', 'level': 'Level-1'}]}}
2021-03-12 04:10:04,787 WARNING: ['Area 1:', ' Interface: r2-eth1, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.1.2/24', ' IPv6 Link-Locals:', ' fe80::1010:23ff:fe12:258/64', '', ' Interface: r2-eth2, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.3.2/24', ' IPv6 Link-Locals:', ' fe80::6ceb:fbff:fecd:e074/64']
2021-03-12 04:10:04,788 WARNING: {'1': {'r2-eth1': [{'metric': '10', 'level': 'Level-1'}], 'r2-eth2': [{'metric': '10', 'level': 'Level-1'}]}}
2021-03-12 04:10:04,999 WARNING: ['Area 1:', ' Interface: r3-eth1, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.2.3/24', ' IPv6 Link-Locals:', ' fe80::e086:fff:fe3b:41f6/64', '', ' Interface: r3-eth2, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.3.3/24', ' IPv6 Link-Locals:', ' fe80::785a:acff:fe76:f75/64']
2021-03-12 04:10:04,999 WARNING: {'1': {'r3-eth2': [{'metric': '10', 'level': 'Level-1'}], 'r3-eth1': [{'metric': '10', 'level': 'Level-1'}]}}
2021-03-12 04:18:43,254 ERROR: r2: zebra left a dead pidfile (pid=18767)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17598/artifact/TOPO7U18AMD64/ErrorLog/log_topotests.txt

Topotests Ubuntu 18.04 amd64 part 6: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPO6U18AMD64-17598/test

Topology Tests failed for Topotests Ubuntu 18.04 amd64 part 6:

*** defaultIntf: warning: r1 has no interfaces
2021-03-12 04:19:11,967 ERROR: assert failed at "evpn_type5_test_topo1.test_evpn_type5_topo1/test_evpn_routes_from_VNFs_p1": Testcase test_evpn_routes_from_VNFs_p1 :Failed 
   Error: [DUT: d2]: Missing route in RIB, routes: ['20::1/128']
assert "[DUT: d2]: Missing route in RIB, routes: ['20::1/128']" is True

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17598/artifact/TOPO6U18AMD64/ErrorLog/log_topotests.txt

Successful on other platforms/tests

Topotests Ubuntu 18.04 arm8 part 1
Topotests Ubuntu 18.04 amd64 part 3
Topotests Ubuntu 16.04 amd64 part 1
Topotests Ubuntu 16.04 amd64 part 6
Addresssanitizer topotests part 1
IPv6 protocols on Ubuntu 18.04
Topotests Ubuntu 16.04 i386 part 8
Topotests Ubuntu 18.04 amd64 part 5
Topotests Ubuntu 16.04 i386 part 1
Topotests Ubuntu 16.04 amd64 part 8
Addresssanitizer topotests part 3
Addresssanitizer topotests part 6
Addresssanitizer topotests part 8
Debian 8 deb pkg check
Topotests Ubuntu 18.04 arm8 part 8
Topotests Ubuntu 16.04 amd64 part 0
Topotests Ubuntu 18.04 arm8 part 6
IPv4 protocols on Ubuntu 18.04
Topotests Ubuntu 16.04 i386 part 3
Topotests Ubuntu 16.04 i386 part 4
Ubuntu 20.04 deb pkg check
Topotests Ubuntu 18.04 arm8 part 2
Topotests Ubuntu 16.04 i386 part 2
Topotests Ubuntu 16.04 i386 part 0
Addresssanitizer topotests part 2
Topotests Ubuntu 18.04 arm8 part 9
Topotests Ubuntu 18.04 arm8 part 4
Topotests Ubuntu 16.04 amd64 part 9
Debian 10 deb pkg check
Topotests Ubuntu 18.04 amd64 part 8
Debian 9 deb pkg check
IPv4 ldp protocol on Ubuntu 18.04
Addresssanitizer topotests part 9
Topotests Ubuntu 18.04 amd64 part 9
Topotests Ubuntu 16.04 amd64 part 7
Fedora 29 rpm pkg check
Addresssanitizer topotests part 4
Topotests Ubuntu 16.04 amd64 part 4
Topotests Ubuntu 16.04 amd64 part 5
Topotests Ubuntu 16.04 i386 part 5
Topotests Ubuntu 16.04 amd64 part 3
Addresssanitizer topotests part 7
Topotests Ubuntu 16.04 i386 part 9
Topotests Ubuntu 18.04 arm8 part 0
Static analyzer (clang)
Topotests Ubuntu 18.04 amd64 part 0
Topotests Ubuntu 18.04 amd64 part 4
Topotests Ubuntu 18.04 arm8 part 5
Ubuntu 18.04 deb pkg check
Addresssanitizer topotests part 5
Ubuntu 16.04 deb pkg check
Topotests Ubuntu 18.04 amd64 part 1
Topotests Ubuntu 18.04 arm8 part 3
CentOS 7 rpm pkg check
Topotests Ubuntu 16.04 i386 part 7
Topotests Ubuntu 18.04 amd64 part 2
Addresssanitizer topotests part 0
Topotests Ubuntu 16.04 amd64 part 2

Warnings Generated during build:

Checkout code: Successful with additional warnings

Topotests Ubuntu 18.04 arm8 part 7: Failed (click for details)

Topotests Ubuntu 18.04 arm8 part 7: No useful log found

Topotests Ubuntu 16.04 i386 part 6: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPO6U16I386-17598/test

Topology Tests failed for Topotests Ubuntu 16.04 i386 part 6:

2021-03-12 05:05:45,543 ERROR: assert failed at "test_bgp_snmp_mplsvpn/test_r1_mplsvpn_rte_table": mplsL3VpnVrfRteInetCidrMetric4 should be ['-1', '-1', '-1', '-1', '-1', '-1', '-1'] oids ['86.82.70.45.97.1.10.5.5.5.32.0.0.1.192.168.100.10', '86.82.70.45.97.1.10.7.7.7.32.0.0.1.192.168.200.10', '86.82.70.45.97.1.192.168.34.0.24.0.0.1.10.4.4.4', '86.82.70.45.97.1.192.168.100.0.24.0.0.1.192.168.100.10', '86.82.70.45.97.1.192.168.100.0.24.0.1.0', '86.82.70.45.97.1.192.168.200.0.24.0.0.1.192.168.200.10', '86.82.70.45.97.1.192.168.200.0.24.0.1.0'] full dict ({'86.82.70.45.97.1.10.7.7.7.32.0.0.1.192.168.200.10': '-1', '86.82.70.45.97.1.192.168.200.0.24.0.1.0': '-1', '86.82.70.45.97.1.192.168.100.0.24.0.1.1.192.168.100.10': '-1', '86.82.70.45.97.1.192.168.34.0.24.0.0.1.10.4.4.4': '-1', '86.82.70.45.97.1.192.168.200.0.24.0.0.1.192.168.200.10': '-1', '86.82.70.45.97.1.10.5.5.5.32.0.0.1.192.168.100.10': '-1', '86.82.70.45.97.1.192.168.100.0.24.0.0.0': '-1'}, ['-1', '-1', '-1', '-1', '-1', '-1', '-1']):
assert False
*** defaultIntf: warning: r1 has no interfaces
2021-03-12 05:06:37,482 ERROR: 'router_json_cmp' failed after 1.42 seconds
2021-03-12 05:06:37,484 ERROR: assert failed at "test_bgp_suppress_fib/test_bgp_route": "r3" JSON output mismatches
assert Generated JSON diff error report:
  
  > $->40.0.0.0/8: d2 has the following element at index 0 which is not present in d1: 
  
  	{
  	    "distance": 20,
  	    "destSelected": true,
  	    "protocol": "bgp",
  	    "internalFlags": 8,
  	    "metric": 0,
  	    "selected": true,
  	    "installed": true,
  	    "internalNextHopNum": 1,
  	    "prefix": "40.0.0.0/8",
  	    "table": 254,
  	    "internalNextHopActiveNum": 1,
  	    "internalStatus": 16,
  	    "nexthops": [
  	        {
  	            "interfaceName": "r3-eth0",
  	            "ip": "10.0.0.9",
  	            "interfaceIndex": 2,
  	            "fib": true,
  	            "flags": 3,
  	            "active": true,
  	            "afi": "ipv4"
  	        }
  	    ]
  	}
  
  	Closest match in d1 is at index 0 with the following errors: 
  
  	> $->40.0.0.0/8[0]->nexthops: d2 has the following element at index 0 which is not present in d1: 
  	
  		{
  		    "interfaceName": "r3-eth0",
  		    "ip": "10.0.0.9",
  		    "interfaceIndex": 2,
  		    "fib": true,
  		    "flags": 3,
  		    "active": true,
  		    "afi": "ipv4"
  		}
  	
  		Closest match in d1 is at index 0 with the following errors: 
  	
  		> $->40.0.0.0/8[0]->nexthops[0]->interfaceIndex: d1 has element with value '5' but in d2 it has value '2'
  	
  
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument
RTNETLINK answers: Invalid argument

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17598/artifact/TOPO6U16I386/ErrorLog/log_topotests.txt

Topotests Ubuntu 18.04 amd64 part 7: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPO7U18AMD64-17598/test

Topology Tests failed for Topotests Ubuntu 18.04 amd64 part 7:

2021-03-12 03:59:46,007 ERROR: 'router_json_cmp' failed after 83.18 seconds
2021-03-12 03:59:46,010 ERROR: assert failed at "test_isis_lsp_bits_topo1/test_rib_ipv4_step1": "rt5" JSON output mismatches the expected result
assert Generated JSON diff error report:
  
  > $->10.0.4.0/24: d2 has the following element at index 0 which is not present in d1: 
  
  	{
  	    "distance": 115,
  	    "prefix": "10.0.4.0/24",
  	    "protocol": "isis",
  	    "metric": 20,
  	    "nexthops": [
  	        {
  	            "ip": "10.0.4.3",
  	            "interfaceName": "eth-rt3",
  	            "interfaceIndex": 2,
  	            "afi": "ipv4"
  	        }
  	    ]
  	}
  
  	Closest match in d1 is at index 0 with the following errors: 
  
  	> $->10.0.4.0/24[0]->nexthops: d2 has the following element at index 0 which is not present in d1: 
  	
  		{
  		    "ip": "10.0.4.3",
  		    "afi": "ipv4",
  		    "interfaceName": "eth-rt3",
  		    "interfaceIndex": 2
  		}
  	
  		Closest match in d1 is at index 0 with the following errors: 
  	
  		> $->10.0.4.0/24[0]->nexthops[0]->interfaceIndex: d1 has element with value '5' but in d2 it has value '2'
  	
  
  > $->10.0.6.0/24: d2 has the following element at index 0 which is not present in d1: 
  
  	{
  	    "distance": 115,
  	    "prefix": "10.0.6.0/24",
  	    "protocol": "isis",
  	    "metric": 20,
  	    "nexthops": [
  	        {
  	            "ip": "10.0.6.4",
  	            "interfaceName": "eth-rt4",
  	            "interfaceIndex": 3,
  	            "afi": "ipv4"
  	        }
  	    ]
  	}
  
  	Closest match in d1 is at index 0 with the following errors: 
  
  	> $->10.0.6.0/24[0]->nexthops: d2 has the following element at index 0 which is not present in d1: 
  	
  		{
  		    "ip": "10.0.6.4",
  		    "afi": "ipv4",
  		    "interfaceName": "eth-rt4",
  		    "interfaceIndex": 3
  		}
  	
  		Closest match in d1 is at index 0 with the following errors: 
  	
  		> $->10.0.6.0/24[0]->nexthops[0]->interfaceIndex: d1 has element with value '6' but in d2 it has value '3'
  	
  
2021-03-12 04:09:03,931 WARNING: ['Area 1:', ' Interface: r1-eth1, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.1.1/24', ' IPv6 Link-Locals:', ' fe80::884c:16ff:fee6:550/64', '', ' Interface: r1-eth2, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.2.1/24', ' IPv6 Link-Locals:', ' fe80::c060:ceff:fee0:59b9/64']
2021-03-12 04:09:03,931 WARNING: {'1': {'r1-eth1': [{'metric': '10', 'level': 'Level-1'}], 'r1-eth2': [{'metric': '10', 'level': 'Level-1'}]}}
2021-03-12 04:09:04,086 WARNING: ['Area 1:', ' Interface: r2-eth1, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.1.2/24', ' IPv6 Link-Locals:', ' fe80::1010:23ff:fe12:258/64', '', ' Interface: r2-eth2, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.3.2/24', ' IPv6 Link-Locals:', ' fe80::6ceb:fbff:fecd:e074/64']
2021-03-12 04:09:04,086 WARNING: {'1': {'r2-eth1': [{'metric': '10', 'level': 'Level-1'}], 'r2-eth2': [{'metric': '10', 'level': 'Level-1'}]}}
2021-03-12 04:09:04,231 WARNING: ['Area 1:', ' Interface: r3-eth1, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.2.3/24', ' IPv6 Link-Locals:', ' fe80::e086:fff:fe3b:41f6/64', '', ' Interface: r3-eth2, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.3.3/24', ' IPv6 Link-Locals:', ' fe80::785a:acff:fe76:f75/64']
2021-03-12 04:09:04,231 WARNING: {'1': {'r3-eth2': [{'metric': '10', 'level': 'Level-1'}], 'r3-eth1': [{'metric': '10', 'level': 'Level-1'}]}}
2021-03-12 04:09:17,400 WARNING: ['Area 1:', ' Interface: r1-eth1, State: Config, Active, Circuit Id: 0x0', ' Type: Unknown, Level: L1', ' Level-1 Information:', ' Metric: 16777214, Active neighbors: 0', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', '', ' Interface: r1-eth2, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.2.1/24', ' IPv6 Link-Locals:', ' fe80::c060:ceff:fee0:59b9/64']
2021-03-12 04:09:17,400 WARNING: {'1': {'r1-eth1': [{'metric': '16777214', 'level': 'Level-1'}], 'r1-eth2': [{'metric': '10', 'level': 'Level-1'}]}}
2021-03-12 04:09:17,568 WARNING: ['Area 1:', ' Interface: r2-eth1, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 16777214, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.1.2/24', ' IPv6 Link-Locals:', ' fe80::1010:23ff:fe12:258/64', '', ' Interface: r2-eth2, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.3.2/24', ' IPv6 Link-Locals:', ' fe80::6ceb:fbff:fecd:e074/64']
2021-03-12 04:09:17,569 WARNING: {'1': {'r2-eth1': [{'metric': '16777214', 'level': 'Level-1'}], 'r2-eth2': [{'metric': '10', 'level': 'Level-1'}]}}
2021-03-12 04:09:17,711 WARNING: ['Area 1:', ' Interface: r3-eth1, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.2.3/24', ' IPv6 Link-Locals:', ' fe80::e086:fff:fe3b:41f6/64', '', ' Interface: r3-eth2, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.3.3/24', ' IPv6 Link-Locals:', ' fe80::785a:acff:fe76:f75/64']
2021-03-12 04:09:17,711 WARNING: {'1': {'r3-eth2': [{'metric': '10', 'level': 'Level-1'}], 'r3-eth1': [{'metric': '10', 'level': 'Level-1'}]}}
2021-03-12 04:09:33,164 WARNING: ['Area 1:', ' Interface: r1-eth1, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.1.1/24', ' IPv6 Link-Locals:', ' fe80::884c:16ff:fee6:550/64', '', ' Interface: r1-eth2, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.2.1/24', ' IPv6 Link-Locals:', ' fe80::c060:ceff:fee0:59b9/64']
2021-03-12 04:09:33,164 WARNING: {'1': {'r1-eth1': [{'metric': '10', 'level': 'Level-1'}], 'r1-eth2': [{'metric': '10', 'level': 'Level-1'}]}}
2021-03-12 04:09:33,313 WARNING: ['Area 1:', ' Interface: r2-eth1, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.1.2/24', ' IPv6 Link-Locals:', ' fe80::1010:23ff:fe12:258/64', '', ' Interface: r2-eth2, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.3.2/24', ' IPv6 Link-Locals:', ' fe80::6ceb:fbff:fecd:e074/64']
2021-03-12 04:09:33,313 WARNING: {'1': {'r2-eth1': [{'metric': '10', 'level': 'Level-1'}], 'r2-eth2': [{'metric': '10', 'level': 'Level-1'}]}}
2021-03-12 04:09:33,453 WARNING: ['Area 1:', ' Interface: r3-eth1, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.2.3/24', ' IPv6 Link-Locals:', ' fe80::e086:fff:fe3b:41f6/64', '', ' Interface: r3-eth2, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.3.3/24', ' IPv6 Link-Locals:', ' fe80::785a:acff:fe76:f75/64']
2021-03-12 04:09:33,453 WARNING: {'1': {'r3-eth2': [{'metric': '10', 'level': 'Level-1'}], 'r3-eth1': [{'metric': '10', 'level': 'Level-1'}]}}
2021-03-12 04:09:48,084 WARNING: ['Area 1:', ' Interface: r1-eth1, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 16777214, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.1.1/24', ' IPv6 Link-Locals:', ' fe80::884c:16ff:fee6:550/64', '', ' Interface: r1-eth2, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.2.1/24', ' IPv6 Link-Locals:', ' fe80::c060:ceff:fee0:59b9/64']
2021-03-12 04:09:48,084 WARNING: {'1': {'r1-eth1': [{'metric': '16777214', 'level': 'Level-1'}], 'r1-eth2': [{'metric': '10', 'level': 'Level-1'}]}}
2021-03-12 04:09:48,227 WARNING: ['Area 1:', ' Interface: r2-eth1, State: Config, Active, Circuit Id: 0x0', ' Type: Unknown, Level: L1', ' Level-1 Information:', ' Metric: 16777214, Active neighbors: 0', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', '', ' Interface: r2-eth2, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.3.2/24', ' IPv6 Link-Locals:', ' fe80::6ceb:fbff:fecd:e074/64']
2021-03-12 04:09:48,227 WARNING: {'1': {'r2-eth1': [{'metric': '16777214', 'level': 'Level-1'}], 'r2-eth2': [{'metric': '10', 'level': 'Level-1'}]}}
2021-03-12 04:09:48,437 WARNING: ['Area 1:', ' Interface: r3-eth1, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.2.3/24', ' IPv6 Link-Locals:', ' fe80::e086:fff:fe3b:41f6/64', '', ' Interface: r3-eth2, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.3.3/24', ' IPv6 Link-Locals:', ' fe80::785a:acff:fe76:f75/64']
2021-03-12 04:09:48,437 WARNING: {'1': {'r3-eth2': [{'metric': '10', 'level': 'Level-1'}], 'r3-eth1': [{'metric': '10', 'level': 'Level-1'}]}}
2021-03-12 04:10:04,638 WARNING: ['Area 1:', ' Interface: r1-eth1, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.1.1/24', ' IPv6 Link-Locals:', ' fe80::884c:16ff:fee6:550/64', '', ' Interface: r1-eth2, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.2.1/24', ' IPv6 Link-Locals:', ' fe80::c060:ceff:fee0:59b9/64']
2021-03-12 04:10:04,639 WARNING: {'1': {'r1-eth1': [{'metric': '10', 'level': 'Level-1'}], 'r1-eth2': [{'metric': '10', 'level': 'Level-1'}]}}
2021-03-12 04:10:04,787 WARNING: ['Area 1:', ' Interface: r2-eth1, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.1.2/24', ' IPv6 Link-Locals:', ' fe80::1010:23ff:fe12:258/64', '', ' Interface: r2-eth2, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.3.2/24', ' IPv6 Link-Locals:', ' fe80::6ceb:fbff:fecd:e074/64']
2021-03-12 04:10:04,788 WARNING: {'1': {'r2-eth1': [{'metric': '10', 'level': 'Level-1'}], 'r2-eth2': [{'metric': '10', 'level': 'Level-1'}]}}
2021-03-12 04:10:04,999 WARNING: ['Area 1:', ' Interface: r3-eth1, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.2.3/24', ' IPv6 Link-Locals:', ' fe80::e086:fff:fe3b:41f6/64', '', ' Interface: r3-eth2, State: Up, Active, Circuit Id: 0x0', ' Type: p2p, Level: L1', ' Level-1 Information:', ' Metric: 10, Active neighbors: 1', ' Hello interval: 3, Holddown count: 10 (pad)', ' CNSP interval: 10, PSNP interval: 2', ' IP Prefix(es):', ' 10.0.3.3/24', ' IPv6 Link-Locals:', ' fe80::785a:acff:fe76:f75/64']
2021-03-12 04:10:04,999 WARNING: {'1': {'r3-eth2': [{'metric': '10', 'level': 'Level-1'}], 'r3-eth1': [{'metric': '10', 'level': 'Level-1'}]}}
2021-03-12 04:18:43,254 ERROR: r2: zebra left a dead pidfile (pid=18767)

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17598/artifact/TOPO7U18AMD64/ErrorLog/log_topotests.txt

Topotests Ubuntu 18.04 amd64 part 6: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPO6U18AMD64-17598/test

Topology Tests failed for Topotests Ubuntu 18.04 amd64 part 6:

*** defaultIntf: warning: r1 has no interfaces
2021-03-12 04:19:11,967 ERROR: assert failed at "evpn_type5_test_topo1.test_evpn_type5_topo1/test_evpn_routes_from_VNFs_p1": Testcase test_evpn_routes_from_VNFs_p1 :Failed 
   Error: [DUT: d2]: Missing route in RIB, routes: ['20::1/128']
assert "[DUT: d2]: Missing route in RIB, routes: ['20::1/128']" is True

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17598/artifact/TOPO6U18AMD64/ErrorLog/log_topotests.txt

<stdin>:802: trailing whitespace.
		       sockunion2str(&pp->peer->vc->remote.nbma, buf[1], 
warning: 1 line adds whitespace errors.
Report for nhrp_nhs.c | 2 issues
===============================================
< WARNING: Missing a blank line after declarations
< #467: FILE: /tmp/f1-31425/nhrp_nhs.c:467:
Report for nhrp_peer.c | 28 issues
===============================================
< WARNING: Missing a blank line after declarations
< #289: FILE: /tmp/f1-31425/nhrp_peer.c:289:
< WARNING: C99 // comments do not match recommendation
< #340: FILE: /tmp/f1-31425/nhrp_peer.c:340:
< WARNING: Missing a blank line after declarations
< #341: FILE: /tmp/f1-31425/nhrp_peer.c:341:
< WARNING: Block comments use a trailing */ on a separate line
< #411: FILE: /tmp/f1-31425/nhrp_peer.c:411:
< WARNING: Block comments use a trailing */ on a separate line
< #511: FILE: /tmp/f1-31425/nhrp_peer.c:511:
< WARNING: Block comments use a trailing */ on a separate line
< #517: FILE: /tmp/f1-31425/nhrp_peer.c:517:
< WARNING: Block comments use a trailing */ on a separate line
< #1032: FILE: /tmp/f1-31425/nhrp_peer.c:1032:
< WARNING: line over 80 characters
< #1048: FILE: /tmp/f1-31425/nhrp_peer.c:1048:
< WARNING: Too many leading tabs - consider code refactoring
< #1052: FILE: /tmp/f1-31425/nhrp_peer.c:1052:
< WARNING: line over 80 characters
< #1053: FILE: /tmp/f1-31425/nhrp_peer.c:1053:
< WARNING: line over 80 characters
< #1057: FILE: /tmp/f1-31425/nhrp_peer.c:1057:
< WARNING: line over 80 characters
< #1058: FILE: /tmp/f1-31425/nhrp_peer.c:1058:
< WARNING: Too many leading tabs - consider code refactoring
< #1060: FILE: /tmp/f1-31425/nhrp_peer.c:1060:
< WARNING: Block comments use a trailing */ on a separate line
< #1079: FILE: /tmp/f1-31425/nhrp_peer.c:1079:
Report for nhrp_shortcut.c | 12 issues
===============================================
< WARNING: Missing a blank line after declarations
< #281: FILE: /tmp/f1-31425/nhrp_shortcut.c:281:
< WARNING: Missing a blank line after declarations
< #283: FILE: /tmp/f1-31425/nhrp_shortcut.c:283:
< WARNING: Block comments use a trailing */ on a separate line
< #310: FILE: /tmp/f1-31425/nhrp_shortcut.c:310:
< ERROR: trailing whitespace
< #319: FILE: /tmp/f1-31425/nhrp_shortcut.c:319:
< WARNING: line over 80 characters
< #341: FILE: /tmp/f1-31425/nhrp_shortcut.c:341:
< WARNING: line over 80 characters
< #356: FILE: /tmp/f1-31425/nhrp_shortcut.c:356:
Report for nhrp_vty.c | 10 issues
===============================================
< WARNING: line over 80 characters
< #568: FILE: /tmp/f1-31425/nhrp_vty.c:568:
< WARNING: line over 80 characters
< #640: FILE: /tmp/f1-31425/nhrp_vty.c:640:
< WARNING: line over 80 characters
< #641: FILE: /tmp/f1-31425/nhrp_vty.c:641:
< WARNING: line over 80 characters
< #652: FILE: /tmp/f1-31425/nhrp_vty.c:652:
< WARNING: line over 80 characters
< #982: FILE: /tmp/f1-31425/nhrp_vty.c:982:

CLANG Static Analyzer Summary

Github Pull Request 8240, comparing to Git base SHA b65540e
Base image data for Git b65540e does not exist - compare skipped

1 Static Analyzer issues remaining.

See details at
https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17598/artifact/shared/static_analysis/index.html

nhrpd/nhrp_peer.c

nhrpd/zbuf.c

pguibert6WIND

before going further, I would like to get a source of the specification you used to do nat extension.
my reference is https://www.cisco.com/c/en/us/td/docs/ios-xml/ios/sec_conn_dmvpn/configuration/15-mt/sec-conn-dmvpn-15-mt-book/sec-conn-dmvpn-dt-spokes-b-nat.html.

so there are some items that are clearly not covered by this documentation.
if you reproduce it with a cisco version, thanks to communicate cisco version used.

pguibert6WIND · 2021-03-12T09:35:49Z

nhrpd/nhrp_peer.c

+						if (!cie)
+							goto err;
+					}
+				} else {


I don't understand why you add some more information on the hub.
on https://www.cisco.com/c/en/us/td/docs/ios-xml/ios/sec_conn_dmvpn/configuration/15-mt/sec-conn-dmvpn-15-mt-book/sec-conn-dmvpn-dt-spokes-b-nat.html, it simply asks to add nhrp extension if needed, but not to fill in nhrp extension.

"
The hub receives the resolution request. If the spoke is behind a NAT device and there is no NAT extension, then the hub adds a NAT extension before forwarding this extension to the next node (spoke or next hop server) along the path.
"

It looks like @reubendowle missed one change in the commit. I'll discuss with him. The actual change in hub is

"The hub receives the resolution request. If the spoke is behind a NAT device and there is no NAT extension, then the hub adds a NAT extension before forwarding this extension to the next node (spoke or next hop server) along the path. However, if spoke already includes NAT extension header then it is just copied across and no changes are made to the extension header received from spoke"

The change @amollad mentions is actually included. It is perhaps a bit confusing for the purposes of this review, but that change was added as a follow up commit. See 24c6333

before going further, I would like to get a source of the specification you used to do nat extension.
my reference is https://www.cisco.com/c/en/us/td/docs/ios-xml/ios/sec_conn_dmvpn/configuration/15-mt/sec-conn-dmvpn-15-mt-book/sec-conn-dmvpn-dt-spokes-b-nat.html.

so there are some items that are clearly not covered by this documentation.

From our research, cisco does not publically disclose the exact details of how the NAT extension should work. This is a proprietary extension (in fact the extension number 9 is actually defined in RFC2735 for a completely different purpose https://tools.ietf.org/html/rfc2735#section-4.2, so technically the NAT extension is violation of RFC. But that said the NAT extension is widely used and is required for interoperability in real world networks.

The main source of our information is reverse engineering of the protocol through observing packets from Cisco devices in wireshark.

if you reproduce it with a cisco version, thanks to communicate cisco version used.

We have tested against a number of different Cisco devices. These are the devices in our lab, although I think Amol has some others in his setup:

Cisco 1921 with IOS 15.7(3)M7

Cisco 2951 with IOS 15.6(3)M2

Cisco 2901 with IOS 15.6(3)M2

Cisco 819 with Version 15.6(3)M0a

I dit a test with an our nhrp nat implementation. I followed the cisco link spec and expect that it will work.

frr implementation at hub side not behind nat device : interact ok with spoke other implementation (1)

frr implementation at spoke side not behind nat device: interact ok with spoke other implementation (2)

for (2), I could see that resolution reply is sent back via the hub, whereas on [0] it is written that resolution reply should be sent directly. So I guess the cisco implementations you used do not send directly resolution reply ?

[0] https://www.cisco.com/c/en/us/td/docs/ios-xml/ios/sec_conn_dmvpn/configuration/15-mt/sec-conn-dmvpn-15-mt-book/sec-conn-dmvpn-dt-spokes-b-nat.html

Spoke A parses the NHRP NAT-extension and builds a tunnel using Spoke B’s post-NAT address and replies directly to Spoke B.

I dit a test with an our nhrp nat implementation. I followed the cisco link spec and expect that it will work.

frr implementation at hub side not behind nat device : interact ok with spoke other implementation (1)

frr implementation at spoke side not behind nat device: interact ok with spoke other implementation (2)

for (2), I could see that resolution reply is sent back via the hub, whereas on [0] it is written that resolution reply should be sent directly. So I guess the cisco implementations you used do not send directly resolution reply ?

[0] https://www.cisco.com/c/en/us/td/docs/ios-xml/ios/sec_conn_dmvpn/configuration/15-mt/sec-conn-dmvpn-15-mt-book/sec-conn-dmvpn-dt-spokes-b-nat.html

Spoke A parses the NHRP NAT-extension and builds a tunnel using Spoke B’s post-NAT address and replies directly to Spoke B.

Well, I am aware of this and this is not easy to address. The problem is when spoke receives the Resolution-Request, then nhrpd asks Zebra to update the routing table / neighbor table accordingly. However, before Zebra gets a chance to update all this, the Resolution-Reply has already left the Spoke using old routing entries - as a result the reply goes via hub. The only way to address this is to wait for Zebra to complete all routing table updates and then only send Resolution-Reply. We thought it's not worth the effort involved ....

I dit a test with an our nhrp nat implementation. I followed the cisco link spec and expect that it will work.

frr implementation at hub side not behind nat device : interact ok with spoke other implementation (1)

frr implementation at spoke side not behind nat device: interact ok with spoke other implementation (2)

for (2), I could see that resolution reply is sent back via the hub, whereas on [0] it is written that resolution reply should be sent directly. So I guess the cisco implementations you used do not send directly resolution reply ?
[0] https://www.cisco.com/c/en/us/td/docs/ios-xml/ios/sec_conn_dmvpn/configuration/15-mt/sec-conn-dmvpn-15-mt-book/sec-conn-dmvpn-dt-spokes-b-nat.html

Spoke A parses the NHRP NAT-extension and builds a tunnel using Spoke B’s post-NAT address and replies directly to Spoke B.

Well, I am aware of this and this is not easy to address. The problem is when spoke receives the Resolution-Request, then nhrpd asks Zebra to update the routing table / neighbor table accordingly. However, before Zebra gets a chance to update all this, the Resolution-Reply has already left the Spoke using old routing entries - as a result the reply goes via hub. The only way to address this is to wait for Zebra to complete all routing table updates and then only send Resolution-Reply. We thought it's not worth the effort involved ....

ok, you mean the NBMA address of remote spoke may not be reachable directly. But don't you have spokes with default route, so that all remote spokes should be reachable directly ? I use following snipped of code to send to spoke instead of hub:

-void nhrp_peer_send(struct nhrp_peer *p, struct zbuf *zb) +static void nhrp_peer_send_to(struct nhrp_peer *p, struct zbuf *zb, union sockunion *target) { char buf[2][256]; struct nhrp_vrf *nhrp_vrf; + union sockunion *to; nhrp_packet_debug(zb, "Send"); @@ -336,33 +337,42 @@ void nhrp_peer_send(struct nhrp_peer *p, struct zbuf *zb) zlog_err("%s(): nhrp_vrf context not found", __func__); return; } + if (target) + to = target; + else + to = &p->vc->remote.nbma; debugf(NHRP_DEBUG_KERNEL, "PACKET: Send %s -> %s", sockunion2str(&p->vc->local.nbma, buf[0], sizeof buf[0]), - sockunion2str(&p->vc->remote.nbma, buf[1], sizeof buf[1])); + sockunion2str(to, buf[1], sizeof buf[1])); os_sendmsg(zb->head, zbuf_used(zb), p->ifp->ifindex, - sockunion_get_addr(&p->vc->remote.nbma), - sockunion_get_addrlen(&p->vc->remote.nbma), + sockunion_get_addr(to), sockunion_get_addrlen(to), nhrp_vrf->nhrp_socket_fd); zbuf_reset(zb); }

and that patch

@@ -507,7 +536,14 @@ static void nhrp_handle_resolution_req(struct nhrp_packet_parser *pp) } nhrp_packet_complete(zb, hdr); - nhrp_peer_send(peer, zb); + + /* if post-NAT set, reply directly to post-NAT ip address */ + if (sockunion_family(&cie_nat) != AF_UNSPEC) + nbma_addr = &cie_nat; + else + nbma_addr = NULL; + nhrp_peer_send_to(peer, zb, nbma_addr);

Is it ok to defer this change to a new pull-request? I will need to test it and currently not in position to test it

This idea looks good. Although this patch does not fit with code in this pull- there is no cie_nat variable. I think the reply would need to go direct to the already set nbma_addr variable which has chosen the most likely true nbma, from one of nat extension, ipsec parameters or the claimed nbma.

I don't have the time to check this out though. So as @amollad said, can we split this off. We are confident the code as is works in practice, as the hub always forwards the replies. Maybe a new issue could be created for this defect?

NetDEF-CI · 2021-03-14T22:24:43Z

Continuous Integration Result: FAILED

See below for issues.
CI System Testrun URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/

This is a comment from an automated CI system.
For questions and feedback in regards to this CI system, please feel free to email
Martin Winter - mwinter (at) opensourcerouting.org.

Get source / Pull Request: Successful

Building Stage: Failed

Ubuntu 18.04 ppc64le build: Failed (click for details)

Make failed for Ubuntu 18.04 ppc64le build:
(see full Make log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U1804PPC64LEBUILD/ErrorLog/log_make.txt)

In file included from ./lib/log.h:34:0,
nhrpd/nhrp_peer.c: In function nhrp_process_nat_extension:
nhrpd/nhrp_peer.c:425:19: error: the address of buf1 will always evaluate as true [-Werror=address]
./lib/zlog.h:104:29: note: in definition of macro _zlog_ref
nhrpd/debug.h:26:4: note: in expansion of macro zlog_debug
nhrpd/nhrp_peer.c:423:7: note: in expansion of macro debugf
cc1: all warnings being treated as errors
Makefile:8064: recipe for target 'nhrpd/nhrp_peer.o' failed
make[1]: *** [nhrpd/nhrp_peer.o] Error 1

Ubuntu 18.04 ppc64le build: config.status output from configure script can be found at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U1804PPC64LEBUILD/config.status/config.status
Ubuntu 18.04 ppc64le build: Unknown Log <config.log.gz>
URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U1804PPC64LEBUILD/config.log/config.log.gz

Debian 9 amd64 build: Failed (click for details)

Make failed for Debian 9 amd64 build:
(see full Make log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/CI021BUILD/ErrorLog/log_make.txt)

In file included from ./lib/log.h:34:0,
nhrpd/nhrp_peer.c: In function nhrp_process_nat_extension:
nhrpd/nhrp_peer.c:425:19: error: the address of buf1 will always evaluate as true [-Werror=address]
./lib/zlog.h:104:29: note: in definition of macro _zlog_ref
nhrpd/debug.h:26:4: note: in expansion of macro zlog_debug
nhrpd/nhrp_peer.c:423:7: note: in expansion of macro debugf
cc1: all warnings being treated as errors
Makefile:8064: recipe for target 'nhrpd/nhrp_peer.o' failed
make[1]: *** [nhrpd/nhrp_peer.o] Error 1

Debian 9 amd64 build: config.status output from configure script can be found at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/CI021BUILD/config.status/config.status
Debian 9 amd64 build: Unknown Log <config.log.gz>
URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/CI021BUILD/config.log/config.log.gz

Ubuntu 16.04 i386 build: Failed (click for details)

Make failed for Ubuntu 16.04 i386 build:
(see full Make log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U1604I386/ErrorLog/log_make.txt)

In file included from ./lib/log.h:34:0,
nhrpd/nhrp_peer.c: In function nhrp_process_nat_extension:
nhrpd/nhrp_peer.c:425:19: error: the address of buf1 will always evaluate as true [-Werror=address]
./lib/zlog.h:104:29: note: in definition of macro _zlog_ref
nhrpd/debug.h:26:4: note: in expansion of macro zlog_debug
nhrpd/nhrp_peer.c:423:7: note: in expansion of macro debugf
cc1: all warnings being treated as errors
Makefile:8064: recipe for target 'nhrpd/nhrp_peer.o' failed
make[1]: *** [nhrpd/nhrp_peer.o] Error 1

Ubuntu 16.04 i386 build: config.status output from configure script can be found at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U1604I386/config.status/config.status
Ubuntu 16.04 i386 build: Unknown Log <config.log.gz>
URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U1604I386/config.log/config.log.gz

Ubuntu 18.04 arm7 build: Failed (click for details)

Make failed for Ubuntu 18.04 arm7 build:
(see full Make log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U18ARM7BUILD/ErrorLog/log_make.txt)

In file included from ./lib/log.h:34:0,
nhrpd/nhrp_peer.c: In function nhrp_process_nat_extension:
nhrpd/nhrp_peer.c:425:19: error: the address of buf1 will always evaluate as true [-Werror=address]
./lib/zlog.h:104:29: note: in definition of macro _zlog_ref
nhrpd/debug.h:26:4: note: in expansion of macro zlog_debug
nhrpd/nhrp_peer.c:423:7: note: in expansion of macro debugf
cc1: all warnings being treated as errors
Makefile:8064: recipe for target 'nhrpd/nhrp_peer.o' failed
make[1]: *** [nhrpd/nhrp_peer.o] Error 1

Ubuntu 18.04 arm7 build: Unknown Log <config.log.gz>
URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U18ARM7BUILD/config.log/config.log.gz
Ubuntu 18.04 arm7 build: config.status output from configure script can be found at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U18ARM7BUILD/config.status/config.status

Ubuntu 16.04 amd64 build: Failed (click for details)

Make failed for Ubuntu 16.04 amd64 build:
(see full Make log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/CI014BUILD/ErrorLog/log_make.txt)

In file included from ./lib/log.h:34:0,
nhrpd/nhrp_peer.c: In function nhrp_process_nat_extension:
nhrpd/nhrp_peer.c:425:19: error: the address of buf1 will always evaluate as true [-Werror=address]
./lib/zlog.h:104:29: note: in definition of macro _zlog_ref
nhrpd/debug.h:26:4: note: in expansion of macro zlog_debug
nhrpd/nhrp_peer.c:423:7: note: in expansion of macro debugf
cc1: all warnings being treated as errors
Makefile:8064: recipe for target 'nhrpd/nhrp_peer.o' failed
make[1]: *** [nhrpd/nhrp_peer.o] Error 1

Ubuntu 16.04 amd64 build: config.status output from configure script can be found at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/CI014BUILD/config.status/config.status
Ubuntu 16.04 amd64 build: Unknown Log <config.log.gz>
URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/CI014BUILD/config.log/config.log.gz

Ubuntu 20.04 amd64 build: Failed (click for details)

Ubuntu 20.04 amd64 build: config.status output from configure script can be found at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U2004AMD64BUILD/config.status/config.status

Make failed for Ubuntu 20.04 amd64 build:
(see full Make log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U2004AMD64BUILD/ErrorLog/log_make.txt)

In file included from ./lib/log.h:34,
nhrpd/nhrp_peer.c: In function nhrp_process_nat_extension:
nhrpd/nhrp_peer.c:425:19: error: the address of buf1 will always evaluate as true [-Werror=address]
./lib/zlog.h:104:29: note: in definition of macro _zlog_ref
nhrpd/debug.h:26:4: note: in expansion of macro zlog_debug
nhrpd/nhrp_peer.c:423:7: note: in expansion of macro debugf
cc1: all warnings being treated as errors
make[1]: *** [Makefile:8624: nhrpd/nhrp_peer.o] Error 1
copying selected object files to avoid basename conflicts...

Ubuntu 20.04 amd64 build: Unknown Log <config.log.gz>
URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U2004AMD64BUILD/config.log/config.log.gz

Debian 8 amd64 build: Failed (click for details)

Debian 8 amd64 build: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/CI008BLD/config.log/config.log.gz

Make failed for Debian 8 amd64 build:
(see full Make log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/CI008BLD/ErrorLog/log_make.txt)

In file included from ./lib/log.h:34:0,
nhrpd/nhrp_peer.c: In function nhrp_process_nat_extension:
nhrpd/nhrp_peer.c:425:19: error: the address of buf1 will always evaluate as true [-Werror=address]
./lib/zlog.h:104:29: note: in definition of macro _zlog_ref
nhrpd/debug.h:26:4: note: in expansion of macro zlog_debug
nhrpd/nhrp_peer.c:423:7: note: in expansion of macro debugf
cc1: all warnings being treated as errors
Makefile:8052: recipe for target 'nhrpd/nhrp_peer.o' failed
make[1]: *** [nhrpd/nhrp_peer.o] Error 1

Debian 8 amd64 build: config.status output from configure script can be found at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/CI008BLD/config.status/config.status

Fedora 29 amd64 build: Failed (click for details)

Make failed for Fedora 29 amd64 build:
(see full Make log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/F29BUILD/ErrorLog/log_make.txt)

In file included from ./lib/log.h:34,
nhrpd/nhrp_peer.c: In function nhrp_process_nat_extension:
nhrpd/nhrp_peer.c:425:19: error: the address of buf1 will always evaluate as true [-Werror=address]
./lib/zlog.h:104:29: note: in definition of macro _zlog_ref
nhrpd/debug.h:26:4: note: in expansion of macro zlog_debug
nhrpd/nhrp_peer.c:423:7: note: in expansion of macro debugf
cc1: all warnings being treated as errors
make[1]: *** [Makefile:8623: nhrpd/nhrp_peer.o] Error 1
copying selected object files to avoid basename conflicts...

Fedora 29 amd64 build: config.status output from configure script can be found at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/F29BUILD/config.status/config.status
Fedora 29 amd64 build: Unknown Log <config.log.gz>
URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/F29BUILD/config.log/config.log.gz

Debian 10 amd64 build: Failed (click for details)

Debian 10 amd64 build: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/DEB10BUILD/config.log/config.log.gz

Make failed for Debian 10 amd64 build:
(see full Make log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/DEB10BUILD/ErrorLog/log_make.txt)

In file included from ./lib/log.h:34,
nhrpd/nhrp_peer.c: In function nhrp_process_nat_extension:
nhrpd/nhrp_peer.c:425:19: error: the address of buf1 will always evaluate as true [-Werror=address]
./lib/zlog.h:104:29: note: in definition of macro _zlog_ref
nhrpd/debug.h:26:4: note: in expansion of macro zlog_debug
nhrpd/nhrp_peer.c:423:7: note: in expansion of macro debugf
cc1: all warnings being treated as errors
make[1]: *** [Makefile:8624: nhrpd/nhrp_peer.o] Error 1
copying selected object files to avoid basename conflicts...

Debian 10 amd64 build: config.status output from configure script can be found at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/DEB10BUILD/config.status/config.status

Ubuntu 16.04 arm8 build: Failed (click for details)

Make failed for Ubuntu 16.04 arm8 build:
(see full Make log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U16ARM8BUILD/ErrorLog/log_make.txt)

In file included from ./lib/log.h:34:0,
nhrpd/nhrp_peer.c: In function nhrp_process_nat_extension:
nhrpd/nhrp_peer.c:425:19: error: the address of buf1 will always evaluate as true [-Werror=address]
./lib/zlog.h:104:29: note: in definition of macro _zlog_ref
nhrpd/debug.h:26:4: note: in expansion of macro zlog_debug
nhrpd/nhrp_peer.c:423:7: note: in expansion of macro debugf
cc1: all warnings being treated as errors
Makefile:8064: recipe for target 'nhrpd/nhrp_peer.o' failed
make[1]: *** [nhrpd/nhrp_peer.o] Error 1

Ubuntu 16.04 arm8 build: Unknown Log <config.log.gz>
URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U16ARM8BUILD/config.log/config.log.gz
Ubuntu 16.04 arm8 build: config.status output from configure script can be found at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U16ARM8BUILD/config.status/config.status

Ubuntu 18.04 arm8 build: Failed (click for details)

Ubuntu 18.04 arm8 build: config.status output from configure script can be found at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U18ARM8BUILD/config.status/config.status Ubuntu 18.04 arm8 build: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U18ARM8BUILD/config.log/config.log.gz

Make failed for Ubuntu 18.04 arm8 build:
(see full Make log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U18ARM8BUILD/ErrorLog/log_make.txt)

In file included from ./lib/log.h:34:0,
nhrpd/nhrp_peer.c: In function nhrp_process_nat_extension:
nhrpd/nhrp_peer.c:425:19: error: the address of buf1 will always evaluate as true [-Werror=address]
./lib/zlog.h:104:29: note: in definition of macro _zlog_ref
nhrpd/debug.h:26:4: note: in expansion of macro zlog_debug
nhrpd/nhrp_peer.c:423:7: note: in expansion of macro debugf
cc1: all warnings being treated as errors
Makefile:8064: recipe for target 'nhrpd/nhrp_peer.o' failed
make[1]: *** [nhrpd/nhrp_peer.o] Error 1

Ubuntu 18.04 amd64 build: Failed (click for details)

Make failed for Ubuntu 18.04 amd64 build:
(see full Make log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U1804AMD64/ErrorLog/log_make.txt)

In file included from ./lib/log.h:34:0,
nhrpd/nhrp_peer.c: In function nhrp_process_nat_extension:
nhrpd/nhrp_peer.c:425:19: error: the address of buf1 will always evaluate as true [-Werror=address]
./lib/zlog.h:104:29: note: in definition of macro _zlog_ref
nhrpd/debug.h:26:4: note: in expansion of macro zlog_debug
nhrpd/nhrp_peer.c:423:7: note: in expansion of macro debugf
cc1: all warnings being treated as errors
Makefile:8064: recipe for target 'nhrpd/nhrp_peer.o' failed
make[1]: *** [nhrpd/nhrp_peer.o] Error 1

Ubuntu 18.04 amd64 build: config.status output from configure script can be found at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U1804AMD64/config.status/config.status
Ubuntu 18.04 amd64 build: Unknown Log <config.log.gz>
URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U1804AMD64/config.log/config.log.gz

Ubuntu 16.04 arm7 build: Failed (click for details)

Ubuntu 16.04 arm7 build: config.status output from configure script can be found at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/CI101BUILD/config.status/config.status Ubuntu 16.04 arm7 build: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/CI101BUILD/config.log/config.log.gz

Make failed for Ubuntu 16.04 arm7 build:
(see full Make log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/CI101BUILD/ErrorLog/log_make.txt)

In file included from ./lib/log.h:34:0,
nhrpd/nhrp_peer.c: In function nhrp_process_nat_extension:
nhrpd/nhrp_peer.c:425:19: error: the address of buf1 will always evaluate as true [-Werror=address]
./lib/zlog.h:104:29: note: in definition of macro _zlog_ref
nhrpd/debug.h:26:4: note: in expansion of macro zlog_debug
nhrpd/nhrp_peer.c:423:7: note: in expansion of macro debugf
cc1: all warnings being treated as errors
Makefile:8064: recipe for target 'nhrpd/nhrp_peer.o' failed
make[1]: *** [nhrpd/nhrp_peer.o] Error 1

CentOS 8 amd64 build: Failed (click for details)

CentOS 8 amd64 build: config.status output from configure script can be found at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/CENTOS8BUILD/config.status/config.status

Make failed for CentOS 8 amd64 build:
(see full Make log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/CENTOS8BUILD/ErrorLog/log_make.txt)

In file included from ./lib/log.h:34,
nhrpd/nhrp_peer.c: In function nhrp_process_nat_extension:
nhrpd/nhrp_peer.c:425:19: error: the address of buf1 will always evaluate as true [-Werror=address]
./lib/zlog.h:104:29: note: in definition of macro _zlog_ref
nhrpd/debug.h:26:4: note: in expansion of macro zlog_debug
nhrpd/nhrp_peer.c:423:7: note: in expansion of macro debugf
cc1: all warnings being treated as errors
make[1]: *** [Makefile:8623: nhrpd/nhrp_peer.o] Error 1
copying selected object files to avoid basename conflicts...

CentOS 8 amd64 build: Unknown Log <config.log.gz>
URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/CENTOS8BUILD/config.log/config.log.gz

Successful on other platforms/tests

NetBSD 8 amd64 build
OpenBSD 6 amd64 build
FreeBSD 11 amd64 build
CentOS 7 amd64 build
FreeBSD 12 amd64 build

Warnings Generated during build:

Checkout code: Successful with additional warnings

Ubuntu 18.04 ppc64le build: Failed (click for details)

Make failed for Ubuntu 18.04 ppc64le build:
(see full Make log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U1804PPC64LEBUILD/ErrorLog/log_make.txt)

In file included from ./lib/log.h:34:0,
nhrpd/nhrp_peer.c: In function nhrp_process_nat_extension:
nhrpd/nhrp_peer.c:425:19: error: the address of buf1 will always evaluate as true [-Werror=address]
./lib/zlog.h:104:29: note: in definition of macro _zlog_ref
nhrpd/debug.h:26:4: note: in expansion of macro zlog_debug
nhrpd/nhrp_peer.c:423:7: note: in expansion of macro debugf
cc1: all warnings being treated as errors
Makefile:8064: recipe for target 'nhrpd/nhrp_peer.o' failed
make[1]: *** [nhrpd/nhrp_peer.o] Error 1

Ubuntu 18.04 ppc64le build: config.status output from configure script can be found at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U1804PPC64LEBUILD/config.status/config.status
Ubuntu 18.04 ppc64le build: Unknown Log <config.log.gz>
URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U1804PPC64LEBUILD/config.log/config.log.gz

Debian 9 amd64 build: Failed (click for details)

Make failed for Debian 9 amd64 build:
(see full Make log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/CI021BUILD/ErrorLog/log_make.txt)

In file included from ./lib/log.h:34:0,
nhrpd/nhrp_peer.c: In function nhrp_process_nat_extension:
nhrpd/nhrp_peer.c:425:19: error: the address of buf1 will always evaluate as true [-Werror=address]
./lib/zlog.h:104:29: note: in definition of macro _zlog_ref
nhrpd/debug.h:26:4: note: in expansion of macro zlog_debug
nhrpd/nhrp_peer.c:423:7: note: in expansion of macro debugf
cc1: all warnings being treated as errors
Makefile:8064: recipe for target 'nhrpd/nhrp_peer.o' failed
make[1]: *** [nhrpd/nhrp_peer.o] Error 1

Debian 9 amd64 build: config.status output from configure script can be found at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/CI021BUILD/config.status/config.status
Debian 9 amd64 build: Unknown Log <config.log.gz>
URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/CI021BUILD/config.log/config.log.gz

Ubuntu 16.04 i386 build: Failed (click for details)

Make failed for Ubuntu 16.04 i386 build:
(see full Make log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U1604I386/ErrorLog/log_make.txt)

In file included from ./lib/log.h:34:0,
nhrpd/nhrp_peer.c: In function nhrp_process_nat_extension:
nhrpd/nhrp_peer.c:425:19: error: the address of buf1 will always evaluate as true [-Werror=address]
./lib/zlog.h:104:29: note: in definition of macro _zlog_ref
nhrpd/debug.h:26:4: note: in expansion of macro zlog_debug
nhrpd/nhrp_peer.c:423:7: note: in expansion of macro debugf
cc1: all warnings being treated as errors
Makefile:8064: recipe for target 'nhrpd/nhrp_peer.o' failed
make[1]: *** [nhrpd/nhrp_peer.o] Error 1

Ubuntu 16.04 i386 build: config.status output from configure script can be found at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U1604I386/config.status/config.status
Ubuntu 16.04 i386 build: Unknown Log <config.log.gz>
URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U1604I386/config.log/config.log.gz

Ubuntu 18.04 arm7 build: Failed (click for details)

Make failed for Ubuntu 18.04 arm7 build:
(see full Make log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U18ARM7BUILD/ErrorLog/log_make.txt)

In file included from ./lib/log.h:34:0,
nhrpd/nhrp_peer.c: In function nhrp_process_nat_extension:
nhrpd/nhrp_peer.c:425:19: error: the address of buf1 will always evaluate as true [-Werror=address]
./lib/zlog.h:104:29: note: in definition of macro _zlog_ref
nhrpd/debug.h:26:4: note: in expansion of macro zlog_debug
nhrpd/nhrp_peer.c:423:7: note: in expansion of macro debugf
cc1: all warnings being treated as errors
Makefile:8064: recipe for target 'nhrpd/nhrp_peer.o' failed
make[1]: *** [nhrpd/nhrp_peer.o] Error 1

Ubuntu 18.04 arm7 build: Unknown Log <config.log.gz>
URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U18ARM7BUILD/config.log/config.log.gz
Ubuntu 18.04 arm7 build: config.status output from configure script can be found at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U18ARM7BUILD/config.status/config.status

Ubuntu 16.04 amd64 build: Failed (click for details)

Make failed for Ubuntu 16.04 amd64 build:
(see full Make log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/CI014BUILD/ErrorLog/log_make.txt)

In file included from ./lib/log.h:34:0,
nhrpd/nhrp_peer.c: In function nhrp_process_nat_extension:
nhrpd/nhrp_peer.c:425:19: error: the address of buf1 will always evaluate as true [-Werror=address]
./lib/zlog.h:104:29: note: in definition of macro _zlog_ref
nhrpd/debug.h:26:4: note: in expansion of macro zlog_debug
nhrpd/nhrp_peer.c:423:7: note: in expansion of macro debugf
cc1: all warnings being treated as errors
Makefile:8064: recipe for target 'nhrpd/nhrp_peer.o' failed
make[1]: *** [nhrpd/nhrp_peer.o] Error 1

Ubuntu 16.04 amd64 build: config.status output from configure script can be found at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/CI014BUILD/config.status/config.status
Ubuntu 16.04 amd64 build: Unknown Log <config.log.gz>
URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/CI014BUILD/config.log/config.log.gz

Ubuntu 20.04 amd64 build: Failed (click for details)

Ubuntu 20.04 amd64 build: config.status output from configure script can be found at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U2004AMD64BUILD/config.status/config.status

Make failed for Ubuntu 20.04 amd64 build:
(see full Make log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U2004AMD64BUILD/ErrorLog/log_make.txt)

In file included from ./lib/log.h:34,
nhrpd/nhrp_peer.c: In function nhrp_process_nat_extension:
nhrpd/nhrp_peer.c:425:19: error: the address of buf1 will always evaluate as true [-Werror=address]
./lib/zlog.h:104:29: note: in definition of macro _zlog_ref
nhrpd/debug.h:26:4: note: in expansion of macro zlog_debug
nhrpd/nhrp_peer.c:423:7: note: in expansion of macro debugf
cc1: all warnings being treated as errors
make[1]: *** [Makefile:8624: nhrpd/nhrp_peer.o] Error 1
copying selected object files to avoid basename conflicts...

Ubuntu 20.04 amd64 build: Unknown Log <config.log.gz>
URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U2004AMD64BUILD/config.log/config.log.gz

Debian 8 amd64 build: Failed (click for details)

Debian 8 amd64 build: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/CI008BLD/config.log/config.log.gz

Make failed for Debian 8 amd64 build:
(see full Make log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/CI008BLD/ErrorLog/log_make.txt)

In file included from ./lib/log.h:34:0,
nhrpd/nhrp_peer.c: In function nhrp_process_nat_extension:
nhrpd/nhrp_peer.c:425:19: error: the address of buf1 will always evaluate as true [-Werror=address]
./lib/zlog.h:104:29: note: in definition of macro _zlog_ref
nhrpd/debug.h:26:4: note: in expansion of macro zlog_debug
nhrpd/nhrp_peer.c:423:7: note: in expansion of macro debugf
cc1: all warnings being treated as errors
Makefile:8052: recipe for target 'nhrpd/nhrp_peer.o' failed
make[1]: *** [nhrpd/nhrp_peer.o] Error 1

Debian 8 amd64 build: config.status output from configure script can be found at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/CI008BLD/config.status/config.status

Fedora 29 amd64 build: Failed (click for details)

Make failed for Fedora 29 amd64 build:
(see full Make log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/F29BUILD/ErrorLog/log_make.txt)

In file included from ./lib/log.h:34,
nhrpd/nhrp_peer.c: In function nhrp_process_nat_extension:
nhrpd/nhrp_peer.c:425:19: error: the address of buf1 will always evaluate as true [-Werror=address]
./lib/zlog.h:104:29: note: in definition of macro _zlog_ref
nhrpd/debug.h:26:4: note: in expansion of macro zlog_debug
nhrpd/nhrp_peer.c:423:7: note: in expansion of macro debugf
cc1: all warnings being treated as errors
make[1]: *** [Makefile:8623: nhrpd/nhrp_peer.o] Error 1
copying selected object files to avoid basename conflicts...

Fedora 29 amd64 build: config.status output from configure script can be found at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/F29BUILD/config.status/config.status
Fedora 29 amd64 build: Unknown Log <config.log.gz>
URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/F29BUILD/config.log/config.log.gz

Debian 10 amd64 build: Failed (click for details)

Debian 10 amd64 build: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/DEB10BUILD/config.log/config.log.gz

Make failed for Debian 10 amd64 build:
(see full Make log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/DEB10BUILD/ErrorLog/log_make.txt)

In file included from ./lib/log.h:34,
nhrpd/nhrp_peer.c: In function nhrp_process_nat_extension:
nhrpd/nhrp_peer.c:425:19: error: the address of buf1 will always evaluate as true [-Werror=address]
./lib/zlog.h:104:29: note: in definition of macro _zlog_ref
nhrpd/debug.h:26:4: note: in expansion of macro zlog_debug
nhrpd/nhrp_peer.c:423:7: note: in expansion of macro debugf
cc1: all warnings being treated as errors
make[1]: *** [Makefile:8624: nhrpd/nhrp_peer.o] Error 1
copying selected object files to avoid basename conflicts...

Debian 10 amd64 build: config.status output from configure script can be found at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/DEB10BUILD/config.status/config.status

Ubuntu 16.04 arm8 build: Failed (click for details)

Make failed for Ubuntu 16.04 arm8 build:
(see full Make log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U16ARM8BUILD/ErrorLog/log_make.txt)

In file included from ./lib/log.h:34:0,
nhrpd/nhrp_peer.c: In function nhrp_process_nat_extension:
nhrpd/nhrp_peer.c:425:19: error: the address of buf1 will always evaluate as true [-Werror=address]
./lib/zlog.h:104:29: note: in definition of macro _zlog_ref
nhrpd/debug.h:26:4: note: in expansion of macro zlog_debug
nhrpd/nhrp_peer.c:423:7: note: in expansion of macro debugf
cc1: all warnings being treated as errors
Makefile:8064: recipe for target 'nhrpd/nhrp_peer.o' failed
make[1]: *** [nhrpd/nhrp_peer.o] Error 1

Ubuntu 16.04 arm8 build: Unknown Log <config.log.gz>
URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U16ARM8BUILD/config.log/config.log.gz
Ubuntu 16.04 arm8 build: config.status output from configure script can be found at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U16ARM8BUILD/config.status/config.status

Ubuntu 18.04 arm8 build: Failed (click for details)

Ubuntu 18.04 arm8 build: config.status output from configure script can be found at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U18ARM8BUILD/config.status/config.status Ubuntu 18.04 arm8 build: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U18ARM8BUILD/config.log/config.log.gz

Make failed for Ubuntu 18.04 arm8 build:
(see full Make log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U18ARM8BUILD/ErrorLog/log_make.txt)

In file included from ./lib/log.h:34:0,
nhrpd/nhrp_peer.c: In function nhrp_process_nat_extension:
nhrpd/nhrp_peer.c:425:19: error: the address of buf1 will always evaluate as true [-Werror=address]
./lib/zlog.h:104:29: note: in definition of macro _zlog_ref
nhrpd/debug.h:26:4: note: in expansion of macro zlog_debug
nhrpd/nhrp_peer.c:423:7: note: in expansion of macro debugf
cc1: all warnings being treated as errors
Makefile:8064: recipe for target 'nhrpd/nhrp_peer.o' failed
make[1]: *** [nhrpd/nhrp_peer.o] Error 1

Ubuntu 18.04 amd64 build: Failed (click for details)

Make failed for Ubuntu 18.04 amd64 build:
(see full Make log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U1804AMD64/ErrorLog/log_make.txt)

In file included from ./lib/log.h:34:0,
nhrpd/nhrp_peer.c: In function nhrp_process_nat_extension:
nhrpd/nhrp_peer.c:425:19: error: the address of buf1 will always evaluate as true [-Werror=address]
./lib/zlog.h:104:29: note: in definition of macro _zlog_ref
nhrpd/debug.h:26:4: note: in expansion of macro zlog_debug
nhrpd/nhrp_peer.c:423:7: note: in expansion of macro debugf
cc1: all warnings being treated as errors
Makefile:8064: recipe for target 'nhrpd/nhrp_peer.o' failed
make[1]: *** [nhrpd/nhrp_peer.o] Error 1

Ubuntu 18.04 amd64 build: config.status output from configure script can be found at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U1804AMD64/config.status/config.status
Ubuntu 18.04 amd64 build: Unknown Log <config.log.gz>
URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/U1804AMD64/config.log/config.log.gz

Ubuntu 16.04 arm7 build: Failed (click for details)

Ubuntu 16.04 arm7 build: config.status output from configure script can be found at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/CI101BUILD/config.status/config.status Ubuntu 16.04 arm7 build: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/CI101BUILD/config.log/config.log.gz

Make failed for Ubuntu 16.04 arm7 build:
(see full Make log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/CI101BUILD/ErrorLog/log_make.txt)

In file included from ./lib/log.h:34:0,
nhrpd/nhrp_peer.c: In function nhrp_process_nat_extension:
nhrpd/nhrp_peer.c:425:19: error: the address of buf1 will always evaluate as true [-Werror=address]
./lib/zlog.h:104:29: note: in definition of macro _zlog_ref
nhrpd/debug.h:26:4: note: in expansion of macro zlog_debug
nhrpd/nhrp_peer.c:423:7: note: in expansion of macro debugf
cc1: all warnings being treated as errors
Makefile:8064: recipe for target 'nhrpd/nhrp_peer.o' failed
make[1]: *** [nhrpd/nhrp_peer.o] Error 1

CentOS 8 amd64 build: Failed (click for details)

CentOS 8 amd64 build: config.status output from configure script can be found at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/CENTOS8BUILD/config.status/config.status

Make failed for CentOS 8 amd64 build:
(see full Make log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/CENTOS8BUILD/ErrorLog/log_make.txt)

In file included from ./lib/log.h:34,
nhrpd/nhrp_peer.c: In function nhrp_process_nat_extension:
nhrpd/nhrp_peer.c:425:19: error: the address of buf1 will always evaluate as true [-Werror=address]
./lib/zlog.h:104:29: note: in definition of macro _zlog_ref
nhrpd/debug.h:26:4: note: in expansion of macro zlog_debug
nhrpd/nhrp_peer.c:423:7: note: in expansion of macro debugf
cc1: all warnings being treated as errors
make[1]: *** [Makefile:8623: nhrpd/nhrp_peer.o] Error 1
copying selected object files to avoid basename conflicts...

CentOS 8 amd64 build: Unknown Log <config.log.gz>
URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17643/artifact/CENTOS8BUILD/config.log/config.log.gz

<stdin>:772: trailing whitespace.
		       sockunion2str(&pp->peer->vc->remote.nbma, buf[1], 
warning: 1 line adds whitespace errors.
Report for nhrp_nhs.c | 2 issues
===============================================
< WARNING: Missing a blank line after declarations
< #467: FILE: /tmp/f1-8632/nhrp_nhs.c:467:
Report for nhrp_peer.c | 30 issues
===============================================
< WARNING: Missing a blank line after declarations
< #289: FILE: /tmp/f1-8632/nhrp_peer.c:289:
< WARNING: C99 // comments do not match recommendation
< #340: FILE: /tmp/f1-8632/nhrp_peer.c:340:
< WARNING: Missing a blank line after declarations
< #341: FILE: /tmp/f1-8632/nhrp_peer.c:341:
< WARNING: Block comments use a trailing */ on a separate line
< #411: FILE: /tmp/f1-8632/nhrp_peer.c:411:
< WARNING: line over 80 characters
< #419: FILE: /tmp/f1-8632/nhrp_peer.c:419:
< WARNING: Block comments use a trailing */ on a separate line
< #509: FILE: /tmp/f1-8632/nhrp_peer.c:509:
< WARNING: Block comments use a trailing */ on a separate line
< #515: FILE: /tmp/f1-8632/nhrp_peer.c:515:
< WARNING: Block comments use a trailing */ on a separate line
< #1030: FILE: /tmp/f1-8632/nhrp_peer.c:1030:
< WARNING: line over 80 characters
< #1046: FILE: /tmp/f1-8632/nhrp_peer.c:1046:
< WARNING: Too many leading tabs - consider code refactoring
< #1050: FILE: /tmp/f1-8632/nhrp_peer.c:1050:
< WARNING: line over 80 characters
< #1051: FILE: /tmp/f1-8632/nhrp_peer.c:1051:
< WARNING: line over 80 characters
< #1055: FILE: /tmp/f1-8632/nhrp_peer.c:1055:
< WARNING: line over 80 characters
< #1056: FILE: /tmp/f1-8632/nhrp_peer.c:1056:
< WARNING: Too many leading tabs - consider code refactoring
< #1058: FILE: /tmp/f1-8632/nhrp_peer.c:1058:
< WARNING: Block comments use a trailing */ on a separate line
< #1077: FILE: /tmp/f1-8632/nhrp_peer.c:1077:
Report for nhrp_shortcut.c | 12 issues
===============================================
< WARNING: Missing a blank line after declarations
< #281: FILE: /tmp/f1-8632/nhrp_shortcut.c:281:
< WARNING: Missing a blank line after declarations
< #283: FILE: /tmp/f1-8632/nhrp_shortcut.c:283:
< WARNING: Block comments use a trailing */ on a separate line
< #310: FILE: /tmp/f1-8632/nhrp_shortcut.c:310:
< ERROR: trailing whitespace
< #319: FILE: /tmp/f1-8632/nhrp_shortcut.c:319:
< WARNING: line over 80 characters
< #341: FILE: /tmp/f1-8632/nhrp_shortcut.c:341:
< WARNING: line over 80 characters
< #356: FILE: /tmp/f1-8632/nhrp_shortcut.c:356:
Report for nhrp_vty.c | 10 issues
===============================================
< WARNING: line over 80 characters
< #568: FILE: /tmp/f1-8632/nhrp_vty.c:568:
< WARNING: line over 80 characters
< #640: FILE: /tmp/f1-8632/nhrp_vty.c:640:
< WARNING: line over 80 characters
< #641: FILE: /tmp/f1-8632/nhrp_vty.c:641:
< WARNING: line over 80 characters
< #652: FILE: /tmp/f1-8632/nhrp_vty.c:652:
< WARNING: line over 80 characters
< #982: FILE: /tmp/f1-8632/nhrp_vty.c:982:

LabN-CI · 2021-03-15T01:15:54Z

Outdated results 💚

Basic BGPD CI results: SUCCESS, 0 tests failed

_	_
Result	SUCCESS git merge/8240 `acff149`
Date	03/14/2021
Start	20:36:26
Finish	21:15:51
Run-Time	39:25
Total	1815
Pass	1815
Fail	0
Valgrind-Errors	0
Valgrind-Loss	0
Details	vncregress-2021-03-14-20:36:26.txt
Log	autoscript-2021-03-14-20:37:34.log.bz2
Memory	484 482 431

For details, please contact louberger

NetDEF-CI · 2021-03-15T02:19:35Z

Continuous Integration Result: SUCCESSFUL

Congratulations, this patch passed basic tests

Tested-by: NetDEF / OpenSourceRouting.org CI System

CI System Testrun URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17645/

This is a comment from an automated CI system.
For questions and feedback in regards to this CI system, please feel free to email
Martin Winter - mwinter (at) opensourcerouting.org.

Warnings Generated during build:

Checkout code: Successful with additional warnings

<stdin>:772: trailing whitespace.
		       sockunion2str(&pp->peer->vc->remote.nbma, buf[1], 
warning: 1 line adds whitespace errors.
Report for nhrp_nhs.c | 2 issues
===============================================
< WARNING: Missing a blank line after declarations
< #467: FILE: /tmp/f1-30392/nhrp_nhs.c:467:
Report for nhrp_peer.c | 33 issues
===============================================
< WARNING: Missing a blank line after declarations
< #289: FILE: /tmp/f1-30392/nhrp_peer.c:289:
< WARNING: C99 // comments do not match recommendation
< #340: FILE: /tmp/f1-30392/nhrp_peer.c:340:
< WARNING: Missing a blank line after declarations
< #341: FILE: /tmp/f1-30392/nhrp_peer.c:341:
< WARNING: Block comments use a trailing */ on a separate line
< #411: FILE: /tmp/f1-30392/nhrp_peer.c:411:
< WARNING: strncpy() is error-prone; please use strlcpy() if possible, or memcpy()#413: FILE: /tmp/f1-30392/nhrp_peer.c:413:
< +					strncpy(buf1, "NULL", sizeof(buf1));
< 
< WARNING: Too many leading tabs - consider code refactoring
< #423: FILE: /tmp/f1-30392/nhrp_peer.c:423:
< WARNING: Block comments use a trailing */ on a separate line
< #509: FILE: /tmp/f1-30392/nhrp_peer.c:509:
< WARNING: Block comments use a trailing */ on a separate line
< #515: FILE: /tmp/f1-30392/nhrp_peer.c:515:
< WARNING: Block comments use a trailing */ on a separate line
< #1030: FILE: /tmp/f1-30392/nhrp_peer.c:1030:
< WARNING: line over 80 characters
< #1046: FILE: /tmp/f1-30392/nhrp_peer.c:1046:
< WARNING: Too many leading tabs - consider code refactoring
< #1050: FILE: /tmp/f1-30392/nhrp_peer.c:1050:
< WARNING: line over 80 characters
< #1051: FILE: /tmp/f1-30392/nhrp_peer.c:1051:
< WARNING: line over 80 characters
< #1055: FILE: /tmp/f1-30392/nhrp_peer.c:1055:
< WARNING: line over 80 characters
< #1056: FILE: /tmp/f1-30392/nhrp_peer.c:1056:
< WARNING: Too many leading tabs - consider code refactoring
< #1058: FILE: /tmp/f1-30392/nhrp_peer.c:1058:
< WARNING: Block comments use a trailing */ on a separate line
< #1077: FILE: /tmp/f1-30392/nhrp_peer.c:1077:
Report for nhrp_shortcut.c | 12 issues
===============================================
< WARNING: Missing a blank line after declarations
< #281: FILE: /tmp/f1-30392/nhrp_shortcut.c:281:
< WARNING: Missing a blank line after declarations
< #283: FILE: /tmp/f1-30392/nhrp_shortcut.c:283:
< WARNING: Block comments use a trailing */ on a separate line
< #310: FILE: /tmp/f1-30392/nhrp_shortcut.c:310:
< ERROR: trailing whitespace
< #319: FILE: /tmp/f1-30392/nhrp_shortcut.c:319:
< WARNING: line over 80 characters
< #341: FILE: /tmp/f1-30392/nhrp_shortcut.c:341:
< WARNING: line over 80 characters
< #356: FILE: /tmp/f1-30392/nhrp_shortcut.c:356:
Report for nhrp_vty.c | 10 issues
===============================================
< WARNING: line over 80 characters
< #568: FILE: /tmp/f1-30392/nhrp_vty.c:568:
< WARNING: line over 80 characters
< #640: FILE: /tmp/f1-30392/nhrp_vty.c:640:
< WARNING: line over 80 characters
< #641: FILE: /tmp/f1-30392/nhrp_vty.c:641:
< WARNING: line over 80 characters
< #652: FILE: /tmp/f1-30392/nhrp_vty.c:652:
< WARNING: line over 80 characters
< #982: FILE: /tmp/f1-30392/nhrp_vty.c:982:

CLANG Static Analyzer Summary

Github Pull Request 8240, comparing to Git base SHA e319ed4
Base image data for Git e319ed4 does not exist - compare skipped

1 Static Analyzer issues remaining.

See details at
https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17645/artifact/shared/static_analysis/index.html

LabN-CI · 2021-03-15T04:45:20Z

Outdated results 💚

Basic BGPD CI results: SUCCESS, 0 tests failed

_	_
Result	SUCCESS git merge/8240 `224b9e5`
Date	03/15/2021
Start	00:05:48
Finish	00:45:16
Run-Time	39:28
Total	1815
Pass	1815
Fail	0
Valgrind-Errors	0
Valgrind-Loss	0
Details	vncregress-2021-03-15-00:05:48.txt
Log	autoscript-2021-03-15-00:06:54.log.bz2
Memory	478 483 430

For details, please contact louberger

LabN-CI · 2021-03-15T05:30:12Z

Outdated results 💚

Basic BGPD CI results: SUCCESS, 0 tests failed

_	_
Result	SUCCESS git merge/8240 `7a4fbcb`
Date	03/15/2021
Start	00:50:48
Finish	01:30:08
Run-Time	39:20
Total	1815
Pass	1815
Fail	0
Valgrind-Errors	0
Valgrind-Loss	0
Details	vncregress-2021-03-15-00:50:48.txt
Log	autoscript-2021-03-15-00:51:53.log.bz2
Memory	498 461 430

For details, please contact louberger

NetDEF-CI · 2021-03-15T06:57:11Z

Continuous Integration Result: SUCCESSFUL

Congratulations, this patch passed basic tests

Tested-by: NetDEF / OpenSourceRouting.org CI System

CI System Testrun URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17647/

This is a comment from an automated CI system.
For questions and feedback in regards to this CI system, please feel free to email
Martin Winter - mwinter (at) opensourcerouting.org.

Warnings Generated during build:

Checkout code: Successful with additional warnings

Report for nhrp_peer.c | 16 issues
===============================================
< WARNING: Too many leading tabs - consider code refactoring
< #429: FILE: /tmp/f1-31502/nhrp_peer.c:429:
< WARNING: line over 80 characters
< #1052: FILE: /tmp/f1-31502/nhrp_peer.c:1052:
< WARNING: Too many leading tabs - consider code refactoring
< #1056: FILE: /tmp/f1-31502/nhrp_peer.c:1056:
< WARNING: line over 80 characters
< #1057: FILE: /tmp/f1-31502/nhrp_peer.c:1057:
< WARNING: line over 80 characters
< #1061: FILE: /tmp/f1-31502/nhrp_peer.c:1061:
< WARNING: line over 80 characters
< #1062: FILE: /tmp/f1-31502/nhrp_peer.c:1062:
< WARNING: Too many leading tabs - consider code refactoring
< #1064: FILE: /tmp/f1-31502/nhrp_peer.c:1064:
< WARNING: Block comments use a trailing */ on a separate line
< #1083: FILE: /tmp/f1-31502/nhrp_peer.c:1083:

NetDEF-CI · 2021-03-15T07:24:58Z

Continuous Integration Result: SUCCESSFUL

Congratulations, this patch passed basic tests

Tested-by: NetDEF / OpenSourceRouting.org CI System

CI System Testrun URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17648/

This is a comment from an automated CI system.
For questions and feedback in regards to this CI system, please feel free to email
Martin Winter - mwinter (at) opensourcerouting.org.

Warnings Generated during build:

Checkout code: Successful with additional warnings

Report for nhrp_peer.c | 10 issues
===============================================
< WARNING: Too many leading tabs - consider code refactoring
< #429: FILE: /tmp/f1-10320/nhrp_peer.c:429:
< WARNING: line over 80 characters
< #1054: FILE: /tmp/f1-10320/nhrp_peer.c:1054:
< WARNING: line over 80 characters
< #1064: FILE: /tmp/f1-10320/nhrp_peer.c:1064:
< WARNING: Too many leading tabs - consider code refactoring
< #1066: FILE: /tmp/f1-10320/nhrp_peer.c:1066:
< WARNING: Block comments use a trailing */ on a separate line
< #1081: FILE: /tmp/f1-10320/nhrp_peer.c:1081:

LabN-CI · 2021-03-16T02:21:18Z

Outdated results 💚

Basic BGPD CI results: SUCCESS, 0 tests failed

_	_
Result	SUCCESS git merge/8240 `4195ee7`
Date	03/15/2021
Start	21:41:48
Finish	22:21:15
Run-Time	39:27
Total	1815
Pass	1815
Fail	0
Valgrind-Errors	0
Valgrind-Loss	0
Details	vncregress-2021-03-15-21:41:48.txt
Log	autoscript-2021-03-15-21:42:53.log.bz2
Memory	467 484 429

For details, please contact louberger

NetDEF-CI · 2021-03-16T02:44:29Z

Continuous Integration Result: FAILED

See below for issues.
CI System Testrun URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17679/

This is a comment from an automated CI system.
For questions and feedback in regards to this CI system, please feel free to email
Martin Winter - mwinter (at) opensourcerouting.org.

Get source / Pull Request: Successful

Building Stage: Successful

Basic Tests: Failed

Topotests Ubuntu 18.04 amd64 part 6: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPO6U18AMD64-17679/test

Topology Tests failed for Topotests Ubuntu 18.04 amd64 part 6:

*** defaultIntf: warning: r1 has no interfaces
2021-03-16 00:40:07,382 ERROR: assert failed at "evpn_type5_test_topo1.test_evpn_type5_topo1/test_evpn_routes_from_VNFs_p1": Testcase test_evpn_routes_from_VNFs_p1 :Failed 
   Error: [DUT: d2]: Missing route in RIB, routes: ['20::1/128']
assert "[DUT: d2]: Missing route in RIB, routes: ['20::1/128']" is True

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17679/artifact/TOPO6U18AMD64/ErrorLog/log_topotests.txt

Successful on other platforms/tests

Topotests Ubuntu 16.04 amd64 part 5
Topotests Ubuntu 16.04 i386 part 6
Topotests Ubuntu 18.04 arm8 part 9
Topotests Ubuntu 18.04 arm8 part 4
Topotests Ubuntu 18.04 amd64 part 7
Topotests Ubuntu 16.04 amd64 part 3
Addresssanitizer topotests part 7
Topotests Ubuntu 18.04 arm8 part 0
Static analyzer (clang)
Fedora 29 rpm pkg check
Topotests Ubuntu 18.04 arm8 part 5
Topotests Ubuntu 16.04 i386 part 2
Addresssanitizer topotests part 5
Topotests Ubuntu 16.04 amd64 part 4
Topotests Ubuntu 18.04 amd64 part 1
Topotests Ubuntu 16.04 i386 part 5
Topotests Ubuntu 18.04 arm8 part 3
Topotests Ubuntu 18.04 amd64 part 5
Topotests Ubuntu 16.04 amd64 part 7
CentOS 7 rpm pkg check
Topotests Ubuntu 16.04 i386 part 7
Addresssanitizer topotests part 0
Topotests Ubuntu 16.04 amd64 part 0
Topotests Ubuntu 18.04 amd64 part 9
Topotests Ubuntu 18.04 arm8 part 1
Topotests Ubuntu 16.04 amd64 part 1
Addresssanitizer topotests part 8
Topotests Ubuntu 18.04 amd64 part 3
Topotests Ubuntu 18.04 amd64 part 0
Addresssanitizer topotests part 1
Topotests Ubuntu 18.04 amd64 part 4
Addresssanitizer topotests part 4
IPv6 protocols on Ubuntu 18.04
Topotests Ubuntu 16.04 i386 part 0
Addresssanitizer topotests part 6
Topotests Ubuntu 16.04 i386 part 1
Topotests Ubuntu 18.04 amd64 part 2
Debian 10 deb pkg check
Topotests Ubuntu 18.04 arm8 part 8
IPv4 protocols on Ubuntu 18.04
Topotests Ubuntu 16.04 i386 part 9
Topotests Ubuntu 18.04 arm8 part 6
Topotests Ubuntu 16.04 amd64 part 2
Topotests Ubuntu 16.04 amd64 part 6
Topotests Ubuntu 16.04 i386 part 3
Ubuntu 18.04 deb pkg check
Ubuntu 20.04 deb pkg check
Topotests Ubuntu 16.04 i386 part 8
Ubuntu 16.04 deb pkg check
Addresssanitizer topotests part 2
Topotests Ubuntu 16.04 amd64 part 9
Topotests Ubuntu 16.04 amd64 part 8
Addresssanitizer topotests part 3
IPv4 ldp protocol on Ubuntu 18.04
Debian 8 deb pkg check
Topotests Ubuntu 18.04 amd64 part 8
Debian 9 deb pkg check
Addresssanitizer topotests part 9
Topotests Ubuntu 16.04 i386 part 4
Topotests Ubuntu 18.04 arm8 part 2
Topotests Ubuntu 18.04 arm8 part 7

Warnings Generated during build:

Checkout code: Successful with additional warnings

Topotests Ubuntu 18.04 amd64 part 6: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPO6U18AMD64-17679/test

Topology Tests failed for Topotests Ubuntu 18.04 amd64 part 6:

*** defaultIntf: warning: r1 has no interfaces
2021-03-16 00:40:07,382 ERROR: assert failed at "evpn_type5_test_topo1.test_evpn_type5_topo1/test_evpn_routes_from_VNFs_p1": Testcase test_evpn_routes_from_VNFs_p1 :Failed 
   Error: [DUT: d2]: Missing route in RIB, routes: ['20::1/128']
assert "[DUT: d2]: Missing route in RIB, routes: ['20::1/128']" is True

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17679/artifact/TOPO6U18AMD64/ErrorLog/log_topotests.txt

Report for nhrp_peer.c | 10 issues
===============================================
< WARNING: Too many leading tabs - consider code refactoring
< #429: FILE: /tmp/f1-1315/nhrp_peer.c:429:
< WARNING: line over 80 characters
< #1058: FILE: /tmp/f1-1315/nhrp_peer.c:1058:
< WARNING: line over 80 characters
< #1068: FILE: /tmp/f1-1315/nhrp_peer.c:1068:
< WARNING: Too many leading tabs - consider code refactoring
< #1070: FILE: /tmp/f1-1315/nhrp_peer.c:1070:
< WARNING: Block comments use a trailing */ on a separate line
< #1085: FILE: /tmp/f1-1315/nhrp_peer.c:1085:

reubendowle · 2021-03-17T03:28:14Z

Topotests Ubuntu 18.04 amd64 part 6: Failed (click for details)
Successful on other platforms/tests

Is there something wrong with the CI system? This failure seems unrelated to my changes.

NetDEF-CI · 2021-03-23T01:18:11Z

Continuous Integration Result: FAILED

See below for issues.
CI System Testrun URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17898/

This is a comment from an automated CI system.
For questions and feedback in regards to this CI system, please feel free to email
Martin Winter - mwinter (at) opensourcerouting.org.

Get source / Pull Request: Successful

Building Stage: Successful

Basic Tests: Failed

Topotests Ubuntu 18.04 arm8 part 0: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPO0U18ARM8-17898/test

Topology Tests failed for Topotests Ubuntu 18.04 arm8 part 0
see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17898/artifact/TOPO0U18ARM8/ErrorLog/log_topotests.txt

Topotests Ubuntu 16.04 amd64 part 0: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1604-17898/test

Topology Tests failed for Topotests Ubuntu 16.04 amd64 part 0:

54	../sysdeps/unix/sysv/linux/raise.c: No such file or directory.
No function contains program counter for selected frame.
No function contains program counter for selected frame.
No function contains program counter for selected frame.

r1: nhrpd crashed. Core file found - Backtrace follows:
[New LWP 16196]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/nhrpd --log file:nhrpd.log --log-level debug -d'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007fa406053438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
  Id   Target Id         Frame 
* 1    Thread 0x7fa40711b880 (LWP 16196) 0x00007fa406053438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007fa406053438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
        resultvar = 0
        pid = 16196
        selftid = 16196
#1  0x00007fa40605503a in __GI_abort () at abort.c:89
        save_stage = 2
        act = {__sigaction_handler = {sa_handler = 0x0, sa_sigaction = 0x0}, sa_mask = {__val = {0 <repeats 14 times>, 88, 140736301219728}}, sa_flags = -9, sa_restorer = 0x7fffb93dbd30}
        sigs = {__val = {32, 0 <repeats 15 times>}}
#2  0x00007fa4060957fa in __libc_message (do_abort=do_abort@entry=2, fmt=fmt@entry=0x7fa4061aef98 "*** Error in `%s': %s: 0x%s ***\n") at ../sysdeps/posix/libc_fatal.c:175
        ap = <error reading variable ap (Attempt to dereference a generic pointer.)>
        fd = 2
        on_2 = <optimized out>
        list = <optimized out>
        nlist = <optimized out>
        cp = <optimized out>
        written = <optimized out>
#3  0x00007fa40609c6fd in malloc_printerr (ar_ptr=0x7fa4063e2b20 <main_arena>, ptr=<optimized out>, str=0x7fa4061abd52 "corrupted double-linked list", action=<optimized out>) at malloc.c:5020
        buf = "000055ca5238c310"
        cp = <optimized out>
        ar_ptr = 0x7fa4063e2b20 <main_arena>
        ptr = <optimized out>
        str = 0x7fa4061abd52 "corrupted double-linked list"
#4  malloc_consolidate (av=av@entry=0x7fa4063e2b20 <main_arena>) at malloc.c:4190
        fb = 0x7fa4063e2b30 <main_arena+16>
        maxfb = 0x7fa4063e2b70 <main_arena+80>
        p = 0x55ca5238c2e0
        nextp = <optimized out>
        unsorted_bin = 0x7fa4063e2b78 <main_arena+88>
        first_unsorted = <optimized out>
        nextchunk = <optimized out>
        size = 496
        nextsize = <optimized out>
        prevsize = <optimized out>
        nextinuse = <optimized out>
        bck = <optimized out>
        fwd = <optimized out>
#5  0x00007fa40609fd0c in _int_malloc (av=av@entry=0x7fa4063e2b20 <main_arena>, bytes=bytes@entry=1182) at malloc.c:3457
        nb = 1200
        idx = 66
        bin = <optimized out>
        victim = <optimized out>
        size = <optimized out>
        victim_index = <optimized out>
        remainder = <optimized out>
        remainder_size = <optimized out>
        block = <optimized out>
        bit = <optimized out>
        map = <optimized out>
        fwd = <optimized out>
        bck = <optimized out>
        errstr = 0x0
        __func__ = "_int_malloc"
#6  0x00007fa4060a2e3a in __libc_calloc (n=<optimized out>, elem_size=<optimized out>) at malloc.c:3243
        av = 0x7fa4063e2b20 <main_arena>
        oldtop = 0x55ca5238c650
        p = <optimized out>
        bytes = 1182
        sz = 1182
        csz = <optimized out>
        oldtopsize = 133552
        mem = <optimized out>
        clearsize = <optimized out>
        nclears = <optimized out>
        d = <optimized out>
        hook = <optimized out>
        __func__ = "__libc_calloc"
#7  0x00007fa406f9dc26 in _dl_new_object (realname=realname@entry=0x55ca5238ad60 "/lib/x86_64-linux-gnu/libgcc_s.so.1", libname=libname@entry=0x7fa4061aa746 "libgcc_s.so.1", type=type@entry=2, loader=loader@entry=0x0, mode=mode@entry=-1879048191, nsid=nsid@entry=0) at dl-object.c:75
        libname_len = 14
        new = <optimized out>
        newname = <optimized out>
        naudit = 0
        audit_space = 0
        idx = <optimized out>
#8  0x00007fa406f9853d in _dl_map_object_from_fd (name=name@entry=0x7fa4061aa746 "libgcc_s.so.1", origname=origname@entry=0x0, fd=17, fbp=fbp@entry=0x7fffb93dc3a0, realname=0x55ca5238ad60 "/lib/x86_64-linux-gnu/libgcc_s.so.1", loader=loader@entry=0x0, l_type=2, mode=-1879048191, stack_endp=0x7fffb93dc398, nsid=0) at dl-load.c:1028
        l = <optimized out>
        header = 0x7fffb93dc3a8
        phdr = <optimized out>
        ph = <optimized out>
        maplength = <optimized out>
        type = <optimized out>
        errstring = 0x0
        errval = 0
        r = 0x7fa4071b9140 <_r_debug>
        make_consistent = true
        id = {dev = 64768, ino = 521752}
        __PRETTY_FUNCTION__ = "_dl_map_object_from_fd"
        stack_flags = <optimized out>
#9  0x00007fa406f9ac57 in _dl_map_object (loader=0x0, loader@entry=0x7fa4071a99d8, name=name@entry=0x7fa4061aa746 "libgcc_s.so.1", type=type@entry=2, trace_mode=trace_mode@entry=0, mode=mode@entry=-1879048191, nsid=<optimized out>) at dl-load.c:2498
        fd = <optimized out>
        origname = <optimized out>
        realname = 0x55ca5238ad60 "/lib/x86_64-linux-gnu/libgcc_s.so.1"
        name_copy = <optimized out>
        l = <optimized out>
        fb = {len = 832, buf = "\177ELF\002\001\001\000\000\000\000\000\000\000\000\000\003\000>\000\001\000\000\000p*\000\000\000\000\000\000@\000\000\000\000\000\000\000`W\001\000\000\000\000\000\000\000\000\000@\000\070\000\006\000@\000\034\000\033\000\001\000\000\000\005", '\000' <repeats 27 times>, "\214R\001\000\000\000\000\000\214R\001\000\000\000\000\000\000\000 \000\000\000\000\000\001\000\000\000\006\000\000\000\220R\001\000\000\000\000\000\220R!\000\000\000\000\000\220R!\000\000\000\000\000\300\003\000\000\000\000\000\000\200\006\000\000\000\000\000\000\000\000 \000\000\000\000\000\002\000\000\000\006\000\000\000\260R\001\000\000\000\000\000\260R!\000\000\000\000\000"...}
        __PRETTY_FUNCTION__ = "_dl_map_object"
        found_other_class = false
        stack_end = 0x7fffb93dde60
#10 0x00007fa406fa75b7 in dl_open_worker (a=a@entry=0x7fffb93dc960) at dl-open.c:237
        args = 0x7fffb93dc960
        file = 0x7fa4061aa746 "libgcc_s.so.1"
        mode = -2147483647
        call_map = 0x7fa4071a99d8
        dst = <optimized out>
        new = <optimized out>
        __PRETTY_FUNCTION__ = "dl_open_worker"
        r = <optimized out>
        reloc_mode = <optimized out>
        nmaps = <optimized out>
        l = <optimized out>
        maps = <optimized out>
        relocation_in_progress = <optimized out>
        any_tls = <optimized out>
        first_static_tls = <optimized out>
#11 0x00007fa406fa25a4 in _dl_catch_error (objname=objname@entry=0x7fffb93dc950, errstring=errstring@entry=0x7fffb93dc958, mallocedp=mallocedp@entry=0x7fffb93dc94f, operate=operate@entry=0x7fa406fa7510 <dl_open_worker>, args=args@entry=0x7fffb93dc960) at dl-error.c:187
        errcode = 0
        c = {objname = 0x7fffb93dc950, errstring = 0x7fffb93dc958, malloced = 0x7fffb93dc94f, errcode = 0x7fffb93dc82c, env = {{__jmpbuf = {140736301222496, 4252365427672181904, 2147483649, 140342453774150, 140342453287749, 140342470606912, 4252365427605073040, 4302081532634295440}, __mask_was_saved = 0, __saved_mask = {__val = {0 <repeats 16 times>}}}}}
        catchp = 0x7fa40711b870
        old = <optimized out>
#12 0x00007fa406fa6de9 in _dl_open (file=0x7fa4061aa746 "libgcc_s.so.1", mode=-2147483647, caller_dlopen=0x7fa406133b45 <init+21>, nsid=-2, argc=<optimized out>, argv=<optimized out>, env=0x7fffb93ddea0) at dl-open.c:660
        args = {file = 0x7fa4061aa746 "libgcc_s.so.1", mode = -2147483647, caller_dlopen = 0x7fa406133b45 <init+21>, caller_dl_open = 0x7fa40616166d <do_dlopen+61>, map = 0x0, nsid = 0, argc = 6, argv = 0x7fffb93dde68, env = 0x7fffb93ddea0}
        objname = 0x0
        errstring = 0x0
        malloced = false
        errcode = <optimized out>
        __PRETTY_FUNCTION__ = "_dl_open"
#13 0x00007fa40616166d in do_dlopen (ptr=ptr@entry=0x7fffb93dcb80) at dl-libc.c:87
        args = 0x7fffb93dcb80
#14 0x00007fa406fa25a4 in _dl_catch_error (objname=0x7fffb93dcb70, errstring=0x7fffb93dcb78, mallocedp=0x7fffb93dcb6f, operate=0x7fa406161630 <do_dlopen>, args=0x7fffb93dcb80) at dl-error.c:187
        errcode = 0
        c = {objname = 0x7fffb93dcb70, errstring = 0x7fffb93dcb78, malloced = 0x7fffb93dcb6f, errcode = 0x7fffb93dca5c, env = {{__jmpbuf = {0, 4252365427732999312, 140736301222864, 140342452368440, 6, 140736301223024, 4252365427686861968, 4302081532634295440}, __mask_was_saved = 0, __saved_mask = {__val = {0 <repeats 16 times>}}}}}
        catchp = 0x7fa40711b870
        old = <optimized out>
#15 0x00007fa406161724 in dlerror_run (args=0x7fffb93dcb80, operate=0x7fa406161630 <do_dlopen>) at dl-libc.c:46
        objname = 0x0
        last_errstring = 0x0
        malloced = false
        result = <optimized out>
#16 __GI___libc_dlopen_mode (name=name@entry=0x7fa4061aa746 "libgcc_s.so.1", mode=mode@entry=-2147483647) at dl-libc.c:163
        args = {name = 0x7fa4061aa746 "libgcc_s.so.1", mode = -2147483647, caller_dlopen = 0x7fa406133b45 <init+21>, map = 0x0}
#17 0x00007fa406133b45 in init () at ../sysdeps/x86_64/backtrace.c:52
No locals.
#18 0x00007fa4063f6a99 in __pthread_once_slow (once_control=0x7fa4063e6110 <once>, init_routine=0x7fa406133b30 <init>) at pthread_once.c:116
        _buffer = {__routine = 0x7fa4063f6ae0 <clear_once_control>, __arg = 0x7fa4063e6110 <once>, __canceltype = 0, __prev = 0x0}
        val = 0
        newval = <optimized out>
#19 0x00007fa406133c64 in __GI___backtrace (array=<optimized out>, size=<optimized out>) at ../sysdeps/x86_64/backtrace.c:105
        __p = <optimized out>
        arg = {array = 0x7fffb93dcc70, cfa = 0, cnt = -1, size = 64}
        once = 5
#20 0x00007fa406c9b0e7 in zlog_backtrace_sigsafe () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#21 0x00007fa406c9b2dd in zlog_signal () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#22 0x00007fa406cc2635 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#23 <signal handler called>
No locals.
#24 0x00007fa406053438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
        resultvar = 0
        pid = 16196
        selftid = 16196
#25 0x00007fa40605503a in __GI_abort () at abort.c:89
        save_stage = 2
        act = {__sigaction_handler = {sa_handler = 0x4, sa_sigaction = 0x4}, sa_mask = {__val = {39, 3107837712, 140736301225600, 17179869224, 140342470586368, 140342465678692, 83, 140342465678824, 94327451203328, 94327451202752, 140342452692364, 140342453789456, 140342453803104, 140736301225968, 140342453789456, 140342465678692}}, sa_flags = 119222272, sa_restorer = 0x7fa406d04d64}
        sigs = {__val = {32, 0 <repeats 15 times>}}
#26 0x00007fa40604bbe7 in __assert_fail_base (fmt=<optimized out>, assertion=assertion@entry=0x7fa406d04d64 "mt->n_alloc", file=file@entry=0x7fa406d04d57 "lib/memory.c", line=line@entry=83, function=function@entry=0x7fa406d04de8 "mt_count_free") at assert.c:92
        str = 0x55ca52263980 "\020O8R\312U"
        total = 4096
#27 0x00007fa40604bc92 in __GI___assert_fail (assertion=0x7fa406d04d64 "mt->n_alloc", file=0x7fa406d04d57 "lib/memory.c", line=83, function=0x7fa406d04de8 "mt_count_free") at assert.c:101
No locals.
#28 0x00007fa406c6a059 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#29 0x00007fa406c9ec32 in qfree () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#30 0x000055ca507d7826 in ?? ()
No symbol table info available.
#31 0x000055ca507d1fbc in ?? ()
No symbol table info available.
#32 0x00007fa406c8caca in hash_iterate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#33 0x000055ca507d27c0 in nhrp_cache_interface_del ()
No symbol table info available.
#34 0x000055ca507d3ee2 in ?? ()
No symbol table info available.
#35 0x00007fa406c8e565 in if_delete_retain () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#36 0x00007fa406c907b5 in if_delete () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#37 0x00007fa406c90985 in if_terminate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#38 0x00007fa406cd4c75 in vrf_delete () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#39 0x00007fa406cd4fbb in vrf_terminate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#40 0x000055ca507d52e5 in ?? ()
No symbol table info available.
#41 0x00007fa406cc29e3 in quagga_sigevent_process () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#42 0x00007fa406cd1e55 in thread_fetch () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#43 0x00007fa406c96de3 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#44 0x000055ca507d008a in main ()
No symbol table info available.
Dump of assembler code for function __GI___assert_fail:
   0x00007fa40604bc50 <+0>:	push   %r13
   0x00007fa40604bc52 <+2>:	push   %r12
   0x00007fa40604bc54 <+4>:	mov    %rcx,%r13
   0x00007fa40604bc57 <+7>:	push   %rbp
   0x00007fa40604bc58 <+8>:	push   %rbx
   0x00007fa40604bc59 <+9>:	mov    %rsi,%rbp
   0x00007fa40604bc5c <+12>:	mov    %rdi,%rbx
   0x00007fa40604bc5f <+15>:	lea    0x1626aa(%rip),%rsi        # 0x7fa4061ae310
   0x00007fa40604bc66 <+22>:	lea    0x15f013(%rip),%rdi        # 0x7fa4061aac80 <_libc_intl_domainname>
   0x00007fa40604bc6d <+29>:	mov    %edx,%r12d
   0x00007fa40604bc70 <+32>:	sub    $0x8,%rsp
   0x00007fa40604bc74 <+36>:	mov    $0x5,%edx
   0x00007fa40604bc79 <+41>:	callq  0x7fa40604c630 <__GI___dcgettext>
   0x00007fa40604bc7e <+46>:	mov    %r13,%r8
   0x00007fa40604bc81 <+49>:	mov    %r12d,%ecx
   0x00007fa40604bc84 <+52>:	mov    %rbp,%rdx
   0x00007fa40604bc87 <+55>:	mov    %rbx,%rsi
   0x00007fa40604bc8a <+58>:	mov    %rax,%rdi
   0x00007fa40604bc8d <+61>:	callq  0x7fa40604bad0 <__assert_fail_base>
End of assembler dump.
#28 0x00007fa406c6a059 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#29 0x00007fa406c9ec32 in qfree () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function qfree:
   0x00007fa406c9ebf0 <+0>:	push   %rbp
   0x00007fa406c9ebf1 <+1>:	test   %rsi,%rsi
   0x00007fa406c9ebf4 <+4>:	mov    %rsp,%rbp
   0x00007fa406c9ebf7 <+7>:	push   %r12
   0x00007fa406c9ebf9 <+9>:	mov    %rsi,%r12
   0x00007fa406c9ebfc <+12>:	push   %rbx
   0x00007fa406c9ebfd <+13>:	je     0x7fa406c9ec21 <qfree+49>
   0x00007fa406c9ebff <+15>:	mov    0x18(%rdi),%rdx
   0x00007fa406c9ec03 <+19>:	mov    %rdi,%rbx
   0x00007fa406c9ec06 <+22>:	lea    0x18(%rdi),%rax
   0x00007fa406c9ec0a <+26>:	test   %rdx,%rdx
   0x00007fa406c9ec0d <+29>:	je     0x7fa406c9ec2d <qfree+61>
   0x00007fa406c9ec0f <+31>:	lock subq $0x1,(%rax)
   0x00007fa406c9ec14 <+36>:	mov    %rsi,%rdi
   0x00007fa406c9ec17 <+39>:	callq  0x7fa406c69800
   0x00007fa406c9ec1c <+44>:	lock sub %rax,0x30(%rbx)
   0x00007fa406c9ec21 <+49>:	pop    %rbx
   0x00007fa406c9ec22 <+50>:	mov    %r12,%rdi
   0x00007fa406c9ec25 <+53>:	pop    %r12
   0x00007fa406c9ec27 <+55>:	pop    %rbp
   0x00007fa406c9ec28 <+56>:	jmpq   0x7fa406c694f8
   0x00007fa406c9ec2d <+61>:	callq  0x7fa406c6a036
End of assembler dump.
#30 0x000055ca507d7826 in ?? ()
#31 0x000055ca507d1fbc in ?? ()
#32 0x00007fa406c8caca in hash_iterate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function hash_iterate:
   0x00007fa406c8ca80 <+0>:	mov    0x8(%rdi),%eax
   0x00007fa406c8ca83 <+3>:	test   %eax,%eax
   0x00007fa406c8ca85 <+5>:	je     0x7fa406c8caea <hash_iterate+106>
   0x00007fa406c8ca87 <+7>:	push   %rbp
   0x00007fa406c8ca88 <+8>:	mov    %rsp,%rbp
   0x00007fa406c8ca8b <+11>:	push   %r15
   0x00007fa406c8ca8d <+13>:	push   %r14
   0x00007fa406c8ca8f <+15>:	push   %r13
   0x00007fa406c8ca91 <+17>:	push   %r12
   0x00007fa406c8ca93 <+19>:	mov    %rdi,%r15
   0x00007fa406c8ca96 <+22>:	push   %rbx
   0x00007fa406c8ca97 <+23>:	mov    %rsi,%r13
   0x00007fa406c8ca9a <+26>:	mov    %rdx,%r12
   0x00007fa406c8ca9d <+29>:	xor    %r14d,%r14d
   0x00007fa406c8caa0 <+32>:	sub    $0x8,%rsp
   0x00007fa406c8caa4 <+36>:	nopl   0x0(%rax)
   0x00007fa406c8caa8 <+40>:	mov    (%r15),%rdx
   0x00007fa406c8caab <+43>:	mov    %r14d,%eax
   0x00007fa406c8caae <+46>:	mov    (%rdx,%rax,8),%rdi
   0x00007fa406c8cab2 <+50>:	test   %rdi,%rdi
   0x00007fa406c8cab5 <+53>:	je     0x7fa406c8cad2 <hash_iterate+82>
   0x00007fa406c8cab7 <+55>:	nopw   0x0(%rax,%rax,1)
   0x00007fa406c8cac0 <+64>:	mov    0x8(%rdi),%rbx
   0x00007fa406c8cac4 <+68>:	mov    %r12,%rsi
   0x00007fa406c8cac7 <+71>:	callq  *%r13
=> 0x00007fa406c8caca <+74>:	test   %rbx,%rbx
   0x00007fa406c8cacd <+77>:	mov    %rbx,%rdi
   0x00007fa406c8cad0 <+80>:	jne    0x7fa406c8cac0 <hash_iterate+64>
   0x00007fa406c8cad2 <+82>:	add    $0x1,%r14d
   0x00007fa406c8cad6 <+86>:	cmp    %r14d,0x8(%r15)
   0x00007fa406c8cada <+90>:	ja     0x7fa406c8caa8 <hash_iterate+40>
   0x00007fa406c8cadc <+92>:	add    $0x8,%rsp
   0x00007fa406c8cae0 <+96>:	pop    %rbx
   0x00007fa406c8cae1 <+97>:	pop    %r12
   0x00007fa406c8cae3 <+99>:	pop    %r13
   0x00007fa406c8cae5 <+101>:	pop    %r14
   0x00007fa406c8cae7 <+103>:	pop    %r15
   0x00007fa406c8cae9 <+105>:	pop    %rbp
   0x00007fa406c8caea <+106>:	repz retq 
End of assembler dump.
54	../sysdeps/unix/sysv/linux/raise.c: No such file or directory.
No function contains program counter for selected frame.
No function contains program counter for selected frame.
No function contains program counter for selected frame.

r2: nhrpd crashed. Core file found - Backtrace follows:
[New LWP 16266]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/nhrpd --log file:nhrpd.log --log-level debug -d'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007fd264731438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
  Id   Target Id         Frame 
* 1    Thread 0x7fd2657f9880 (LWP 16266) 0x00007fd264731438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007fd264731438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
        resultvar = 0
        pid = 16266
        selftid = 16266
#1  0x00007fd26473303a in __GI_abort () at abort.c:89
        save_stage = 2
        act = {__sigaction_handler = {sa_handler = 0x0, sa_sigaction = 0x0}, sa_mask = {__val = {0 <repeats 14 times>, 88, 140725579391568}}, sa_flags = -9, sa_restorer = 0x7ffd3a2b9ff0}
        sigs = {__val = {32, 0 <repeats 15 times>}}
#2  0x00007fd2647737fa in __libc_message (do_abort=2, fmt=fmt@entry=0x7fd26488cf98 "*** Error in `%s': %s: 0x%s ***\n") at ../sysdeps/posix/libc_fatal.c:175
        ap = <error reading variable ap (Attempt to dereference a generic pointer.)>
        fd = 2
        on_2 = <optimized out>
        list = <optimized out>
        nlist = <optimized out>
        cp = <optimized out>
        written = <optimized out>
#3  0x00007fd26477a7d3 in malloc_printerr (ar_ptr=0x7fd264ac0b20 <main_arena>, ptr=0x55a5eded54d0, str=0x7fd264889d52 "corrupted double-linked list", action=<optimized out>) at malloc.c:5020
        buf = "000055a5eded54d0"
        cp = <optimized out>
        ar_ptr = 0x7fd264ac0b20 <main_arena>
        ptr = 0x55a5eded54d0
        str = 0x7fd264889d52 "corrupted double-linked list"
        action = <optimized out>
#4  malloc_consolidate (av=av@entry=0x7fd264ac0b20 <main_arena>) at malloc.c:4182
        fb = 0x7fd264ac0b38 <main_arena+24>
        maxfb = 0x7fd264ac0b70 <main_arena+80>
        p = 0x55a5eded54d0
        nextp = <optimized out>
        unsorted_bin = 0x7fd264ac0b78 <main_arena+88>
        first_unsorted = <optimized out>
        nextchunk = 0x55a5eded5540
        size = 112
        nextsize = 48
        prevsize = <optimized out>
        nextinuse = <optimized out>
        bck = <optimized out>
        fwd = <optimized out>
#5  0x00007fd26477dd0c in _int_malloc (av=av@entry=0x7fd264ac0b20 <main_arena>, bytes=bytes@entry=1182) at malloc.c:3457
        nb = 1200
        idx = 66
        bin = <optimized out>
        victim = <optimized out>
        size = <optimized out>
        victim_index = <optimized out>
        remainder = <optimized out>
        remainder_size = <optimized out>
        block = <optimized out>
        bit = <optimized out>
        map = <optimized out>
        fwd = <optimized out>
        bck = <optimized out>
        errstr = 0x0
        __func__ = "_int_malloc"
#6  0x00007fd264780e3a in __libc_calloc (n=<optimized out>, elem_size=<optimized out>) at malloc.c:3243
        av = 0x7fd264ac0b20 <main_arena>
        oldtop = 0x55a5edee2580
        p = <optimized out>
        bytes = 1182
        sz = 1182
        csz = <optimized out>
        oldtopsize = 133760
        mem = <optimized out>
        clearsize = <optimized out>
        nclears = <optimized out>
        d = <optimized out>
        hook = <optimized out>
        __func__ = "__libc_calloc"
#7  0x00007fd26567bc26 in _dl_new_object (realname=realname@entry=0x55a5eded99b0 "/lib/x86_64-linux-gnu/libgcc_s.so.1", libname=libname@entry=0x7fd264888746 "libgcc_s.so.1", type=type@entry=2, loader=loader@entry=0x0, mode=mode@entry=-1879048191, nsid=nsid@entry=0) at dl-object.c:75
        libname_len = 14
        new = <optimized out>
        newname = <optimized out>
        naudit = 0
        audit_space = 0
        idx = <optimized out>
#8  0x00007fd26567653d in _dl_map_object_from_fd (name=name@entry=0x7fd264888746 "libgcc_s.so.1", origname=origname@entry=0x0, fd=17, fbp=fbp@entry=0x7ffd3a2ba660, realname=0x55a5eded99b0 "/lib/x86_64-linux-gnu/libgcc_s.so.1", loader=loader@entry=0x0, l_type=2, mode=-1879048191, stack_endp=0x7ffd3a2ba658, nsid=0) at dl-load.c:1028
        l = <optimized out>
        header = 0x7ffd3a2ba668
        phdr = <optimized out>
        ph = <optimized out>
        maplength = <optimized out>
        type = <optimized out>
        errstring = 0x0
        errval = 0
        r = 0x7fd265897140 <_r_debug>
        make_consistent = true
        id = {dev = 64768, ino = 521752}
        __PRETTY_FUNCTION__ = "_dl_map_object_from_fd"
        stack_flags = <optimized out>
#9  0x00007fd265678c57 in _dl_map_object (loader=0x0, loader@entry=0x7fd2658879d8, name=name@entry=0x7fd264888746 "libgcc_s.so.1", type=type@entry=2, trace_mode=trace_mode@entry=0, mode=mode@entry=-1879048191, nsid=<optimized out>) at dl-load.c:2498
        fd = <optimized out>
        origname = <optimized out>
        realname = 0x55a5eded99b0 "/lib/x86_64-linux-gnu/libgcc_s.so.1"
        name_copy = <optimized out>
        l = <optimized out>
        fb = {len = 832, buf = "\177ELF\002\001\001\000\000\000\000\000\000\000\000\000\003\000>\000\001\000\000\000p*\000\000\000\000\000\000@\000\000\000\000\000\000\000`W\001\000\000\000\000\000\000\000\000\000@\000\070\000\006\000@\000\034\000\033\000\001\000\000\000\005", '\000' <repeats 27 times>, "\214R\001\000\000\000\000\000\214R\001\000\000\000\000\000\000\000 \000\000\000\000\000\001\000\000\000\006\000\000\000\220R\001\000\000\000\000\000\220R!\000\000\000\000\000\220R!\000\000\000\000\000\300\003\000\000\000\000\000\000\200\006\000\000\000\000\000\000\000\000 \000\000\000\000\000\002\000\000\000\006\000\000\000\260R\001\000\000\000\000\000\260R!\000\000\000\000\000"...}
        __PRETTY_FUNCTION__ = "_dl_map_object"
        found_other_class = false
        stack_end = 0x7ffd3a2bc130
#10 0x00007fd2656855b7 in dl_open_worker (a=a@entry=0x7ffd3a2bac20) at dl-open.c:237
        args = 0x7ffd3a2bac20
        file = 0x7fd264888746 "libgcc_s.so.1"
        mode = -2147483647
        call_map = 0x7fd2658879d8
        dst = <optimized out>
        new = <optimized out>
        __PRETTY_FUNCTION__ = "dl_open_worker"
        r = <optimized out>
        reloc_mode = <optimized out>
        nmaps = <optimized out>
        l = <optimized out>
        maps = <optimized out>
        relocation_in_progress = <optimized out>
        any_tls = <optimized out>
        first_static_tls = <optimized out>
#11 0x00007fd2656805a4 in _dl_catch_error (objname=objname@entry=0x7ffd3a2bac10, errstring=errstring@entry=0x7ffd3a2bac18, mallocedp=mallocedp@entry=0x7ffd3a2bac0f, operate=operate@entry=0x7fd265685510 <dl_open_worker>, args=args@entry=0x7ffd3a2bac20) at dl-error.c:187
        errcode = 0
        c = {objname = 0x7ffd3a2bac10, errstring = 0x7ffd3a2bac18, malloced = 0x7ffd3a2bac0f, errcode = 0x7ffd3a2baaec, env = {{__jmpbuf = {140725579394336, 8192687188270409238, 2147483649, 140541606528838, 140541606042437, 140541623361600, 8192687188069082646, 8209212267441579542}, __mask_was_saved = 0, __saved_mask = {__val = {0 <repeats 16 times>}}}}}
        catchp = 0x7fd2657f9870
        old = <optimized out>
#12 0x00007fd265684de9 in _dl_open (file=0x7fd264888746 "libgcc_s.so.1", mode=-2147483647, caller_dlopen=0x7fd264811b45 <init+21>, nsid=-2, argc=<optimized out>, argv=<optimized out>, env=0x7ffd3a2bc170) at dl-open.c:660
        args = {file = 0x7fd264888746 "libgcc_s.so.1", mode = -2147483647, caller_dlopen = 0x7fd264811b45 <init+21>, caller_dl_open = 0x7fd26483f66d <do_dlopen+61>, map = 0x0, nsid = 0, argc = 6, argv = 0x7ffd3a2bc138, env = 0x7ffd3a2bc170}
        objname = 0x0
        errstring = 0x0
        malloced = false
        errcode = <optimized out>
        __PRETTY_FUNCTION__ = "_dl_open"
#13 0x00007fd26483f66d in do_dlopen (ptr=ptr@entry=0x7ffd3a2bae40) at dl-libc.c:87
        args = 0x7ffd3a2bae40
#14 0x00007fd2656805a4 in _dl_catch_error (objname=0x7ffd3a2bae30, errstring=0x7ffd3a2bae38, mallocedp=0x7ffd3a2bae2f, operate=0x7fd26483f630 <do_dlopen>, args=0x7ffd3a2bae40) at dl-error.c:187
        errcode = 0
        c = {objname = 0x7ffd3a2bae30, errstring = 0x7ffd3a2bae38, malloced = 0x7ffd3a2bae2f, errcode = 0x7ffd3a2bad1c, env = {{__jmpbuf = {0, 8192687188213786134, 140725579394704, 140541605123128, 6, 140725579394864, 8192687188259923478, 8209212267441579542}, __mask_was_saved = 0, __saved_mask = {__val = {0 <repeats 16 times>}}}}}
        catchp = 0x7fd2657f9870
        old = <optimized out>
#15 0x00007fd26483f724 in dlerror_run (args=0x7ffd3a2bae40, operate=0x7fd26483f630 <do_dlopen>) at dl-libc.c:46
        objname = 0x0
        last_errstring = 0x0
        malloced = false
        result = <optimized out>
#16 __GI___libc_dlopen_mode (name=name@entry=0x7fd264888746 "libgcc_s.so.1", mode=mode@entry=-2147483647) at dl-libc.c:163
        args = {name = 0x7fd264888746 "libgcc_s.so.1", mode = -2147483647, caller_dlopen = 0x7fd264811b45 <init+21>, map = 0x0}
#17 0x00007fd264811b45 in init () at ../sysdeps/x86_64/backtrace.c:52
No locals.
#18 0x00007fd264ad4a99 in __pthread_once_slow (once_control=0x7fd264ac4110 <once>, init_routine=0x7fd264811b30 <init>) at pthread_once.c:116
        _buffer = {__routine = 0x7fd264ad4ae0 <clear_once_control>, __arg = 0x7fd264ac4110 <once>, __canceltype = 0, __prev = 0x0}
        val = 0
        newval = <optimized out>
#19 0x00007fd264811c64 in __GI___backtrace (array=<optimized out>, size=<optimized out>) at ../sysdeps/x86_64/backtrace.c:105
        __p = <optimized out>
        arg = {array = 0x7ffd3a2baf30, cfa = 0, cnt = -1, size = 64}
        once = 5
#20 0x00007fd2653790e7 in zlog_backtrace_sigsafe () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#21 0x00007fd2653792dd in zlog_signal () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#22 0x00007fd2653a0635 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#23 <signal handler called>
No locals.
#24 0x00007fd264731438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
        resultvar = 0
        pid = 16266
        selftid = 16266
#25 0x00007fd26473303a in __GI_abort () at abort.c:89
        save_stage = 2
        act = {__sigaction_handler = {sa_handler = 0x4, sa_sigaction = 0x4}, sa_mask = {__val = {40, 975944160, 140725579397456, 17179869225, 140541623341056, 140541618433380, 83, 140541618433512, 94171149768544, 94171148210656, 140541605447052, 140541606544144, 140541606557792, 140725579397824, 140541606544144, 140541618433380}}, sa_flags = 1703481344, sa_restorer = 0x7fd2653e2d64}
        sigs = {__val = {32, 0 <repeats 15 times>}}
#26 0x00007fd264729be7 in __assert_fail_base (fmt=<optimized out>, assertion=assertion@entry=0x7fd2653e2d64 "mt->n_alloc", file=file@entry=0x7fd2653e2d57 "lib/memory.c", line=line@entry=83, function=function@entry=0x7fd2653e2de8 "mt_count_free") at assert.c:92
        str = 0x55a5eddb9980 ""
        total = 4096
#27 0x00007fd264729c92 in __GI___assert_fail (assertion=0x7fd2653e2d64 "mt->n_alloc", file=0x7fd2653e2d57 "lib/memory.c", line=83, function=0x7fd2653e2de8 "mt_count_free") at assert.c:101
No locals.
#28 0x00007fd265348059 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#29 0x00007fd26537cc32 in qfree () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#30 0x000055a5ebba4826 in ?? ()
No symbol table info available.
#31 0x000055a5ebb9efbc in ?? ()
No symbol table info available.
#32 0x00007fd26536aaca in hash_iterate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#33 0x000055a5ebb9f7c0 in nhrp_cache_interface_del ()
No symbol table info available.
#34 0x000055a5ebba0ee2 in ?? ()
No symbol table info available.
#35 0x00007fd26536c565 in if_delete_retain () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#36 0x00007fd26536e7b5 in if_delete () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#37 0x00007fd26536e985 in if_terminate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#38 0x00007fd2653b2c75 in vrf_delete () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#39 0x00007fd2653b2fbb in vrf_terminate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#40 0x000055a5ebba22e5 in ?? ()
No symbol table info available.
#41 0x00007fd2653a09e3 in quagga_sigevent_process () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#42 0x00007fd2653afe55 in thread_fetch () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#43 0x00007fd265374de3 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#44 0x000055a5ebb9d08a in main ()
No symbol table info available.
Dump of assembler code for function __GI___assert_fail:
   0x00007fd264729c50 <+0>:	push   %r13
   0x00007fd264729c52 <+2>:	push   %r12
   0x00007fd264729c54 <+4>:	mov    %rcx,%r13
   0x00007fd264729c57 <+7>:	push   %rbp
   0x00007fd264729c58 <+8>:	push   %rbx
   0x00007fd264729c59 <+9>:	mov    %rsi,%rbp
   0x00007fd264729c5c <+12>:	mov    %rdi,%rbx
   0x00007fd264729c5f <+15>:	lea    0x1626aa(%rip),%rsi        # 0x7fd26488c310
   0x00007fd264729c66 <+22>:	lea    0x15f013(%rip),%rdi        # 0x7fd264888c80 <_libc_intl_domainname>
   0x00007fd264729c6d <+29>:	mov    %edx,%r12d
   0x00007fd264729c70 <+32>:	sub    $0x8,%rsp
   0x00007fd264729c74 <+36>:	mov    $0x5,%edx
   0x00007fd264729c79 <+41>:	callq  0x7fd26472a630 <__GI___dcgettext>
   0x00007fd264729c7e <+46>:	mov    %r13,%r8
   0x00007fd264729c81 <+49>:	mov    %r12d,%ecx
   0x00007fd264729c84 <+52>:	mov    %rbp,%rdx
   0x00007fd264729c87 <+55>:	mov    %rbx,%rsi
   0x00007fd264729c8a <+58>:	mov    %rax,%rdi
   0x00007fd264729c8d <+61>:	callq  0x7fd264729ad0 <__assert_fail_base>
End of assembler dump.
#28 0x00007fd265348059 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#29 0x00007fd26537cc32 in qfree () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function qfree:
   0x00007fd26537cbf0 <+0>:	push   %rbp
   0x00007fd26537cbf1 <+1>:	test   %rsi,%rsi
   0x00007fd26537cbf4 <+4>:	mov    %rsp,%rbp
   0x00007fd26537cbf7 <+7>:	push   %r12
   0x00007fd26537cbf9 <+9>:	mov    %rsi,%r12
   0x00007fd26537cbfc <+12>:	push   %rbx
   0x00007fd26537cbfd <+13>:	je     0x7fd26537cc21 <qfree+49>
   0x00007fd26537cbff <+15>:	mov    0x18(%rdi),%rdx
   0x00007fd26537cc03 <+19>:	mov    %rdi,%rbx
   0x00007fd26537cc06 <+22>:	lea    0x18(%rdi),%rax
   0x00007fd26537cc0a <+26>:	test   %rdx,%rdx
   0x00007fd26537cc0d <+29>:	je     0x7fd26537cc2d <qfree+61>
   0x00007fd26537cc0f <+31>:	lock subq $0x1,(%rax)
   0x00007fd26537cc14 <+36>:	mov    %rsi,%rdi
   0x00007fd26537cc17 <+39>:	callq  0x7fd265347800
   0x00007fd26537cc1c <+44>:	lock sub %rax,0x30(%rbx)
   0x00007fd26537cc21 <+49>:	pop    %rbx
   0x00007fd26537cc22 <+50>:	mov    %r12,%rdi
   0x00007fd26537cc25 <+53>:	pop    %r12
   0x00007fd26537cc27 <+55>:	pop    %rbp
   0x00007fd26537cc28 <+56>:	jmpq   0x7fd2653474f8
   0x00007fd26537cc2d <+61>:	callq  0x7fd265348036
End of assembler dump.
#30 0x000055a5ebba4826 in ?? ()
#31 0x000055a5ebb9efbc in ?? ()
#32 0x00007fd26536aaca in hash_iterate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function hash_iterate:
   0x00007fd26536aa80 <+0>:	mov    0x8(%rdi),%eax
   0x00007fd26536aa83 <+3>:	test   %eax,%eax
   0x00007fd26536aa85 <+5>:	je     0x7fd26536aaea <hash_iterate+106>
   0x00007fd26536aa87 <+7>:	push   %rbp
   0x00007fd26536aa88 <+8>:	mov    %rsp,%rbp
   0x00007fd26536aa8b <+11>:	push   %r15
   0x00007fd26536aa8d <+13>:	push   %r14
   0x00007fd26536aa8f <+15>:	push   %r13
   0x00007fd26536aa91 <+17>:	push   %r12
   0x00007fd26536aa93 <+19>:	mov    %rdi,%r15
   0x00007fd26536aa96 <+22>:	push   %rbx
   0x00007fd26536aa97 <+23>:	mov    %rsi,%r13
   0x00007fd26536aa9a <+26>:	mov    %rdx,%r12
   0x00007fd26536aa9d <+29>:	xor    %r14d,%r14d
   0x00007fd26536aaa0 <+32>:	sub    $0x8,%rsp
   0x00007fd26536aaa4 <+36>:	nopl   0x0(%rax)
   0x00007fd26536aaa8 <+40>:	mov    (%r15),%rdx
   0x00007fd26536aaab <+43>:	mov    %r14d,%eax
   0x00007fd26536aaae <+46>:	mov    (%rdx,%rax,8),%rdi
   0x00007fd26536aab2 <+50>:	test   %rdi,%rdi
   0x00007fd26536aab5 <+53>:	je     0x7fd26536aad2 <hash_iterate+82>
   0x00007fd26536aab7 <+55>:	nopw   0x0(%rax,%rax,1)
   0x00007fd26536aac0 <+64>:	mov    0x8(%rdi),%rbx
   0x00007fd26536aac4 <+68>:	mov    %r12,%rsi
   0x00007fd26536aac7 <+71>:	callq  *%r13
=> 0x00007fd26536aaca <+74>:	test   %rbx,%rbx
   0x00007fd26536aacd <+77>:	mov    %rbx,%rdi
   0x00007fd26536aad0 <+80>:	jne    0x7fd26536aac0 <hash_iterate+64>
   0x00007fd26536aad2 <+82>:	add    $0x1,%r14d
   0x00007fd26536aad6 <+86>:	cmp    %r14d,0x8(%r15)
   0x00007fd26536aada <+90>:	ja     0x7fd26536aaa8 <hash_iterate+40>
   0x00007fd26536aadc <+92>:	add    $0x8,%rsp
   0x00007fd26536aae0 <+96>:	pop    %rbx
   0x00007fd26536aae1 <+97>:	pop    %r12
   0x00007fd26536aae3 <+99>:	pop    %r13
   0x00007fd26536aae5 <+101>:	pop    %r14
   0x00007fd26536aae7 <+103>:	pop    %r15
   0x00007fd26536aae9 <+105>:	pop    %rbp
   0x00007fd26536aaea <+106>:	repz retq 
End of assembler dump.

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17898/artifact/TOPOU1604/ErrorLog/log_topotests.txt

Addresssanitizer topotests part 0: Failed (click for details)

Addresssanitizer topotests part 0: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17898/artifact/ASAN3/AddressSanitizerError/AddressSanitzer.txt Addresssanitizer topotests part 0: No useful log found

Topotests Ubuntu 18.04 amd64 part 0: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1804-17898/test

Topology Tests failed for Topotests Ubuntu 18.04 amd64 part 0
see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17898/artifact/TOPOU1804/ErrorLog/log_topotests.txt

Topotests Ubuntu 16.04 i386 part 0: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOI386-17898/test

Topology Tests failed for Topotests Ubuntu 16.04 i386 part 0:

No function contains program counter for selected frame.
No function contains program counter for selected frame.
No function contains program counter for selected frame.

r1: nhrpd crashed. Core file found - Backtrace follows:
[New LWP 12695]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/nhrpd --log file:nhrpd.log --log-level debug -d'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f80cf5 in ?? ()
  Id   Target Id         Frame 
* 1    Thread 0xb78477c0 (LWP 12695) 0xb7f80cf5 in ?? ()
#0  0xb7f80cf5 in ?? ()
No symbol table info available.
#1  0xb7cac307 in malloc_printerr (action=<optimized out>, str=0xb7d9ba26 "corrupted double-linked list", ptr=<optimized out>, ar_ptr=0xb7df2780 <main_arena>) at malloc.c:5020
        buf = "016fadf8"
        cp = <optimized out>
        ar_ptr = 0xb7df2780 <main_arena>
        ptr = <optimized out>
        str = 0xb7d9ba26 "corrupted double-linked list"
        action = <optimized out>
#2  0xb7cac6b4 in malloc_consolidate (av=av@entry=0xb7df2780 <main_arena>) at malloc.c:4190
        fb = 0xb7df2790 <main_arena+16>
        maxfb = 0xb7df27ac <main_arena+44>
        p = 0x16fadd8
        nextp = 0x16fadb8
        unsorted_bin = 0xb7df27b0 <main_arena+48>
        first_unsorted = <optimized out>
        nextchunk = 0x16fadf8
        size = 384
        nextsize = <optimized out>
        prevsize = <optimized out>
        nextinuse = <optimized out>
        bck = <optimized out>
        fwd = 0x16fbcc8
#3  0xb7cae1e3 in _int_malloc (av=av@entry=0xb7df2780 <main_arena>, bytes=bytes@entry=1910) at malloc.c:3457
        nb = 1920
        idx = <optimized out>
        bin = <optimized out>
        victim = <optimized out>
        size = <optimized out>
        victim_index = <optimized out>
        remainder = <optimized out>
        remainder_size = <optimized out>
        block = <optimized out>
        bit = <optimized out>
        map = <optimized out>
        fwd = <optimized out>
        bck = <optimized out>
        errstr = 0x0
        __func__ = "_int_malloc"
#4  0xb7cb0085 in __GI___libc_malloc (bytes=1910) at malloc.c:2920
        ar_ptr = 0xb7df2780 <main_arena>
        victim = <optimized out>
        hook = <optimized out>
        __func__ = "__libc_malloc"
#5  0xb7d33904 in __backtrace_symbols (array=0xbf8a58fc, size=29) at backtracesyms.c:69
        info = {{dli_fname = 0xb7f7c250 "/usr/lib/i386-linux-gnu/frr/libfrr.so.0", dli_fbase = 0xb7e38000, dli_sname = 0xb7e457b6 "zlog_backtrace_sigsafe", dli_saddr = 0xb7e90960 <zlog_backtrace_sigsafe>}, {dli_fname = 0xb7f7c250 "/usr/lib/i386-linux-gnu/frr/libfrr.so.0", dli_fbase = 0xb7e38000, dli_sname = 0xb7e457ec "zlog_signal", dli_saddr = 0xb7e90af0 <zlog_signal>}, {dli_fname = 0xb7f7c250 "/usr/lib/i386-linux-gnu/frr/libfrr.so.0", dli_fbase = 0xb7e38000, dli_sname = 0x0, dli_saddr = 0x0}, {dli_fname = 0xb7fa6e74 "", dli_fbase = 0xb7f80000, dli_sname = 0xb7f8021b "__kernel_rt_sigreturn", dli_saddr = 0xb7f80d0c}, {dli_fname = 0xb7fa6e74 "", dli_fbase = 0xb7f80000, dli_sname = 0xb7f801d6 "__kernel_vsyscall", dli_saddr = 0xb7f80cec}, {dli_fname = 0xb7e132a8 "/lib/i386-linux-gnu/libc.so.6", dli_fbase = 0xb7c3f000, dli_sname = 0xb7c4f61e "gsignal", dli_saddr = 0xb7c6ae80 <__GI_raise>}, {dli_fname = 0xb7e132a8 "/lib/i386-linux-gnu/libc.so.6", dli_fbase = 0xb7c3f000, dli_sname = 0xb7c4c95d "abort", dli_saddr = 0xb7c6c2c0 <__GI_abort>}, {dli_fname = 0xb7e132a8 "/lib/i386-linux-gnu/libc.so.6", dli_fbase = 0xb7c3f000, dli_sname = 0x0, dli_saddr = 0x0}, {dli_fname = 0xb7e132a8 "/lib/i386-linux-gnu/libc.so.6", dli_fbase = 0xb7c3f000, dli_sname = 0x0, dli_saddr = 0x0}, {dli_fname = 0xb7f7c250 "/usr/lib/i386-linux-gnu/frr/libfrr.so.0", dli_fbase = 0xb7e38000, dli_sname = 0x0, dli_saddr = 0x0}, {dli_fname = 0xb7f7c250 "/usr/lib/i386-linux-gnu/frr/libfrr.so.0", dli_fbase = 0xb7e38000, dli_sname = 0x0, dli_saddr = 0x0}, {dli_fname = 0xbf8a72c1 "/usr/lib/frr/nhrpd", dli_fbase = 0x404000, dli_sname = 0x0, dli_saddr = 0x0}, {dli_fname = 0xbf8a72c1 "/usr/lib/frr/nhrpd", dli_fbase = 0x404000, dli_sname = 0x0, dli_saddr = 0x0}, {dli_fname = 0xbf8a72c1 "/usr/lib/frr/nhrpd", dli_fbase = 0x404000, dli_sname = 0x0, dli_saddr = 0x0}, {dli_fname = 0xb7f7c250 "/usr/lib/i386-linux-gnu/frr/libfrr.so.0", dli_fbase = 0xb7e38000, dli_sname = 0xb7e44553 "hash_iterate", dli_saddr = 0xb7e818b0 <hash_iterate>}, {dli_fname = 0xbf8a72c1 "/usr/lib/frr/nhrpd", dli_fbase = 0x404000, dli_sname = 0x4068ea "nhrp_cache_interface_del", dli_saddr = 0x40d480 <nhrp_cache_interface_del>}, {dli_fname = 0xbf8a72c1 "/usr/lib/frr/nhrpd", dli_fbase = 0x404000, dli_sname = 0x0, dli_saddr = 0x0}, {dli_fname = 0xb7f7c250 "/usr/lib/i386-linux-gnu/frr/libfrr.so.0", dli_fbase = 0xb7e38000, dli_sname = 0xb7e447a5 "if_delete_retain", dli_saddr = 0xb7e83500 <if_delete_retain>}, {dli_fname = 0xb7f7c250 "/usr/lib/i386-linux-gnu/frr/libfrr.so.0", dli_fbase = 0xb7e38000, dli_sname = 0xb7e44b43 "if_delete", dli_saddr = 0xb7e85a10 <if_delete>}, {dli_fname = 0xb7f7c250 "/usr/lib/i386-linux-gnu/frr/libfrr.so.0", dli_fbase = 0xb7e38000, dli_sname = 0xb7e44b61 "if_terminate", dli_saddr = 0xb7e85bf0 <if_terminate>}, {dli_fname = 0xb7f7c250 "/usr/lib/i386-linux-gnu/frr/libfrr.so.0", dli_fbase = 0xb7e38000, dli_sname = 0xb7e48bcc "vrf_delete", dli_saddr = 0xb7ecc550 <vrf_delete>}, {dli_fname = 0xb7f7c250 "/usr/lib/i386-linux-gnu/frr/libfrr.so.0", dli_fbase = 0xb7e38000, dli_sname = 0xb7e48c47 "vrf_terminate", dli_saddr = 0xb7ecc9b0 <vrf_terminate>}, {dli_fname = 0xbf8a72c1 "/usr/lib/frr/nhrpd", dli_fbase = 0x404000, dli_sname = 0x0, dli_saddr = 0x0}, {dli_fname = 0xb7f7c250 "/usr/lib/i386-linux-gnu/frr/libfrr.so.0", dli_fbase = 0xb7e38000, dli_sname = 0xb7e47c18 "quagga_sigevent_process", dli_saddr = 0xb7eba340 <quagga_sigevent_process>}, {dli_fname = 0xb7f7c250 "/usr/lib/i386-linux-gnu/frr/libfrr.so.0", dli_fbase = 0xb7e38000, dli_sname = 0xb7e44342 "thread_fetch", dli_saddr = 0xb7ec9130 <thread_fetch>}, {dli_fname = 0xb7f7c250 "/usr/lib/i386-linux-gnu/frr/libfrr.so.0", dli_fbase = 0xb7e38000, dli_sname = 0xb7e4532e "frr_run", dli_saddr = 0xb7e8c200 <frr_run>}, {dli_fname = 0xbf8a72c1 "/usr/lib/frr/nhrpd", dli_fbase = 0x404000, dli_sname = 0x40625a "main", dli_saddr = 0x40aca0 <main>}, {dli_fname = 0xb7e132a8 "/lib/i386-linux-gnu/libc.so.6", dli_fbase = 0xb7c3f000, dli_sname = 0xb7c4f18e "__libc_start_main", dli_saddr = 0xb7c57550 <__libc_start_main>}, {dli_fname = 0xbf8a72c1 "/usr/lib/frr/nhrpd", dli_fbase = 0x404000, dli_sname = 0x0, dli_saddr = 0x0}}
        status = {1 <repeats 29 times>}
        cnt = <optimized out>
        total = <optimized out>
        result = <optimized out>
        __PRETTY_FUNCTION__ = "__backtrace_symbols"
#6  0xb7e90a32 in zlog_backtrace_sigsafe () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#7  0xb7e90bde in zlog_signal () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#8  0xb7eba044 in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#9  <signal handler called>
No symbol table info available.
#10 0xb7f80cf5 in ?? ()
No symbol table info available.
#11 0xb7e94725 in qfree () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#12 0x00417670 in ?? ()
No symbol table info available.
#13 0x004122da in ?? ()
No symbol table info available.
#14 0x0040cc5f in ?? ()
No symbol table info available.
#15 0xb7e818ea in hash_iterate () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#16 0x0040d4bd in nhrp_cache_interface_del ()
No symbol table info available.
#17 0x0040ead5 in ?? ()
No symbol table info available.
#18 0xb7e83536 in if_delete_retain () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#19 0xb7e85a70 in if_delete () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#20 0xb7e85c7b in if_terminate () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#21 0xb7ecc5fa in vrf_delete () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#22 0xb7ecc9f6 in vrf_terminate () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#23 0x0040fed3 in ?? ()
No symbol table info available.
#24 0xb7eba3a1 in quagga_sigevent_process () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#25 0xb7ec986d in thread_fetch () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#26 0xb7e8c2e6 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#27 0x0040adaa in main ()
No symbol table info available.
Dump of assembler code for function __backtrace_symbols:
   0xb7d33810 <+0>:	push   %ebp
   0xb7d33811 <+1>:	call   0xb7d5ec59 <__x86.get_pc_thunk.ax>
   0xb7d33816 <+6>:	add    $0xbe7ea,%eax
   0xb7d3381b <+11>:	mov    %esp,%ebp
   0xb7d3381d <+13>:	push   %edi
   0xb7d3381e <+14>:	push   %esi
   0xb7d3381f <+15>:	push   %ebx
   0xb7d33820 <+16>:	sub    $0x4c,%esp
   0xb7d33823 <+19>:	mov    %eax,-0x34(%ebp)
   0xb7d33826 <+22>:	mov    0xc(%ebp),%eax
   0xb7d33829 <+25>:	mov    0xc(%ebp),%ecx
   0xb7d3382c <+28>:	shl    $0x4,%eax
   0xb7d3382f <+31>:	add    $0x10,%eax
   0xb7d33832 <+34>:	sub    %eax,%esp
   0xb7d33834 <+36>:	mov    0xc(%ebp),%eax
   0xb7d33837 <+39>:	mov    %esp,%edx
   0xb7d33839 <+41>:	shl    $0x2,%eax
   0xb7d3383c <+44>:	mov    %eax,-0x3c(%ebp)
   0xb7d3383f <+47>:	add    $0x12,%eax
   0xb7d33842 <+50>:	and    $0xfffffff0,%eax
   0xb7d33845 <+53>:	sub    %eax,%esp
   0xb7d33847 <+55>:	test   %ecx,%ecx
   0xb7d33849 <+57>:	mov    %esp,-0x2c(%ebp)
   0xb7d3384c <+60>:	jle    0xb7d33a57 <__backtrace_symbols+583>
   0xb7d33852 <+66>:	lea    -0x1c(%ebp),%eax
   0xb7d33855 <+69>:	mov    %edx,%esi
   0xb7d33857 <+71>:	mov    %edx,-0x40(%ebp)
   0xb7d3385a <+74>:	xor    %edi,%edi
   0xb7d3385c <+76>:	xor    %ebx,%ebx
   0xb7d3385e <+78>:	mov    %eax,-0x30(%ebp)
   0xb7d33861 <+81>:	jmp    0xb7d338c0 <__backtrace_symbols+176>
   0xb7d33863 <+83>:	nop
   0xb7d33864 <+84>:	lea    0x0(%esi,%eiz,1),%esi
   0xb7d33868 <+88>:	mov    (%esi),%eax
   0xb7d3386a <+90>:	test   %eax,%eax
   0xb7d3386c <+92>:	je     0xb7d338e2 <__backtrace_symbols+210>
   0xb7d3386e <+94>:	cmpb   $0x0,(%eax)
   0xb7d33871 <+97>:	je     0xb7d338e2 <__backtrace_symbols+210>
   0xb7d33873 <+99>:	sub    $0xc,%esp
   0xb7d33876 <+102>:	push   %eax
   0xb7d33877 <+103>:	call   0xb7cb46a0 <__strlen_ia32>
   0xb7d3387c <+108>:	mov    %eax,%edx
   0xb7d3387e <+110>:	mov    0x8(%esi),%eax
   0xb7d33881 <+113>:	add    $0x10,%esp
   0xb7d33884 <+116>:	test   %eax,%eax
   0xb7d33886 <+118>:	je     0xb7d33a50 <__backtrace_symbols+576>
   0xb7d3388c <+124>:	sub    $0xc,%esp
   0xb7d3388f <+127>:	mov    %edx,-0x38(%ebp)
   0xb7d33892 <+130>:	push   %eax
   0xb7d33893 <+131>:	call   0xb7cb46a0 <__strlen_ia32>
   0xb7d33898 <+136>:	mov    -0x38(%ebp),%edx
   0xb7d3389b <+139>:	add    $0x10,%esp
   0xb7d3389e <+142>:	lea    0x1b(%edi,%edx,1),%edi
   0xb7d338a2 <+146>:	add    $0x1,%ebx
   0xb7d338a5 <+149>:	add    $0x10,%esi
   0xb7d338a8 <+152>:	add    %eax,%edi
   0xb7d338aa <+154>:	mov    -0x1c(%ebp),%eax
   0xb7d338ad <+157>:	mov    (%eax),%eax
   0xb7d338af <+159>:	mov    %eax,-0xc(%esi)
   0xb7d338b2 <+162>:	cmp    %ebx,0xc(%ebp)
   0xb7d338b5 <+165>:	je     0xb7d338f0 <__backtrace_symbols+224>
   0xb7d338b7 <+167>:	mov    %esi,%esi
   0xb7d338b9 <+169>:	lea    0x0(%edi,%eiz,1),%edi
   0xb7d338c0 <+176>:	mov    0x8(%ebp),%eax
   0xb7d338c3 <+179>:	sub    $0xc,%esp
   0xb7d338c6 <+182>:	mov    -0x30(%ebp),%ecx
   0xb7d338c9 <+185>:	mov    %esi,%edx
   0xb7d338cb <+187>:	mov    (%eax,%ebx,4),%eax
   0xb7d338ce <+190>:	push   $0x0
   0xb7d338d0 <+192>:	call   0xb7d5bc80 <__GI__dl_addr>
   0xb7d338d5 <+197>:	mov    -0x2c(%ebp),%ecx
   0xb7d338d8 <+200>:	add    $0xc,%esp
   0xb7d338db <+203>:	test   %eax,%eax
   0xb7d338dd <+205>:	mov    %eax,(%ecx,%ebx,4)
   0xb7d338e0 <+208>:	jne    0xb7d33868 <__backtrace_symbols+88>
   0xb7d338e2 <+210>:	add    $0xd,%edi
   0xb7d338e5 <+213>:	add    $0x1,%ebx
   0xb7d338e8 <+216>:	add    $0x10,%esi
   0xb7d338eb <+219>:	cmp    %ebx,0xc(%ebp)
   0xb7d338ee <+222>:	jne    0xb7d338c0 <__backtrace_symbols+176>
   0xb7d338f0 <+224>:	mov    -0x3c(%ebp),%esi
   0xb7d338f3 <+227>:	sub    $0xc,%esp
   0xb7d338f6 <+230>:	mov    -0x34(%ebp),%ebx
   0xb7d338f9 <+233>:	add    %esi,%edi
   0xb7d338fb <+235>:	push   %edi
   0xb7d338fc <+236>:	mov    %edi,-0x4c(%ebp)
   0xb7d338ff <+239>:	call   0xb7c56740
=> 0xb7d33904 <+244>:	mov    %eax,%edi
   0xb7d33906 <+246>:	lea    (%eax,%esi,1),%esi
   0xb7d33909 <+249>:	mov    -0x34(%ebp),%eax
   0xb7d3390c <+252>:	add    $0x10,%esp
   0xb7d3390f <+255>:	xor    %ebx,%ebx
   0xb7d33911 <+257>:	test   %edi,%edi
   0xb7d33913 <+259>:	lea    -0x5772e(%eax),%ecx
   0xb7d33919 <+265>:	lea    -0x54cc1(%eax),%eax
   0xb7d3391f <+271>:	mov    %ecx,-0x44(%ebp)
   0xb7d33922 <+274>:	mov    %eax,-0x48(%ebp)
   0xb7d33925 <+277>:	je     0xb7d339ec <__backtrace_symbols+476>
   0xb7d3392b <+283>:	mov    %edi,-0x30(%ebp)
   0xb7d3392e <+286>:	mov    %esi,%edi
   0xb7d33930 <+288>:	mov    -0x40(%ebp),%esi
   0xb7d33933 <+291>:	jmp    0xb7d33994 <__backtrace_symbols+388>
   0xb7d33935 <+293>:	lea    0x0(%esi),%esi
   0xb7d33938 <+296>:	mov    0x8(%esi),%ecx
   0xb7d3393b <+299>:	test   %ecx,%ecx
   0xb7d3393d <+301>:	mov    %ecx,-0x3c(%ebp)
   0xb7d33940 <+304>:	je     0xb7d33a10 <__backtrace_symbols+512>
   0xb7d33946 <+310>:	mov    0xc(%esi),%ecx
   0xb7d33949 <+313>:	mov    0x8(%ebp),%edx
   0xb7d3394c <+316>:	mov    (%edx,%ebx,4),%edx
   0xb7d3394f <+319>:	cmp    %ecx,%edx
   0xb7d33951 <+321>:	mov    %edx,-0x38(%ebp)
   0xb7d33954 <+324>:	jb     0xb7d33a00 <__backtrace_symbols+496>
   0xb7d3395a <+330>:	sub    %ecx,%edx
   0xb7d3395c <+332>:	mov    $0x2b,%ecx
   0xb7d33961 <+337>:	mov    %edx,-0x40(%ebp)
   0xb7d33964 <+340>:	mov    -0x3c(%ebp),%edx
   0xb7d33967 <+343>:	test   %edx,%edx
   0xb7d33969 <+345>:	cmove  -0x44(%ebp),%edx
   0xb7d3396d <+349>:	sub    $0x4,%esp
   0xb7d33970 <+352>:	pushl  -0x38(%ebp)
   0xb7d33973 <+355>:	pushl  -0x40(%ebp)
   0xb7d33976 <+358>:	push   %ecx
   0xb7d33977 <+359>:	push   %edx
   0xb7d33978 <+360>:	push   %eax
   0xb7d33979 <+361>:	pushl  -0x48(%ebp)
   0xb7d3397c <+364>:	push   %edi
   0xb7d3397d <+365>:	call   0xb7c886e0 <__sprintf>
   0xb7d33982 <+370>:	lea    0x1(%edi,%eax,1),%edi
   0xb7d33986 <+374>:	add    $0x20,%esp
   0xb7d33989 <+377>:	add    $0x1,%ebx
   0xb7d3398c <+380>:	add    $0x10,%esi
   0xb7d3398f <+383>:	cmp    %ebx,0xc(%ebp)
   0xb7d33992 <+386>:	je     0xb7d339da <__backtrace_symbols+458>
   0xb7d33994 <+388>:	mov    -0x30(%ebp),%eax
   0xb7d33997 <+391>:	mov    %edi,(%eax,%ebx,4)
   0xb7d3399a <+394>:	mov    -0x2c(%ebp),%eax
   0xb7d3399d <+397>:	mov    (%eax,%ebx,4),%eax
   0xb7d339a0 <+400>:	test   %eax,%eax
   0xb7d339a2 <+402>:	je     0xb7d339af <__backtrace_symbols+415>
   0xb7d339a4 <+404>:	mov    (%esi),%eax
   0xb7d339a6 <+406>:	test   %eax,%eax
   0xb7d339a8 <+408>:	je     0xb7d339af <__backtrace_symbols+415>
   0xb7d339aa <+410>:	cmpb   $0x0,(%eax)
   0xb7d339ad <+413>:	jne    0xb7d33938 <__backtrace_symbols+296>
   0xb7d339af <+415>:	mov    0x8(%ebp),%eax
   0xb7d339b2 <+418>:	sub    $0x4,%esp
   0xb7d339b5 <+421>:	add    $0x10,%esi
   0xb7d339b8 <+424>:	pushl  (%eax,%ebx,4)
   0xb7d339bb <+427>:	mov    -0x34(%ebp),%eax
   0xb7d339be <+430>:	add    $0x1,%ebx
   0xb7d339c1 <+433>:	lea    -0x54cd6(%eax),%eax
   0xb7d339c7 <+439>:	push   %eax
   0xb7d339c8 <+440>:	push   %edi
   0xb7d339c9 <+441>:	call   0xb7c886e0 <__sprintf>
   0xb7d339ce <+446>:	add    $0x10,%esp
   0xb7d339d1 <+449>:	cmp    %ebx,0xc(%ebp)
   0xb7d339d4 <+452>:	lea    0x1(%edi,%eax,1),%edi
   0xb7d339d8 <+456>:	jne    0xb7d33994 <__backtrace_symbols+388>
   0xb7d339da <+458>:	mov    %edi,%esi
   0xb7d339dc <+460>:	mov    -0x4c(%ebp),%eax
   0xb7d339df <+463>:	mov    -0x30(%ebp),%edi
   0xb7d339e2 <+466>:	add    %edi,%eax
   0xb7d339e4 <+468>:	cmp    %eax,%esi
   0xb7d339e6 <+470>:	ja     0xb7d33a6f <__backtrace_symbols+607>
   0xb7d339ec <+476>:	lea    -0xc(%ebp),%esp
   0xb7d339ef <+479>:	mov    %edi,%eax
   0xb7d339f1 <+481>:	pop    %ebx
   0xb7d339f2 <+482>:	pop    %esi
   0xb7d339f3 <+483>:	pop    %edi
   0xb7d339f4 <+484>:	pop    %ebp
   0xb7d339f5 <+485>:	ret    
   0xb7d339f6 <+486>:	lea    0x0(%esi),%esi
   0xb7d339f9 <+489>:	lea    0x0(%edi,%eiz,1),%edi
   0xb7d33a00 <+496>:	sub    -0x38(%ebp),%ecx
   0xb7d33a03 <+499>:	mov    %ecx,-0x40(%ebp)
   0xb7d33a06 <+502>:	mov    $0x2d,%ecx
   0xb7d33a0b <+507>:	jmp    0xb7d33964 <__backtrace_symbols+340>
   0xb7d33a10 <+512>:	mov    0x4(%esi),%ecx
   0xb7d33a13 <+515>:	test   %ecx,%ecx
   0xb7d33a15 <+517>:	mov    %ecx,0xc(%esi)
   0xb7d33a18 <+520>:	jne    0xb7d33949 <__backtrace_symbols+313>
   0xb7d33a1e <+526>:	mov    0x8(%ebp),%ecx
   0xb7d33a21 <+529>:	sub    $0xc,%esp
   0xb7d33a24 <+532>:	pushl  (%ecx,%ebx,4)
   0xb7d33a27 <+535>:	pushl  -0x44(%ebp)
   0xb7d33a2a <+538>:	push   %eax
   0xb7d33a2b <+539>:	mov    -0x34(%ebp),%eax
   0xb7d33a2e <+542>:	lea    -0x54cdd(%eax),%eax
   0xb7d33a34 <+548>:	push   %eax
   0xb7d33a35 <+549>:	push   %edi
   0xb7d33a36 <+550>:	call   0xb7c886e0 <__sprintf>
   0xb7d33a3b <+555>:	add    $0x20,%esp
   0xb7d33a3e <+558>:	lea    0x1(%edi,%eax,1),%edi
   0xb7d33a42 <+562>:	jmp    0xb7d33989 <__backtrace_symbols+377>
   0xb7d33a47 <+567>:	mov    %esi,%esi
   0xb7d33a49 <+569>:	lea    0x0(%edi,%eiz,1),%edi
   0xb7d33a50 <+576>:	xor    %eax,%eax
   0xb7d33a52 <+578>:	jmp    0xb7d3389e <__backtrace_symbols+142>
   0xb7d33a57 <+583>:	mov    -0x34(%ebp),%ebx
   0xb7d33a5a <+586>:	sub    $0xc,%esp
   0xb7d33a5d <+589>:	pushl  -0x3c(%ebp)
   0xb7d33a60 <+592>:	call   0xb7c56740
   0xb7d33a65 <+597>:	add    $0x10,%esp
   0xb7d33a68 <+600>:	mov    %eax,%edi
   0xb7d33a6a <+602>:	jmp    0xb7d339ec <__backtrace_symbols+476>
   0xb7d33a6f <+607>:	mov    -0x34(%ebp),%ecx
   0xb7d33a72 <+610>:	lea    -0x51344(%ecx),%eax
   0xb7d33a78 <+616>:	push   %eax
   0xb7d33a79 <+617>:	lea    -0x54cd1(%ecx),%eax
   0xb7d33a7f <+623>:	push   $0x73
   0xb7d33a81 <+625>:	push   %eax
   0xb7d33a82 <+626>:	lea    -0x51380(%ecx),%eax
   0xb7d33a88 <+632>:	push   %eax
   0xb7d33a89 <+633>:	call   0xb7c63d60 <__GI___assert_fail>
End of assembler dump.
#6  0xb7e90a32 in zlog_backtrace_sigsafe () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function zlog_backtrace_sigsafe:
   0xb7e90960 <+0>:	push   %ebp
   0xb7e90961 <+1>:	mov    %esp,%ebp
   0xb7e90963 <+3>:	push   %edi
   0xb7e90964 <+4>:	push   %esi
   0xb7e90965 <+5>:	push   %ebx
   0xb7e90966 <+6>:	call   0xb7e62640
   0xb7e9096b <+11>:	add    $0xd80a5,%ebx
   0xb7e90971 <+17>:	sub    $0x1c4,%esp
   0xb7e90977 <+23>:	movl   $0x80,-0x1a0(%ebp)
   0xb7e90981 <+33>:	mov    %gs:0x14,%eax
   0xb7e90987 <+39>:	mov    %eax,-0x1c(%ebp)
   0xb7e9098a <+42>:	xor    %eax,%eax
   0xb7e9098c <+44>:	lea    -0x9c(%ebp),%eax
   0xb7e90992 <+50>:	push   $0x40
   0xb7e90994 <+52>:	mov    %eax,-0x1b0(%ebp)
   0xb7e9099a <+58>:	mov    %eax,-0x1a8(%ebp)
   0xb7e909a0 <+64>:	mov    %eax,-0x1a4(%ebp)
   0xb7e909a6 <+70>:	lea    -0x19c(%ebp),%eax
   0xb7e909ac <+76>:	push   %eax
   0xb7e909ad <+77>:	mov    %eax,-0x1bc(%ebp)
   0xb7e909b3 <+83>:	call   0xb7e5ddc0
   0xb7e909b8 <+88>:	mov    %eax,-0x1ac(%ebp)
   0xb7e909be <+94>:	sub    $0x1,%eax
   0xb7e909c1 <+97>:	add    $0x10,%esp
   0xb7e909c4 <+100>:	cmp    $0x3f,%eax
   0xb7e909c7 <+103>:	jbe    0xb7e909e8 <zlog_backtrace_sigsafe+136>
   0xb7e909c9 <+105>:	mov    -0x1c(%ebp),%eax
   0xb7e909cc <+108>:	xor    %gs:0x14,%eax
   0xb7e909d3 <+115>:	jne    0xb7e90ae9 <zlog_backtrace_sigsafe+393>
   0xb7e909d9 <+121>:	lea    -0xc(%ebp),%esp
   0xb7e909dc <+124>:	pop    %ebx
   0xb7e909dd <+125>:	pop    %esi
   0xb7e909de <+126>:	pop    %edi
   0xb7e909df <+127>:	pop    %ebp
   0xb7e909e0 <+128>:	ret    
   0xb7e909e1 <+129>:	lea    0x0(%esi,%eiz,1),%esi
   0xb7e909e8 <+136>:	mov    -0x1ac(%ebp),%edi
   0xb7e909ee <+142>:	lea    -0x6f848(%ebx),%eax
   0xb7e909f4 <+148>:	sub    $0x4,%esp
   0xb7e909f7 <+151>:	push   %edi
   0xb7e909f8 <+152>:	push   %eax
   0xb7e909f9 <+153>:	lea    -0x1a8(%ebp),%eax
   0xb7e909ff <+159>:	push   %eax
   0xb7e90a00 <+160>:	mov    %eax,-0x1b4(%ebp)
   0xb7e90a06 <+166>:	call   0xb7ee6da0 <bprintfrr>
   0xb7e90a0b <+171>:	pop    %eax
   0xb7e90a0c <+172>:	mov    -0x1a4(%ebp),%edx
   0xb7e90a12 <+178>:	mov    -0x1a8(%ebp),%eax
   0xb7e90a18 <+184>:	pop    %ecx
   0xb7e90a19 <+185>:	sub    %edx,%eax
   0xb7e90a1b <+187>:	push   %eax
   0xb7e90a1c <+188>:	push   %edx
   0xb7e90a1d <+189>:	call   0xb7ee1aa0 <zlog_sigsafe>
   0xb7e90a22 <+194>:	pop    %esi
   0xb7e90a23 <+195>:	pop    %eax
   0xb7e90a24 <+196>:	push   %edi
   0xb7e90a25 <+197>:	pushl  -0x1bc(%ebp)
   0xb7e90a2b <+203>:	xor    %esi,%esi
   0xb7e90a2d <+205>:	call   0xb7e5dad8
=> 0xb7e90a32 <+210>:	mov    %eax,%edi
   0xb7e90a34 <+212>:	lea    -0x6f4a4(%ebx),%eax
   0xb7e90a3a <+218>:	add    $0x10,%esp
   0xb7e90a3d <+221>:	mov    %eax,-0x1c0(%ebp)
   0xb7e90a43 <+227>:	lea    -0x6c60d(%ebx),%eax
   0xb7e90a49 <+233>:	mov    %eax,-0x1b8(%ebp)
   0xb7e90a4f <+239>:	jmp    0xb7e90a98 <zlog_backtrace_sigsafe+312>
   0xb7e90a51 <+241>:	lea    0x0(%esi,%eiz,1),%esi
   0xb7e90a58 <+248>:	sub    $0x4,%esp
   0xb7e90a5b <+251>:	pushl  (%edi,%esi,4)
   0xb7e90a5e <+254>:	pushl  -0x1b8(%ebp)
   0xb7e90a64 <+260>:	pushl  -0x1b4(%ebp)
   0xb7e90a6a <+266>:	call   0xb7ee6da0 <bprintfrr>
   0xb7e90a6f <+271>:	add    $0x10,%esp
   0xb7e90a72 <+274>:	mov    -0x1a8(%ebp),%edx
   0xb7e90a78 <+280>:	mov    -0x1a4(%ebp),%eax
   0xb7e90a7e <+286>:	sub    $0x8,%esp
   0xb7e90a81 <+289>:	add    $0x1,%esi
   0xb7e90a84 <+292>:	sub    %edx,%eax
   0xb7e90a86 <+294>:	push   %eax
   0xb7e90a87 <+295>:	push   %edx
   0xb7e90a88 <+296>:	call   0xb7ee1aa0 <zlog_sigsafe>
   0xb7e90a8d <+301>:	add    $0x10,%esp
   0xb7e90a90 <+304>:	cmp    %esi,-0x1ac(%ebp)
   0xb7e90a96 <+310>:	je     0xb7e90ad0 <zlog_backtrace_sigsafe+368>
   0xb7e90a98 <+312>:	mov    -0x1b0(%ebp),%eax
   0xb7e90a9e <+318>:	test   %edi,%edi
   0xb7e90aa0 <+320>:	mov    %eax,-0x1a4(%ebp)
   0xb7e90aa6 <+326>:	jne    0xb7e90a58 <zlog_backtrace_sigsafe+248>
   0xb7e90aa8 <+328>:	mov    -0x1bc(%ebp),%eax
   0xb7e90aae <+334>:	pushl  (%eax,%esi,4)
   0xb7e90ab1 <+337>:	push   %esi
   0xb7e90ab2 <+338>:	pushl  -0x1c0(%ebp)
   0xb7e90ab8 <+344>:	pushl  -0x1b4(%ebp)
   0xb7e90abe <+350>:	call   0xb7ee6da0 <bprintfrr>
   0xb7e90ac3 <+355>:	add    $0x10,%esp
   0xb7e90ac6 <+358>:	jmp    0xb7e90a72 <zlog_backtrace_sigsafe+274>
   0xb7e90ac8 <+360>:	nop
   0xb7e90ac9 <+361>:	lea    0x0(%esi,%eiz,1),%esi
   0xb7e90ad0 <+368>:	test   %edi,%edi
   0xb7e90ad2 <+370>:	je     0xb7e909c9 <zlog_backtrace_sigsafe+105>
   0xb7e90ad8 <+376>:	sub    $0xc,%esp
   0xb7e90adb <+379>:	push   %edi
   0xb7e90adc <+380>:	call   0xb7e5d6b8
   0xb7e90ae1 <+385>:	add    $0x10,%esp
   0xb7e90ae4 <+388>:	jmp    0xb7e909c9 <zlog_backtrace_sigsafe+105>
   0xb7e90ae9 <+393>:	call   0xb7ee7d60
End of assembler dump.
#7  0xb7e90bde in zlog_signal () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function zlog_signal:
   0xb7e90af0 <+0>:	push   %ebp
   0xb7e90af1 <+1>:	mov    %esp,%ebp
   0xb7e90af3 <+3>:	push   %edi
   0xb7e90af4 <+4>:	push   %esi
   0xb7e90af5 <+5>:	push   %ebx
   0xb7e90af6 <+6>:	lea    -0xc3(%ebp),%edi
   0xb7e90afc <+12>:	lea    -0xd0(%ebp),%esi
   0xb7e90b02 <+18>:	call   0xb7e62640
   0xb7e90b07 <+23>:	add    $0xd7f09,%ebx
   0xb7e90b0d <+29>:	sub    $0xe8,%esp
   0xb7e90b13 <+35>:	mov    0xc(%ebp),%eax
   0xb7e90b16 <+38>:	mov    %edi,-0xd0(%ebp)
   0xb7e90b1c <+44>:	mov    %gs:0x14,%ecx
   0xb7e90b23 <+51>:	mov    %ecx,-0x1c(%ebp)
   0xb7e90b26 <+54>:	xor    %ecx,%ecx
   0xb7e90b28 <+56>:	mov    %edi,-0xcc(%ebp)
   0xb7e90b2e <+62>:	movl   $0xa7,-0xc8(%ebp)
   0xb7e90b38 <+72>:	mov    %eax,-0xe0(%ebp)
   0xb7e90b3e <+78>:	mov    0x10(%ebp),%eax
   0xb7e90b41 <+81>:	mov    %eax,-0xe4(%ebp)
   0xb7e90b47 <+87>:	mov    0x14(%ebp),%eax
   0xb7e90b4a <+90>:	mov    %eax,-0xdc(%ebp)
   0xb7e90b50 <+96>:	lea    -0xd4(%ebp),%eax
   0xb7e90b56 <+102>:	push   %eax
   0xb7e90b57 <+103>:	call   0xb7e5d728
   0xb7e90b5c <+108>:	mov    -0xd4(%ebp),%eax
   0xb7e90b62 <+114>:	cltd   
   0xb7e90b63 <+115>:	mov    %edx,(%esp)
   0xb7e90b66 <+118>:	push   %eax
   0xb7e90b67 <+119>:	lea    -0x6f496(%ebx),%eax
   0xb7e90b6d <+125>:	pushl  0x8(%ebp)
   0xb7e90b70 <+128>:	push   %eax
   0xb7e90b71 <+129>:	push   %esi
   0xb7e90b72 <+130>:	call   0xb7ee6da0 <bprintfrr>
   0xb7e90b77 <+135>:	mov    -0xdc(%ebp),%eax
   0xb7e90b7d <+141>:	add    $0x20,%esp
   0xb7e90b80 <+144>:	test   %eax,%eax
   0xb7e90b82 <+146>:	je     0xb7e90c50 <zlog_signal+352>
   0xb7e90b88 <+152>:	push   %eax
   0xb7e90b89 <+153>:	mov    -0xe4(%ebp),%eax
   0xb7e90b8f <+159>:	pushl  0xc(%eax)
   0xb7e90b92 <+162>:	lea    -0x6f47b(%ebx),%eax
   0xb7e90b98 <+168>:	push   %eax
   0xb7e90b99 <+169>:	push   %esi
   0xb7e90b9a <+170>:	call   0xb7ee6da0 <bprintfrr>
   0xb7e90b9f <+175>:	add    $0x10,%esp
   0xb7e90ba2 <+178>:	lea    -0x6f44f(%ebx),%eax
   0xb7e90ba8 <+184>:	sub    $0x4,%esp
   0xb7e90bab <+187>:	pushl  -0xe0(%ebp)
   0xb7e90bb1 <+193>:	push   %eax
   0xb7e90bb2 <+194>:	push   %esi
   0xb7e90bb3 <+195>:	call   0xb7ee6da0 <bprintfrr>
   0xb7e90bb8 <+200>:	pop    %eax
   0xb7e90bb9 <+201>:	mov    -0xd0(%ebp),%edx
   0xb7e90bbf <+207>:	mov    -0xcc(%ebp),%eax
   0xb7e90bc5 <+213>:	pop    %ecx
   0xb7e90bc6 <+214>:	sub    %edx,%eax
   0xb7e90bc8 <+216>:	push   %eax
   0xb7e90bc9 <+217>:	push   %edx
   0xb7e90bca <+218>:	call   0xb7ee1aa0 <zlog_sigsafe>
   0xb7e90bcf <+223>:	pop    %eax
   0xb7e90bd0 <+224>:	pop    %edx
   0xb7e90bd1 <+225>:	pushl  -0xdc(%ebp)
   0xb7e90bd7 <+231>:	push   $0x2
   0xb7e90bd9 <+233>:	call   0xb7e90960 <zlog_backtrace_sigsafe>
=> 0xb7e90bde <+238>:	mov    0x308(%ebx),%eax
   0xb7e90be4 <+244>:	mov    %edi,-0xcc(%ebp)
   0xb7e90bea <+250>:	pop    %ecx
   0xb7e90beb <+251>:	pushl  (%eax)
   0xb7e90bed <+253>:	call   0xb7e5ddf0
   0xb7e90bf2 <+258>:	add    $0x10,%esp
   0xb7e90bf5 <+261>:	test   %eax,%eax
   0xb7e90bf7 <+263>:	je     0xb7e90c78 <zlog_signal+392>
   0xb7e90bf9 <+265>:	mov    0x34(%eax),%eax
   0xb7e90bfc <+268>:	sub    $0x8,%esp
   0xb7e90bff <+271>:	pushl  0x10(%eax)
   0xb7e90c02 <+274>:	pushl  0x8(%eax)
   0xb7e90c05 <+277>:	pushl  0xc(%eax)
   0xb7e90c08 <+280>:	pushl  0x14(%eax)
   0xb7e90c0b <+283>:	lea    -0x6f804(%ebx),%eax
   0xb7e90c11 <+289>:	push   %eax
   0xb7e90c12 <+290>:	push   %esi
   0xb7e90c13 <+291>:	call   0xb7ee6da0 <bprintfrr>
   0xb7e90c18 <+296>:	add    $0x20,%esp
   0xb7e90c1b <+299>:	mov    -0xd0(%ebp),%edx
   0xb7e90c21 <+305>:	mov    -0xcc(%ebp),%eax
   0xb7e90c27 <+311>:	sub    $0x8,%esp
   0xb7e90c2a <+314>:	sub    %edx,%eax
   0xb7e90c2c <+316>:	push   %eax
   0xb7e90c2d <+317>:	push   %edx
   0xb7e90c2e <+318>:	call   0xb7ee1aa0 <zlog_sigsafe>
   0xb7e90c33 <+323>:	add    $0x10,%esp
   0xb7e90c36 <+326>:	mov    -0x1c(%ebp),%eax
   0xb7e90c39 <+329>:	xor    %gs:0x14,%eax
   0xb7e90c40 <+336>:	jne    0xb7e90c8d <zlog_signal+413>
   0xb7e90c42 <+338>:	lea    -0xc(%ebp),%esp
   0xb7e90c45 <+341>:	pop    %ebx
   0xb7e90c46 <+342>:	pop    %esi
   0xb7e90c47 <+343>:	pop    %edi
   0xb7e90c48 <+344>:	pop    %ebp
   0xb7e90c49 <+345>:	ret    
   0xb7e90c4a <+346>:	lea    0x0(%esi),%esi
   0xb7e90c50 <+352>:	mov    -0xe4(%ebp),%eax
   0xb7e90c56 <+358>:	sub    $0x4,%esp
   0xb7e90c59 <+361>:	pushl  0xc(%eax)
   0xb7e90c5c <+364>:	lea    -0x6f460(%ebx),%eax
   0xb7e90c62 <+370>:	push   %eax
   0xb7e90c63 <+371>:	push   %esi
   0xb7e90c64 <+372>:	call   0xb7ee6da0 <bprintfrr>
   0xb7e90c69 <+377>:	add    $0x10,%esp
   0xb7e90c6c <+380>:	jmp    0xb7e90ba2 <zlog_signal+178>
   0xb7e90c71 <+385>:	lea    0x0(%esi,%eiz,1),%esi
   0xb7e90c78 <+392>:	lea    -0x6f828(%ebx),%eax
   0xb7e90c7e <+398>:	sub    $0x8,%esp
   0xb7e90c81 <+401>:	push   %eax
   0xb7e90c82 <+402>:	push   %esi
   0xb7e90c83 <+403>:	call   0xb7ee6da0 <bprintfrr>
   0xb7e90c88 <+408>:	add    $0x10,%esp
   0xb7e90c8b <+411>:	jmp    0xb7e90c1b <zlog_signal+299>
   0xb7e90c8d <+413>:	call   0xb7ee7d60
End of assembler dump.
#8  0xb7eba044 in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#9  <signal handler called>
#10 0xb7f80cf5 in ?? ()

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17898/artifact/TOPOI386/ErrorLog/log_topotests.txt

Successful on other platforms/tests

Ubuntu 20.04 deb pkg check
Addresssanitizer topotests part 4
Topotests Ubuntu 18.04 amd64 part 1
Addresssanitizer topotests part 2
Ubuntu 18.04 deb pkg check
Debian 9 deb pkg check
Topotests Ubuntu 16.04 i386 part 5
Topotests Ubuntu 16.04 amd64 part 9
CentOS 7 rpm pkg check
Topotests Ubuntu 18.04 amd64 part 8
Topotests Ubuntu 16.04 i386 part 3
Addresssanitizer topotests part 9
Topotests Ubuntu 18.04 arm8 part 2
Topotests Ubuntu 18.04 arm8 part 7
Topotests Ubuntu 18.04 arm8 part 3
Addresssanitizer topotests part 7
Topotests Ubuntu 18.04 arm8 part 8
Topotests Ubuntu 16.04 amd64 part 2
Topotests Ubuntu 18.04 amd64 part 2
Addresssanitizer topotests part 5
Static analyzer (clang)
Topotests Ubuntu 16.04 i386 part 9
Topotests Ubuntu 18.04 amd64 part 6
Ubuntu 16.04 deb pkg check
Topotests Ubuntu 16.04 amd64 part 6
Topotests Ubuntu 18.04 arm8 part 5
Topotests Ubuntu 16.04 amd64 part 8
IPv4 ldp protocol on Ubuntu 18.04
Debian 8 deb pkg check
Topotests Ubuntu 18.04 amd64 part 4
Addresssanitizer topotests part 3
Topotests Ubuntu 16.04 i386 part 7
IPv6 protocols on Ubuntu 18.04
Topotests Ubuntu 16.04 i386 part 4
Addresssanitizer topotests part 1
Topotests Ubuntu 18.04 amd64 part 3
Topotests Ubuntu 16.04 amd64 part 1
Topotests Ubuntu 16.04 i386 part 6
Topotests Ubuntu 16.04 amd64 part 3
Topotests Ubuntu 18.04 arm8 part 4
Topotests Ubuntu 18.04 arm8 part 9
Topotests Ubuntu 18.04 arm8 part 6
IPv4 protocols on Ubuntu 18.04
Addresssanitizer topotests part 8
Topotests Ubuntu 18.04 arm8 part 1
Debian 10 deb pkg check
Topotests Ubuntu 16.04 amd64 part 7
Topotests Ubuntu 18.04 amd64 part 7
Topotests Ubuntu 18.04 amd64 part 9
Topotests Ubuntu 16.04 i386 part 2
Topotests Ubuntu 16.04 i386 part 1
Topotests Ubuntu 16.04 i386 part 8
Addresssanitizer topotests part 6
Fedora 29 rpm pkg check
Topotests Ubuntu 18.04 amd64 part 5
Topotests Ubuntu 16.04 amd64 part 4
Topotests Ubuntu 16.04 amd64 part 5

Warnings Generated during build:

Checkout code: Successful with additional warnings

Topotests Ubuntu 18.04 arm8 part 0: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPO0U18ARM8-17898/test

Topology Tests failed for Topotests Ubuntu 18.04 arm8 part 0
see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17898/artifact/TOPO0U18ARM8/ErrorLog/log_topotests.txt

Topotests Ubuntu 16.04 amd64 part 0: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1604-17898/test

Topology Tests failed for Topotests Ubuntu 16.04 amd64 part 0:

54	../sysdeps/unix/sysv/linux/raise.c: No such file or directory.
No function contains program counter for selected frame.
No function contains program counter for selected frame.
No function contains program counter for selected frame.

r1: nhrpd crashed. Core file found - Backtrace follows:
[New LWP 16196]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/nhrpd --log file:nhrpd.log --log-level debug -d'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007fa406053438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
  Id   Target Id         Frame 
* 1    Thread 0x7fa40711b880 (LWP 16196) 0x00007fa406053438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007fa406053438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
        resultvar = 0
        pid = 16196
        selftid = 16196
#1  0x00007fa40605503a in __GI_abort () at abort.c:89
        save_stage = 2
        act = {__sigaction_handler = {sa_handler = 0x0, sa_sigaction = 0x0}, sa_mask = {__val = {0 <repeats 14 times>, 88, 140736301219728}}, sa_flags = -9, sa_restorer = 0x7fffb93dbd30}
        sigs = {__val = {32, 0 <repeats 15 times>}}
#2  0x00007fa4060957fa in __libc_message (do_abort=do_abort@entry=2, fmt=fmt@entry=0x7fa4061aef98 "*** Error in `%s': %s: 0x%s ***\n") at ../sysdeps/posix/libc_fatal.c:175
        ap = <error reading variable ap (Attempt to dereference a generic pointer.)>
        fd = 2
        on_2 = <optimized out>
        list = <optimized out>
        nlist = <optimized out>
        cp = <optimized out>
        written = <optimized out>
#3  0x00007fa40609c6fd in malloc_printerr (ar_ptr=0x7fa4063e2b20 <main_arena>, ptr=<optimized out>, str=0x7fa4061abd52 "corrupted double-linked list", action=<optimized out>) at malloc.c:5020
        buf = "000055ca5238c310"
        cp = <optimized out>
        ar_ptr = 0x7fa4063e2b20 <main_arena>
        ptr = <optimized out>
        str = 0x7fa4061abd52 "corrupted double-linked list"
#4  malloc_consolidate (av=av@entry=0x7fa4063e2b20 <main_arena>) at malloc.c:4190
        fb = 0x7fa4063e2b30 <main_arena+16>
        maxfb = 0x7fa4063e2b70 <main_arena+80>
        p = 0x55ca5238c2e0
        nextp = <optimized out>
        unsorted_bin = 0x7fa4063e2b78 <main_arena+88>
        first_unsorted = <optimized out>
        nextchunk = <optimized out>
        size = 496
        nextsize = <optimized out>
        prevsize = <optimized out>
        nextinuse = <optimized out>
        bck = <optimized out>
        fwd = <optimized out>
#5  0x00007fa40609fd0c in _int_malloc (av=av@entry=0x7fa4063e2b20 <main_arena>, bytes=bytes@entry=1182) at malloc.c:3457
        nb = 1200
        idx = 66
        bin = <optimized out>
        victim = <optimized out>
        size = <optimized out>
        victim_index = <optimized out>
        remainder = <optimized out>
        remainder_size = <optimized out>
        block = <optimized out>
        bit = <optimized out>
        map = <optimized out>
        fwd = <optimized out>
        bck = <optimized out>
        errstr = 0x0
        __func__ = "_int_malloc"
#6  0x00007fa4060a2e3a in __libc_calloc (n=<optimized out>, elem_size=<optimized out>) at malloc.c:3243
        av = 0x7fa4063e2b20 <main_arena>
        oldtop = 0x55ca5238c650
        p = <optimized out>
        bytes = 1182
        sz = 1182
        csz = <optimized out>
        oldtopsize = 133552
        mem = <optimized out>
        clearsize = <optimized out>
        nclears = <optimized out>
        d = <optimized out>
        hook = <optimized out>
        __func__ = "__libc_calloc"
#7  0x00007fa406f9dc26 in _dl_new_object (realname=realname@entry=0x55ca5238ad60 "/lib/x86_64-linux-gnu/libgcc_s.so.1", libname=libname@entry=0x7fa4061aa746 "libgcc_s.so.1", type=type@entry=2, loader=loader@entry=0x0, mode=mode@entry=-1879048191, nsid=nsid@entry=0) at dl-object.c:75
        libname_len = 14
        new = <optimized out>
        newname = <optimized out>
        naudit = 0
        audit_space = 0
        idx = <optimized out>
#8  0x00007fa406f9853d in _dl_map_object_from_fd (name=name@entry=0x7fa4061aa746 "libgcc_s.so.1", origname=origname@entry=0x0, fd=17, fbp=fbp@entry=0x7fffb93dc3a0, realname=0x55ca5238ad60 "/lib/x86_64-linux-gnu/libgcc_s.so.1", loader=loader@entry=0x0, l_type=2, mode=-1879048191, stack_endp=0x7fffb93dc398, nsid=0) at dl-load.c:1028
        l = <optimized out>
        header = 0x7fffb93dc3a8
        phdr = <optimized out>
        ph = <optimized out>
        maplength = <optimized out>
        type = <optimized out>
        errstring = 0x0
        errval = 0
        r = 0x7fa4071b9140 <_r_debug>
        make_consistent = true
        id = {dev = 64768, ino = 521752}
        __PRETTY_FUNCTION__ = "_dl_map_object_from_fd"
        stack_flags = <optimized out>
#9  0x00007fa406f9ac57 in _dl_map_object (loader=0x0, loader@entry=0x7fa4071a99d8, name=name@entry=0x7fa4061aa746 "libgcc_s.so.1", type=type@entry=2, trace_mode=trace_mode@entry=0, mode=mode@entry=-1879048191, nsid=<optimized out>) at dl-load.c:2498
        fd = <optimized out>
        origname = <optimized out>
        realname = 0x55ca5238ad60 "/lib/x86_64-linux-gnu/libgcc_s.so.1"
        name_copy = <optimized out>
        l = <optimized out>
        fb = {len = 832, buf = "\177ELF\002\001\001\000\000\000\000\000\000\000\000\000\003\000>\000\001\000\000\000p*\000\000\000\000\000\000@\000\000\000\000\000\000\000`W\001\000\000\000\000\000\000\000\000\000@\000\070\000\006\000@\000\034\000\033\000\001\000\000\000\005", '\000' <repeats 27 times>, "\214R\001\000\000\000\000\000\214R\001\000\000\000\000\000\000\000 \000\000\000\000\000\001\000\000\000\006\000\000\000\220R\001\000\000\000\000\000\220R!\000\000\000\000\000\220R!\000\000\000\000\000\300\003\000\000\000\000\000\000\200\006\000\000\000\000\000\000\000\000 \000\000\000\000\000\002\000\000\000\006\000\000\000\260R\001\000\000\000\000\000\260R!\000\000\000\000\000"...}
        __PRETTY_FUNCTION__ = "_dl_map_object"
        found_other_class = false
        stack_end = 0x7fffb93dde60
#10 0x00007fa406fa75b7 in dl_open_worker (a=a@entry=0x7fffb93dc960) at dl-open.c:237
        args = 0x7fffb93dc960
        file = 0x7fa4061aa746 "libgcc_s.so.1"
        mode = -2147483647
        call_map = 0x7fa4071a99d8
        dst = <optimized out>
        new = <optimized out>
        __PRETTY_FUNCTION__ = "dl_open_worker"
        r = <optimized out>
        reloc_mode = <optimized out>
        nmaps = <optimized out>
        l = <optimized out>
        maps = <optimized out>
        relocation_in_progress = <optimized out>
        any_tls = <optimized out>
        first_static_tls = <optimized out>
#11 0x00007fa406fa25a4 in _dl_catch_error (objname=objname@entry=0x7fffb93dc950, errstring=errstring@entry=0x7fffb93dc958, mallocedp=mallocedp@entry=0x7fffb93dc94f, operate=operate@entry=0x7fa406fa7510 <dl_open_worker>, args=args@entry=0x7fffb93dc960) at dl-error.c:187
        errcode = 0
        c = {objname = 0x7fffb93dc950, errstring = 0x7fffb93dc958, malloced = 0x7fffb93dc94f, errcode = 0x7fffb93dc82c, env = {{__jmpbuf = {140736301222496, 4252365427672181904, 2147483649, 140342453774150, 140342453287749, 140342470606912, 4252365427605073040, 4302081532634295440}, __mask_was_saved = 0, __saved_mask = {__val = {0 <repeats 16 times>}}}}}
        catchp = 0x7fa40711b870
        old = <optimized out>
#12 0x00007fa406fa6de9 in _dl_open (file=0x7fa4061aa746 "libgcc_s.so.1", mode=-2147483647, caller_dlopen=0x7fa406133b45 <init+21>, nsid=-2, argc=<optimized out>, argv=<optimized out>, env=0x7fffb93ddea0) at dl-open.c:660
        args = {file = 0x7fa4061aa746 "libgcc_s.so.1", mode = -2147483647, caller_dlopen = 0x7fa406133b45 <init+21>, caller_dl_open = 0x7fa40616166d <do_dlopen+61>, map = 0x0, nsid = 0, argc = 6, argv = 0x7fffb93dde68, env = 0x7fffb93ddea0}
        objname = 0x0
        errstring = 0x0
        malloced = false
        errcode = <optimized out>
        __PRETTY_FUNCTION__ = "_dl_open"
#13 0x00007fa40616166d in do_dlopen (ptr=ptr@entry=0x7fffb93dcb80) at dl-libc.c:87
        args = 0x7fffb93dcb80
#14 0x00007fa406fa25a4 in _dl_catch_error (objname=0x7fffb93dcb70, errstring=0x7fffb93dcb78, mallocedp=0x7fffb93dcb6f, operate=0x7fa406161630 <do_dlopen>, args=0x7fffb93dcb80) at dl-error.c:187
        errcode = 0
        c = {objname = 0x7fffb93dcb70, errstring = 0x7fffb93dcb78, malloced = 0x7fffb93dcb6f, errcode = 0x7fffb93dca5c, env = {{__jmpbuf = {0, 4252365427732999312, 140736301222864, 140342452368440, 6, 140736301223024, 4252365427686861968, 4302081532634295440}, __mask_was_saved = 0, __saved_mask = {__val = {0 <repeats 16 times>}}}}}
        catchp = 0x7fa40711b870
        old = <optimized out>
#15 0x00007fa406161724 in dlerror_run (args=0x7fffb93dcb80, operate=0x7fa406161630 <do_dlopen>) at dl-libc.c:46
        objname = 0x0
        last_errstring = 0x0
        malloced = false
        result = <optimized out>
#16 __GI___libc_dlopen_mode (name=name@entry=0x7fa4061aa746 "libgcc_s.so.1", mode=mode@entry=-2147483647) at dl-libc.c:163
        args = {name = 0x7fa4061aa746 "libgcc_s.so.1", mode = -2147483647, caller_dlopen = 0x7fa406133b45 <init+21>, map = 0x0}
#17 0x00007fa406133b45 in init () at ../sysdeps/x86_64/backtrace.c:52
No locals.
#18 0x00007fa4063f6a99 in __pthread_once_slow (once_control=0x7fa4063e6110 <once>, init_routine=0x7fa406133b30 <init>) at pthread_once.c:116
        _buffer = {__routine = 0x7fa4063f6ae0 <clear_once_control>, __arg = 0x7fa4063e6110 <once>, __canceltype = 0, __prev = 0x0}
        val = 0
        newval = <optimized out>
#19 0x00007fa406133c64 in __GI___backtrace (array=<optimized out>, size=<optimized out>) at ../sysdeps/x86_64/backtrace.c:105
        __p = <optimized out>
        arg = {array = 0x7fffb93dcc70, cfa = 0, cnt = -1, size = 64}
        once = 5
#20 0x00007fa406c9b0e7 in zlog_backtrace_sigsafe () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#21 0x00007fa406c9b2dd in zlog_signal () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#22 0x00007fa406cc2635 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#23 <signal handler called>
No locals.
#24 0x00007fa406053438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
        resultvar = 0
        pid = 16196
        selftid = 16196
#25 0x00007fa40605503a in __GI_abort () at abort.c:89
        save_stage = 2
        act = {__sigaction_handler = {sa_handler = 0x4, sa_sigaction = 0x4}, sa_mask = {__val = {39, 3107837712, 140736301225600, 17179869224, 140342470586368, 140342465678692, 83, 140342465678824, 94327451203328, 94327451202752, 140342452692364, 140342453789456, 140342453803104, 140736301225968, 140342453789456, 140342465678692}}, sa_flags = 119222272, sa_restorer = 0x7fa406d04d64}
        sigs = {__val = {32, 0 <repeats 15 times>}}
#26 0x00007fa40604bbe7 in __assert_fail_base (fmt=<optimized out>, assertion=assertion@entry=0x7fa406d04d64 "mt->n_alloc", file=file@entry=0x7fa406d04d57 "lib/memory.c", line=line@entry=83, function=function@entry=0x7fa406d04de8 "mt_count_free") at assert.c:92
        str = 0x55ca52263980 "\020O8R\312U"
        total = 4096
#27 0x00007fa40604bc92 in __GI___assert_fail (assertion=0x7fa406d04d64 "mt->n_alloc", file=0x7fa406d04d57 "lib/memory.c", line=83, function=0x7fa406d04de8 "mt_count_free") at assert.c:101
No locals.
#28 0x00007fa406c6a059 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#29 0x00007fa406c9ec32 in qfree () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#30 0x000055ca507d7826 in ?? ()
No symbol table info available.
#31 0x000055ca507d1fbc in ?? ()
No symbol table info available.
#32 0x00007fa406c8caca in hash_iterate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#33 0x000055ca507d27c0 in nhrp_cache_interface_del ()
No symbol table info available.
#34 0x000055ca507d3ee2 in ?? ()
No symbol table info available.
#35 0x00007fa406c8e565 in if_delete_retain () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#36 0x00007fa406c907b5 in if_delete () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#37 0x00007fa406c90985 in if_terminate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#38 0x00007fa406cd4c75 in vrf_delete () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#39 0x00007fa406cd4fbb in vrf_terminate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#40 0x000055ca507d52e5 in ?? ()
No symbol table info available.
#41 0x00007fa406cc29e3 in quagga_sigevent_process () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#42 0x00007fa406cd1e55 in thread_fetch () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#43 0x00007fa406c96de3 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#44 0x000055ca507d008a in main ()
No symbol table info available.
Dump of assembler code for function __GI___assert_fail:
   0x00007fa40604bc50 <+0>:	push   %r13
   0x00007fa40604bc52 <+2>:	push   %r12
   0x00007fa40604bc54 <+4>:	mov    %rcx,%r13
   0x00007fa40604bc57 <+7>:	push   %rbp
   0x00007fa40604bc58 <+8>:	push   %rbx
   0x00007fa40604bc59 <+9>:	mov    %rsi,%rbp
   0x00007fa40604bc5c <+12>:	mov    %rdi,%rbx
   0x00007fa40604bc5f <+15>:	lea    0x1626aa(%rip),%rsi        # 0x7fa4061ae310
   0x00007fa40604bc66 <+22>:	lea    0x15f013(%rip),%rdi        # 0x7fa4061aac80 <_libc_intl_domainname>
   0x00007fa40604bc6d <+29>:	mov    %edx,%r12d
   0x00007fa40604bc70 <+32>:	sub    $0x8,%rsp
   0x00007fa40604bc74 <+36>:	mov    $0x5,%edx
   0x00007fa40604bc79 <+41>:	callq  0x7fa40604c630 <__GI___dcgettext>
   0x00007fa40604bc7e <+46>:	mov    %r13,%r8
   0x00007fa40604bc81 <+49>:	mov    %r12d,%ecx
   0x00007fa40604bc84 <+52>:	mov    %rbp,%rdx
   0x00007fa40604bc87 <+55>:	mov    %rbx,%rsi
   0x00007fa40604bc8a <+58>:	mov    %rax,%rdi
   0x00007fa40604bc8d <+61>:	callq  0x7fa40604bad0 <__assert_fail_base>
End of assembler dump.
#28 0x00007fa406c6a059 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#29 0x00007fa406c9ec32 in qfree () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function qfree:
   0x00007fa406c9ebf0 <+0>:	push   %rbp
   0x00007fa406c9ebf1 <+1>:	test   %rsi,%rsi
   0x00007fa406c9ebf4 <+4>:	mov    %rsp,%rbp
   0x00007fa406c9ebf7 <+7>:	push   %r12
   0x00007fa406c9ebf9 <+9>:	mov    %rsi,%r12
   0x00007fa406c9ebfc <+12>:	push   %rbx
   0x00007fa406c9ebfd <+13>:	je     0x7fa406c9ec21 <qfree+49>
   0x00007fa406c9ebff <+15>:	mov    0x18(%rdi),%rdx
   0x00007fa406c9ec03 <+19>:	mov    %rdi,%rbx
   0x00007fa406c9ec06 <+22>:	lea    0x18(%rdi),%rax
   0x00007fa406c9ec0a <+26>:	test   %rdx,%rdx
   0x00007fa406c9ec0d <+29>:	je     0x7fa406c9ec2d <qfree+61>
   0x00007fa406c9ec0f <+31>:	lock subq $0x1,(%rax)
   0x00007fa406c9ec14 <+36>:	mov    %rsi,%rdi
   0x00007fa406c9ec17 <+39>:	callq  0x7fa406c69800
   0x00007fa406c9ec1c <+44>:	lock sub %rax,0x30(%rbx)
   0x00007fa406c9ec21 <+49>:	pop    %rbx
   0x00007fa406c9ec22 <+50>:	mov    %r12,%rdi
   0x00007fa406c9ec25 <+53>:	pop    %r12
   0x00007fa406c9ec27 <+55>:	pop    %rbp
   0x00007fa406c9ec28 <+56>:	jmpq   0x7fa406c694f8
   0x00007fa406c9ec2d <+61>:	callq  0x7fa406c6a036
End of assembler dump.
#30 0x000055ca507d7826 in ?? ()
#31 0x000055ca507d1fbc in ?? ()
#32 0x00007fa406c8caca in hash_iterate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function hash_iterate:
   0x00007fa406c8ca80 <+0>:	mov    0x8(%rdi),%eax
   0x00007fa406c8ca83 <+3>:	test   %eax,%eax
   0x00007fa406c8ca85 <+5>:	je     0x7fa406c8caea <hash_iterate+106>
   0x00007fa406c8ca87 <+7>:	push   %rbp
   0x00007fa406c8ca88 <+8>:	mov    %rsp,%rbp
   0x00007fa406c8ca8b <+11>:	push   %r15
   0x00007fa406c8ca8d <+13>:	push   %r14
   0x00007fa406c8ca8f <+15>:	push   %r13
   0x00007fa406c8ca91 <+17>:	push   %r12
   0x00007fa406c8ca93 <+19>:	mov    %rdi,%r15
   0x00007fa406c8ca96 <+22>:	push   %rbx
   0x00007fa406c8ca97 <+23>:	mov    %rsi,%r13
   0x00007fa406c8ca9a <+26>:	mov    %rdx,%r12
   0x00007fa406c8ca9d <+29>:	xor    %r14d,%r14d
   0x00007fa406c8caa0 <+32>:	sub    $0x8,%rsp
   0x00007fa406c8caa4 <+36>:	nopl   0x0(%rax)
   0x00007fa406c8caa8 <+40>:	mov    (%r15),%rdx
   0x00007fa406c8caab <+43>:	mov    %r14d,%eax
   0x00007fa406c8caae <+46>:	mov    (%rdx,%rax,8),%rdi
   0x00007fa406c8cab2 <+50>:	test   %rdi,%rdi
   0x00007fa406c8cab5 <+53>:	je     0x7fa406c8cad2 <hash_iterate+82>
   0x00007fa406c8cab7 <+55>:	nopw   0x0(%rax,%rax,1)
   0x00007fa406c8cac0 <+64>:	mov    0x8(%rdi),%rbx
   0x00007fa406c8cac4 <+68>:	mov    %r12,%rsi
   0x00007fa406c8cac7 <+71>:	callq  *%r13
=> 0x00007fa406c8caca <+74>:	test   %rbx,%rbx
   0x00007fa406c8cacd <+77>:	mov    %rbx,%rdi
   0x00007fa406c8cad0 <+80>:	jne    0x7fa406c8cac0 <hash_iterate+64>
   0x00007fa406c8cad2 <+82>:	add    $0x1,%r14d
   0x00007fa406c8cad6 <+86>:	cmp    %r14d,0x8(%r15)
   0x00007fa406c8cada <+90>:	ja     0x7fa406c8caa8 <hash_iterate+40>
   0x00007fa406c8cadc <+92>:	add    $0x8,%rsp
   0x00007fa406c8cae0 <+96>:	pop    %rbx
   0x00007fa406c8cae1 <+97>:	pop    %r12
   0x00007fa406c8cae3 <+99>:	pop    %r13
   0x00007fa406c8cae5 <+101>:	pop    %r14
   0x00007fa406c8cae7 <+103>:	pop    %r15
   0x00007fa406c8cae9 <+105>:	pop    %rbp
   0x00007fa406c8caea <+106>:	repz retq 
End of assembler dump.
54	../sysdeps/unix/sysv/linux/raise.c: No such file or directory.
No function contains program counter for selected frame.
No function contains program counter for selected frame.
No function contains program counter for selected frame.

r2: nhrpd crashed. Core file found - Backtrace follows:
[New LWP 16266]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/nhrpd --log file:nhrpd.log --log-level debug -d'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007fd264731438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
  Id   Target Id         Frame 
* 1    Thread 0x7fd2657f9880 (LWP 16266) 0x00007fd264731438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007fd264731438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
        resultvar = 0
        pid = 16266
        selftid = 16266
#1  0x00007fd26473303a in __GI_abort () at abort.c:89
        save_stage = 2
        act = {__sigaction_handler = {sa_handler = 0x0, sa_sigaction = 0x0}, sa_mask = {__val = {0 <repeats 14 times>, 88, 140725579391568}}, sa_flags = -9, sa_restorer = 0x7ffd3a2b9ff0}
        sigs = {__val = {32, 0 <repeats 15 times>}}
#2  0x00007fd2647737fa in __libc_message (do_abort=2, fmt=fmt@entry=0x7fd26488cf98 "*** Error in `%s': %s: 0x%s ***\n") at ../sysdeps/posix/libc_fatal.c:175
        ap = <error reading variable ap (Attempt to dereference a generic pointer.)>
        fd = 2
        on_2 = <optimized out>
        list = <optimized out>
        nlist = <optimized out>
        cp = <optimized out>
        written = <optimized out>
#3  0x00007fd26477a7d3 in malloc_printerr (ar_ptr=0x7fd264ac0b20 <main_arena>, ptr=0x55a5eded54d0, str=0x7fd264889d52 "corrupted double-linked list", action=<optimized out>) at malloc.c:5020
        buf = "000055a5eded54d0"
        cp = <optimized out>
        ar_ptr = 0x7fd264ac0b20 <main_arena>
        ptr = 0x55a5eded54d0
        str = 0x7fd264889d52 "corrupted double-linked list"
        action = <optimized out>
#4  malloc_consolidate (av=av@entry=0x7fd264ac0b20 <main_arena>) at malloc.c:4182
        fb = 0x7fd264ac0b38 <main_arena+24>
        maxfb = 0x7fd264ac0b70 <main_arena+80>
        p = 0x55a5eded54d0
        nextp = <optimized out>
        unsorted_bin = 0x7fd264ac0b78 <main_arena+88>
        first_unsorted = <optimized out>
        nextchunk = 0x55a5eded5540
        size = 112
        nextsize = 48
        prevsize = <optimized out>
        nextinuse = <optimized out>
        bck = <optimized out>
        fwd = <optimized out>
#5  0x00007fd26477dd0c in _int_malloc (av=av@entry=0x7fd264ac0b20 <main_arena>, bytes=bytes@entry=1182) at malloc.c:3457
        nb = 1200
        idx = 66
        bin = <optimized out>
        victim = <optimized out>
        size = <optimized out>
        victim_index = <optimized out>
        remainder = <optimized out>
        remainder_size = <optimized out>
        block = <optimized out>
        bit = <optimized out>
        map = <optimized out>
        fwd = <optimized out>
        bck = <optimized out>
        errstr = 0x0
        __func__ = "_int_malloc"
#6  0x00007fd264780e3a in __libc_calloc (n=<optimized out>, elem_size=<optimized out>) at malloc.c:3243
        av = 0x7fd264ac0b20 <main_arena>
        oldtop = 0x55a5edee2580
        p = <optimized out>
        bytes = 1182
        sz = 1182
        csz = <optimized out>
        oldtopsize = 133760
        mem = <optimized out>
        clearsize = <optimized out>
        nclears = <optimized out>
        d = <optimized out>
        hook = <optimized out>
        __func__ = "__libc_calloc"
#7  0x00007fd26567bc26 in _dl_new_object (realname=realname@entry=0x55a5eded99b0 "/lib/x86_64-linux-gnu/libgcc_s.so.1", libname=libname@entry=0x7fd264888746 "libgcc_s.so.1", type=type@entry=2, loader=loader@entry=0x0, mode=mode@entry=-1879048191, nsid=nsid@entry=0) at dl-object.c:75
        libname_len = 14
        new = <optimized out>
        newname = <optimized out>
        naudit = 0
        audit_space = 0
        idx = <optimized out>
#8  0x00007fd26567653d in _dl_map_object_from_fd (name=name@entry=0x7fd264888746 "libgcc_s.so.1", origname=origname@entry=0x0, fd=17, fbp=fbp@entry=0x7ffd3a2ba660, realname=0x55a5eded99b0 "/lib/x86_64-linux-gnu/libgcc_s.so.1", loader=loader@entry=0x0, l_type=2, mode=-1879048191, stack_endp=0x7ffd3a2ba658, nsid=0) at dl-load.c:1028
        l = <optimized out>
        header = 0x7ffd3a2ba668
        phdr = <optimized out>
        ph = <optimized out>
        maplength = <optimized out>
        type = <optimized out>
        errstring = 0x0
        errval = 0
        r = 0x7fd265897140 <_r_debug>
        make_consistent = true
        id = {dev = 64768, ino = 521752}
        __PRETTY_FUNCTION__ = "_dl_map_object_from_fd"
        stack_flags = <optimized out>
#9  0x00007fd265678c57 in _dl_map_object (loader=0x0, loader@entry=0x7fd2658879d8, name=name@entry=0x7fd264888746 "libgcc_s.so.1", type=type@entry=2, trace_mode=trace_mode@entry=0, mode=mode@entry=-1879048191, nsid=<optimized out>) at dl-load.c:2498
        fd = <optimized out>
        origname = <optimized out>
        realname = 0x55a5eded99b0 "/lib/x86_64-linux-gnu/libgcc_s.so.1"
        name_copy = <optimized out>
        l = <optimized out>
        fb = {len = 832, buf = "\177ELF\002\001\001\000\000\000\000\000\000\000\000\000\003\000>\000\001\000\000\000p*\000\000\000\000\000\000@\000\000\000\000\000\000\000`W\001\000\000\000\000\000\000\000\000\000@\000\070\000\006\000@\000\034\000\033\000\001\000\000\000\005", '\000' <repeats 27 times>, "\214R\001\000\000\000\000\000\214R\001\000\000\000\000\000\000\000 \000\000\000\000\000\001\000\000\000\006\000\000\000\220R\001\000\000\000\000\000\220R!\000\000\000\000\000\220R!\000\000\000\000\000\300\003\000\000\000\000\000\000\200\006\000\000\000\000\000\000\000\000 \000\000\000\000\000\002\000\000\000\006\000\000\000\260R\001\000\000\000\000\000\260R!\000\000\000\000\000"...}
        __PRETTY_FUNCTION__ = "_dl_map_object"
        found_other_class = false
        stack_end = 0x7ffd3a2bc130
#10 0x00007fd2656855b7 in dl_open_worker (a=a@entry=0x7ffd3a2bac20) at dl-open.c:237
        args = 0x7ffd3a2bac20
        file = 0x7fd264888746 "libgcc_s.so.1"
        mode = -2147483647
        call_map = 0x7fd2658879d8
        dst = <optimized out>
        new = <optimized out>
        __PRETTY_FUNCTION__ = "dl_open_worker"
        r = <optimized out>
        reloc_mode = <optimized out>
        nmaps = <optimized out>
        l = <optimized out>
        maps = <optimized out>
        relocation_in_progress = <optimized out>
        any_tls = <optimized out>
        first_static_tls = <optimized out>
#11 0x00007fd2656805a4 in _dl_catch_error (objname=objname@entry=0x7ffd3a2bac10, errstring=errstring@entry=0x7ffd3a2bac18, mallocedp=mallocedp@entry=0x7ffd3a2bac0f, operate=operate@entry=0x7fd265685510 <dl_open_worker>, args=args@entry=0x7ffd3a2bac20) at dl-error.c:187
        errcode = 0
        c = {objname = 0x7ffd3a2bac10, errstring = 0x7ffd3a2bac18, malloced = 0x7ffd3a2bac0f, errcode = 0x7ffd3a2baaec, env = {{__jmpbuf = {140725579394336, 8192687188270409238, 2147483649, 140541606528838, 140541606042437, 140541623361600, 8192687188069082646, 8209212267441579542}, __mask_was_saved = 0, __saved_mask = {__val = {0 <repeats 16 times>}}}}}
        catchp = 0x7fd2657f9870
        old = <optimized out>
#12 0x00007fd265684de9 in _dl_open (file=0x7fd264888746 "libgcc_s.so.1", mode=-2147483647, caller_dlopen=0x7fd264811b45 <init+21>, nsid=-2, argc=<optimized out>, argv=<optimized out>, env=0x7ffd3a2bc170) at dl-open.c:660
        args = {file = 0x7fd264888746 "libgcc_s.so.1", mode = -2147483647, caller_dlopen = 0x7fd264811b45 <init+21>, caller_dl_open = 0x7fd26483f66d <do_dlopen+61>, map = 0x0, nsid = 0, argc = 6, argv = 0x7ffd3a2bc138, env = 0x7ffd3a2bc170}
        objname = 0x0
        errstring = 0x0
        malloced = false
        errcode = <optimized out>
        __PRETTY_FUNCTION__ = "_dl_open"
#13 0x00007fd26483f66d in do_dlopen (ptr=ptr@entry=0x7ffd3a2bae40) at dl-libc.c:87
        args = 0x7ffd3a2bae40
#14 0x00007fd2656805a4 in _dl_catch_error (objname=0x7ffd3a2bae30, errstring=0x7ffd3a2bae38, mallocedp=0x7ffd3a2bae2f, operate=0x7fd26483f630 <do_dlopen>, args=0x7ffd3a2bae40) at dl-error.c:187
        errcode = 0
        c = {objname = 0x7ffd3a2bae30, errstring = 0x7ffd3a2bae38, malloced = 0x7ffd3a2bae2f, errcode = 0x7ffd3a2bad1c, env = {{__jmpbuf = {0, 8192687188213786134, 140725579394704, 140541605123128, 6, 140725579394864, 8192687188259923478, 8209212267441579542}, __mask_was_saved = 0, __saved_mask = {__val = {0 <repeats 16 times>}}}}}
        catchp = 0x7fd2657f9870
        old = <optimized out>
#15 0x00007fd26483f724 in dlerror_run (args=0x7ffd3a2bae40, operate=0x7fd26483f630 <do_dlopen>) at dl-libc.c:46
        objname = 0x0
        last_errstring = 0x0
        malloced = false
        result = <optimized out>
#16 __GI___libc_dlopen_mode (name=name@entry=0x7fd264888746 "libgcc_s.so.1", mode=mode@entry=-2147483647) at dl-libc.c:163
        args = {name = 0x7fd264888746 "libgcc_s.so.1", mode = -2147483647, caller_dlopen = 0x7fd264811b45 <init+21>, map = 0x0}
#17 0x00007fd264811b45 in init () at ../sysdeps/x86_64/backtrace.c:52
No locals.
#18 0x00007fd264ad4a99 in __pthread_once_slow (once_control=0x7fd264ac4110 <once>, init_routine=0x7fd264811b30 <init>) at pthread_once.c:116
        _buffer = {__routine = 0x7fd264ad4ae0 <clear_once_control>, __arg = 0x7fd264ac4110 <once>, __canceltype = 0, __prev = 0x0}
        val = 0
        newval = <optimized out>
#19 0x00007fd264811c64 in __GI___backtrace (array=<optimized out>, size=<optimized out>) at ../sysdeps/x86_64/backtrace.c:105
        __p = <optimized out>
        arg = {array = 0x7ffd3a2baf30, cfa = 0, cnt = -1, size = 64}
        once = 5
#20 0x00007fd2653790e7 in zlog_backtrace_sigsafe () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#21 0x00007fd2653792dd in zlog_signal () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#22 0x00007fd2653a0635 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#23 <signal handler called>
No locals.
#24 0x00007fd264731438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
        resultvar = 0
        pid = 16266
        selftid = 16266
#25 0x00007fd26473303a in __GI_abort () at abort.c:89
        save_stage = 2
        act = {__sigaction_handler = {sa_handler = 0x4, sa_sigaction = 0x4}, sa_mask = {__val = {40, 975944160, 140725579397456, 17179869225, 140541623341056, 140541618433380, 83, 140541618433512, 94171149768544, 94171148210656, 140541605447052, 140541606544144, 140541606557792, 140725579397824, 140541606544144, 140541618433380}}, sa_flags = 1703481344, sa_restorer = 0x7fd2653e2d64}
        sigs = {__val = {32, 0 <repeats 15 times>}}
#26 0x00007fd264729be7 in __assert_fail_base (fmt=<optimized out>, assertion=assertion@entry=0x7fd2653e2d64 "mt->n_alloc", file=file@entry=0x7fd2653e2d57 "lib/memory.c", line=line@entry=83, function=function@entry=0x7fd2653e2de8 "mt_count_free") at assert.c:92
        str = 0x55a5eddb9980 ""
        total = 4096
#27 0x00007fd264729c92 in __GI___assert_fail (assertion=0x7fd2653e2d64 "mt->n_alloc", file=0x7fd2653e2d57 "lib/memory.c", line=83, function=0x7fd2653e2de8 "mt_count_free") at assert.c:101
No locals.
#28 0x00007fd265348059 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#29 0x00007fd26537cc32 in qfree () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#30 0x000055a5ebba4826 in ?? ()
No symbol table info available.
#31 0x000055a5ebb9efbc in ?? ()
No symbol table info available.
#32 0x00007fd26536aaca in hash_iterate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#33 0x000055a5ebb9f7c0 in nhrp_cache_interface_del ()
No symbol table info available.
#34 0x000055a5ebba0ee2 in ?? ()
No symbol table info available.
#35 0x00007fd26536c565 in if_delete_retain () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#36 0x00007fd26536e7b5 in if_delete () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#37 0x00007fd26536e985 in if_terminate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#38 0x00007fd2653b2c75 in vrf_delete () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#39 0x00007fd2653b2fbb in vrf_terminate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#40 0x000055a5ebba22e5 in ?? ()
No symbol table info available.
#41 0x00007fd2653a09e3 in quagga_sigevent_process () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#42 0x00007fd2653afe55 in thread_fetch () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#43 0x00007fd265374de3 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#44 0x000055a5ebb9d08a in main ()
No symbol table info available.
Dump of assembler code for function __GI___assert_fail:
   0x00007fd264729c50 <+0>:	push   %r13
   0x00007fd264729c52 <+2>:	push   %r12
   0x00007fd264729c54 <+4>:	mov    %rcx,%r13
   0x00007fd264729c57 <+7>:	push   %rbp
   0x00007fd264729c58 <+8>:	push   %rbx
   0x00007fd264729c59 <+9>:	mov    %rsi,%rbp
   0x00007fd264729c5c <+12>:	mov    %rdi,%rbx
   0x00007fd264729c5f <+15>:	lea    0x1626aa(%rip),%rsi        # 0x7fd26488c310
   0x00007fd264729c66 <+22>:	lea    0x15f013(%rip),%rdi        # 0x7fd264888c80 <_libc_intl_domainname>
   0x00007fd264729c6d <+29>:	mov    %edx,%r12d
   0x00007fd264729c70 <+32>:	sub    $0x8,%rsp
   0x00007fd264729c74 <+36>:	mov    $0x5,%edx
   0x00007fd264729c79 <+41>:	callq  0x7fd26472a630 <__GI___dcgettext>
   0x00007fd264729c7e <+46>:	mov    %r13,%r8
   0x00007fd264729c81 <+49>:	mov    %r12d,%ecx
   0x00007fd264729c84 <+52>:	mov    %rbp,%rdx
   0x00007fd264729c87 <+55>:	mov    %rbx,%rsi
   0x00007fd264729c8a <+58>:	mov    %rax,%rdi
   0x00007fd264729c8d <+61>:	callq  0x7fd264729ad0 <__assert_fail_base>
End of assembler dump.
#28 0x00007fd265348059 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
#29 0x00007fd26537cc32 in qfree () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function qfree:
   0x00007fd26537cbf0 <+0>:	push   %rbp
   0x00007fd26537cbf1 <+1>:	test   %rsi,%rsi
   0x00007fd26537cbf4 <+4>:	mov    %rsp,%rbp
   0x00007fd26537cbf7 <+7>:	push   %r12
   0x00007fd26537cbf9 <+9>:	mov    %rsi,%r12
   0x00007fd26537cbfc <+12>:	push   %rbx
   0x00007fd26537cbfd <+13>:	je     0x7fd26537cc21 <qfree+49>
   0x00007fd26537cbff <+15>:	mov    0x18(%rdi),%rdx
   0x00007fd26537cc03 <+19>:	mov    %rdi,%rbx
   0x00007fd26537cc06 <+22>:	lea    0x18(%rdi),%rax
   0x00007fd26537cc0a <+26>:	test   %rdx,%rdx
   0x00007fd26537cc0d <+29>:	je     0x7fd26537cc2d <qfree+61>
   0x00007fd26537cc0f <+31>:	lock subq $0x1,(%rax)
   0x00007fd26537cc14 <+36>:	mov    %rsi,%rdi
   0x00007fd26537cc17 <+39>:	callq  0x7fd265347800
   0x00007fd26537cc1c <+44>:	lock sub %rax,0x30(%rbx)
   0x00007fd26537cc21 <+49>:	pop    %rbx
   0x00007fd26537cc22 <+50>:	mov    %r12,%rdi
   0x00007fd26537cc25 <+53>:	pop    %r12
   0x00007fd26537cc27 <+55>:	pop    %rbp
   0x00007fd26537cc28 <+56>:	jmpq   0x7fd2653474f8
   0x00007fd26537cc2d <+61>:	callq  0x7fd265348036
End of assembler dump.
#30 0x000055a5ebba4826 in ?? ()
#31 0x000055a5ebb9efbc in ?? ()
#32 0x00007fd26536aaca in hash_iterate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function hash_iterate:
   0x00007fd26536aa80 <+0>:	mov    0x8(%rdi),%eax
   0x00007fd26536aa83 <+3>:	test   %eax,%eax
   0x00007fd26536aa85 <+5>:	je     0x7fd26536aaea <hash_iterate+106>
   0x00007fd26536aa87 <+7>:	push   %rbp
   0x00007fd26536aa88 <+8>:	mov    %rsp,%rbp
   0x00007fd26536aa8b <+11>:	push   %r15
   0x00007fd26536aa8d <+13>:	push   %r14
   0x00007fd26536aa8f <+15>:	push   %r13
   0x00007fd26536aa91 <+17>:	push   %r12
   0x00007fd26536aa93 <+19>:	mov    %rdi,%r15
   0x00007fd26536aa96 <+22>:	push   %rbx
   0x00007fd26536aa97 <+23>:	mov    %rsi,%r13
   0x00007fd26536aa9a <+26>:	mov    %rdx,%r12
   0x00007fd26536aa9d <+29>:	xor    %r14d,%r14d
   0x00007fd26536aaa0 <+32>:	sub    $0x8,%rsp
   0x00007fd26536aaa4 <+36>:	nopl   0x0(%rax)
   0x00007fd26536aaa8 <+40>:	mov    (%r15),%rdx
   0x00007fd26536aaab <+43>:	mov    %r14d,%eax
   0x00007fd26536aaae <+46>:	mov    (%rdx,%rax,8),%rdi
   0x00007fd26536aab2 <+50>:	test   %rdi,%rdi
   0x00007fd26536aab5 <+53>:	je     0x7fd26536aad2 <hash_iterate+82>
   0x00007fd26536aab7 <+55>:	nopw   0x0(%rax,%rax,1)
   0x00007fd26536aac0 <+64>:	mov    0x8(%rdi),%rbx
   0x00007fd26536aac4 <+68>:	mov    %r12,%rsi
   0x00007fd26536aac7 <+71>:	callq  *%r13
=> 0x00007fd26536aaca <+74>:	test   %rbx,%rbx
   0x00007fd26536aacd <+77>:	mov    %rbx,%rdi
   0x00007fd26536aad0 <+80>:	jne    0x7fd26536aac0 <hash_iterate+64>
   0x00007fd26536aad2 <+82>:	add    $0x1,%r14d
   0x00007fd26536aad6 <+86>:	cmp    %r14d,0x8(%r15)
   0x00007fd26536aada <+90>:	ja     0x7fd26536aaa8 <hash_iterate+40>
   0x00007fd26536aadc <+92>:	add    $0x8,%rsp
   0x00007fd26536aae0 <+96>:	pop    %rbx
   0x00007fd26536aae1 <+97>:	pop    %r12
   0x00007fd26536aae3 <+99>:	pop    %r13
   0x00007fd26536aae5 <+101>:	pop    %r14
   0x00007fd26536aae7 <+103>:	pop    %r15
   0x00007fd26536aae9 <+105>:	pop    %rbp
   0x00007fd26536aaea <+106>:	repz retq 
End of assembler dump.

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17898/artifact/TOPOU1604/ErrorLog/log_topotests.txt

Addresssanitizer topotests part 0: Failed (click for details)

Addresssanitizer topotests part 0: Unknown Log URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17898/artifact/ASAN3/AddressSanitizerError/AddressSanitzer.txt Addresssanitizer topotests part 0: No useful log found

Topotests Ubuntu 18.04 amd64 part 0: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1804-17898/test

Topology Tests failed for Topotests Ubuntu 18.04 amd64 part 0
see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17898/artifact/TOPOU1804/ErrorLog/log_topotests.txt

Topotests Ubuntu 16.04 i386 part 0: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOI386-17898/test

Topology Tests failed for Topotests Ubuntu 16.04 i386 part 0:

No function contains program counter for selected frame.
No function contains program counter for selected frame.
No function contains program counter for selected frame.

r1: nhrpd crashed. Core file found - Backtrace follows:
[New LWP 12695]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/nhrpd --log file:nhrpd.log --log-level debug -d'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f80cf5 in ?? ()
  Id   Target Id         Frame 
* 1    Thread 0xb78477c0 (LWP 12695) 0xb7f80cf5 in ?? ()
#0  0xb7f80cf5 in ?? ()
No symbol table info available.
#1  0xb7cac307 in malloc_printerr (action=<optimized out>, str=0xb7d9ba26 "corrupted double-linked list", ptr=<optimized out>, ar_ptr=0xb7df2780 <main_arena>) at malloc.c:5020
        buf = "016fadf8"
        cp = <optimized out>
        ar_ptr = 0xb7df2780 <main_arena>
        ptr = <optimized out>
        str = 0xb7d9ba26 "corrupted double-linked list"
        action = <optimized out>
#2  0xb7cac6b4 in malloc_consolidate (av=av@entry=0xb7df2780 <main_arena>) at malloc.c:4190
        fb = 0xb7df2790 <main_arena+16>
        maxfb = 0xb7df27ac <main_arena+44>
        p = 0x16fadd8
        nextp = 0x16fadb8
        unsorted_bin = 0xb7df27b0 <main_arena+48>
        first_unsorted = <optimized out>
        nextchunk = 0x16fadf8
        size = 384
        nextsize = <optimized out>
        prevsize = <optimized out>
        nextinuse = <optimized out>
        bck = <optimized out>
        fwd = 0x16fbcc8
#3  0xb7cae1e3 in _int_malloc (av=av@entry=0xb7df2780 <main_arena>, bytes=bytes@entry=1910) at malloc.c:3457
        nb = 1920
        idx = <optimized out>
        bin = <optimized out>
        victim = <optimized out>
        size = <optimized out>
        victim_index = <optimized out>
        remainder = <optimized out>
        remainder_size = <optimized out>
        block = <optimized out>
        bit = <optimized out>
        map = <optimized out>
        fwd = <optimized out>
        bck = <optimized out>
        errstr = 0x0
        __func__ = "_int_malloc"
#4  0xb7cb0085 in __GI___libc_malloc (bytes=1910) at malloc.c:2920
        ar_ptr = 0xb7df2780 <main_arena>
        victim = <optimized out>
        hook = <optimized out>
        __func__ = "__libc_malloc"
#5  0xb7d33904 in __backtrace_symbols (array=0xbf8a58fc, size=29) at backtracesyms.c:69
        info = {{dli_fname = 0xb7f7c250 "/usr/lib/i386-linux-gnu/frr/libfrr.so.0", dli_fbase = 0xb7e38000, dli_sname = 0xb7e457b6 "zlog_backtrace_sigsafe", dli_saddr = 0xb7e90960 <zlog_backtrace_sigsafe>}, {dli_fname = 0xb7f7c250 "/usr/lib/i386-linux-gnu/frr/libfrr.so.0", dli_fbase = 0xb7e38000, dli_sname = 0xb7e457ec "zlog_signal", dli_saddr = 0xb7e90af0 <zlog_signal>}, {dli_fname = 0xb7f7c250 "/usr/lib/i386-linux-gnu/frr/libfrr.so.0", dli_fbase = 0xb7e38000, dli_sname = 0x0, dli_saddr = 0x0}, {dli_fname = 0xb7fa6e74 "", dli_fbase = 0xb7f80000, dli_sname = 0xb7f8021b "__kernel_rt_sigreturn", dli_saddr = 0xb7f80d0c}, {dli_fname = 0xb7fa6e74 "", dli_fbase = 0xb7f80000, dli_sname = 0xb7f801d6 "__kernel_vsyscall", dli_saddr = 0xb7f80cec}, {dli_fname = 0xb7e132a8 "/lib/i386-linux-gnu/libc.so.6", dli_fbase = 0xb7c3f000, dli_sname = 0xb7c4f61e "gsignal", dli_saddr = 0xb7c6ae80 <__GI_raise>}, {dli_fname = 0xb7e132a8 "/lib/i386-linux-gnu/libc.so.6", dli_fbase = 0xb7c3f000, dli_sname = 0xb7c4c95d "abort", dli_saddr = 0xb7c6c2c0 <__GI_abort>}, {dli_fname = 0xb7e132a8 "/lib/i386-linux-gnu/libc.so.6", dli_fbase = 0xb7c3f000, dli_sname = 0x0, dli_saddr = 0x0}, {dli_fname = 0xb7e132a8 "/lib/i386-linux-gnu/libc.so.6", dli_fbase = 0xb7c3f000, dli_sname = 0x0, dli_saddr = 0x0}, {dli_fname = 0xb7f7c250 "/usr/lib/i386-linux-gnu/frr/libfrr.so.0", dli_fbase = 0xb7e38000, dli_sname = 0x0, dli_saddr = 0x0}, {dli_fname = 0xb7f7c250 "/usr/lib/i386-linux-gnu/frr/libfrr.so.0", dli_fbase = 0xb7e38000, dli_sname = 0x0, dli_saddr = 0x0}, {dli_fname = 0xbf8a72c1 "/usr/lib/frr/nhrpd", dli_fbase = 0x404000, dli_sname = 0x0, dli_saddr = 0x0}, {dli_fname = 0xbf8a72c1 "/usr/lib/frr/nhrpd", dli_fbase = 0x404000, dli_sname = 0x0, dli_saddr = 0x0}, {dli_fname = 0xbf8a72c1 "/usr/lib/frr/nhrpd", dli_fbase = 0x404000, dli_sname = 0x0, dli_saddr = 0x0}, {dli_fname = 0xb7f7c250 "/usr/lib/i386-linux-gnu/frr/libfrr.so.0", dli_fbase = 0xb7e38000, dli_sname = 0xb7e44553 "hash_iterate", dli_saddr = 0xb7e818b0 <hash_iterate>}, {dli_fname = 0xbf8a72c1 "/usr/lib/frr/nhrpd", dli_fbase = 0x404000, dli_sname = 0x4068ea "nhrp_cache_interface_del", dli_saddr = 0x40d480 <nhrp_cache_interface_del>}, {dli_fname = 0xbf8a72c1 "/usr/lib/frr/nhrpd", dli_fbase = 0x404000, dli_sname = 0x0, dli_saddr = 0x0}, {dli_fname = 0xb7f7c250 "/usr/lib/i386-linux-gnu/frr/libfrr.so.0", dli_fbase = 0xb7e38000, dli_sname = 0xb7e447a5 "if_delete_retain", dli_saddr = 0xb7e83500 <if_delete_retain>}, {dli_fname = 0xb7f7c250 "/usr/lib/i386-linux-gnu/frr/libfrr.so.0", dli_fbase = 0xb7e38000, dli_sname = 0xb7e44b43 "if_delete", dli_saddr = 0xb7e85a10 <if_delete>}, {dli_fname = 0xb7f7c250 "/usr/lib/i386-linux-gnu/frr/libfrr.so.0", dli_fbase = 0xb7e38000, dli_sname = 0xb7e44b61 "if_terminate", dli_saddr = 0xb7e85bf0 <if_terminate>}, {dli_fname = 0xb7f7c250 "/usr/lib/i386-linux-gnu/frr/libfrr.so.0", dli_fbase = 0xb7e38000, dli_sname = 0xb7e48bcc "vrf_delete", dli_saddr = 0xb7ecc550 <vrf_delete>}, {dli_fname = 0xb7f7c250 "/usr/lib/i386-linux-gnu/frr/libfrr.so.0", dli_fbase = 0xb7e38000, dli_sname = 0xb7e48c47 "vrf_terminate", dli_saddr = 0xb7ecc9b0 <vrf_terminate>}, {dli_fname = 0xbf8a72c1 "/usr/lib/frr/nhrpd", dli_fbase = 0x404000, dli_sname = 0x0, dli_saddr = 0x0}, {dli_fname = 0xb7f7c250 "/usr/lib/i386-linux-gnu/frr/libfrr.so.0", dli_fbase = 0xb7e38000, dli_sname = 0xb7e47c18 "quagga_sigevent_process", dli_saddr = 0xb7eba340 <quagga_sigevent_process>}, {dli_fname = 0xb7f7c250 "/usr/lib/i386-linux-gnu/frr/libfrr.so.0", dli_fbase = 0xb7e38000, dli_sname = 0xb7e44342 "thread_fetch", dli_saddr = 0xb7ec9130 <thread_fetch>}, {dli_fname = 0xb7f7c250 "/usr/lib/i386-linux-gnu/frr/libfrr.so.0", dli_fbase = 0xb7e38000, dli_sname = 0xb7e4532e "frr_run", dli_saddr = 0xb7e8c200 <frr_run>}, {dli_fname = 0xbf8a72c1 "/usr/lib/frr/nhrpd", dli_fbase = 0x404000, dli_sname = 0x40625a "main", dli_saddr = 0x40aca0 <main>}, {dli_fname = 0xb7e132a8 "/lib/i386-linux-gnu/libc.so.6", dli_fbase = 0xb7c3f000, dli_sname = 0xb7c4f18e "__libc_start_main", dli_saddr = 0xb7c57550 <__libc_start_main>}, {dli_fname = 0xbf8a72c1 "/usr/lib/frr/nhrpd", dli_fbase = 0x404000, dli_sname = 0x0, dli_saddr = 0x0}}
        status = {1 <repeats 29 times>}
        cnt = <optimized out>
        total = <optimized out>
        result = <optimized out>
        __PRETTY_FUNCTION__ = "__backtrace_symbols"
#6  0xb7e90a32 in zlog_backtrace_sigsafe () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#7  0xb7e90bde in zlog_signal () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#8  0xb7eba044 in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#9  <signal handler called>
No symbol table info available.
#10 0xb7f80cf5 in ?? ()
No symbol table info available.
#11 0xb7e94725 in qfree () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#12 0x00417670 in ?? ()
No symbol table info available.
#13 0x004122da in ?? ()
No symbol table info available.
#14 0x0040cc5f in ?? ()
No symbol table info available.
#15 0xb7e818ea in hash_iterate () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#16 0x0040d4bd in nhrp_cache_interface_del ()
No symbol table info available.
#17 0x0040ead5 in ?? ()
No symbol table info available.
#18 0xb7e83536 in if_delete_retain () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#19 0xb7e85a70 in if_delete () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#20 0xb7e85c7b in if_terminate () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#21 0xb7ecc5fa in vrf_delete () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#22 0xb7ecc9f6 in vrf_terminate () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#23 0x0040fed3 in ?? ()
No symbol table info available.
#24 0xb7eba3a1 in quagga_sigevent_process () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#25 0xb7ec986d in thread_fetch () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#26 0xb7e8c2e6 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#27 0x0040adaa in main ()
No symbol table info available.
Dump of assembler code for function __backtrace_symbols:
   0xb7d33810 <+0>:	push   %ebp
   0xb7d33811 <+1>:	call   0xb7d5ec59 <__x86.get_pc_thunk.ax>
   0xb7d33816 <+6>:	add    $0xbe7ea,%eax
   0xb7d3381b <+11>:	mov    %esp,%ebp
   0xb7d3381d <+13>:	push   %edi
   0xb7d3381e <+14>:	push   %esi
   0xb7d3381f <+15>:	push   %ebx
   0xb7d33820 <+16>:	sub    $0x4c,%esp
   0xb7d33823 <+19>:	mov    %eax,-0x34(%ebp)
   0xb7d33826 <+22>:	mov    0xc(%ebp),%eax
   0xb7d33829 <+25>:	mov    0xc(%ebp),%ecx
   0xb7d3382c <+28>:	shl    $0x4,%eax
   0xb7d3382f <+31>:	add    $0x10,%eax
   0xb7d33832 <+34>:	sub    %eax,%esp
   0xb7d33834 <+36>:	mov    0xc(%ebp),%eax
   0xb7d33837 <+39>:	mov    %esp,%edx
   0xb7d33839 <+41>:	shl    $0x2,%eax
   0xb7d3383c <+44>:	mov    %eax,-0x3c(%ebp)
   0xb7d3383f <+47>:	add    $0x12,%eax
   0xb7d33842 <+50>:	and    $0xfffffff0,%eax
   0xb7d33845 <+53>:	sub    %eax,%esp
   0xb7d33847 <+55>:	test   %ecx,%ecx
   0xb7d33849 <+57>:	mov    %esp,-0x2c(%ebp)
   0xb7d3384c <+60>:	jle    0xb7d33a57 <__backtrace_symbols+583>
   0xb7d33852 <+66>:	lea    -0x1c(%ebp),%eax
   0xb7d33855 <+69>:	mov    %edx,%esi
   0xb7d33857 <+71>:	mov    %edx,-0x40(%ebp)
   0xb7d3385a <+74>:	xor    %edi,%edi
   0xb7d3385c <+76>:	xor    %ebx,%ebx
   0xb7d3385e <+78>:	mov    %eax,-0x30(%ebp)
   0xb7d33861 <+81>:	jmp    0xb7d338c0 <__backtrace_symbols+176>
   0xb7d33863 <+83>:	nop
   0xb7d33864 <+84>:	lea    0x0(%esi,%eiz,1),%esi
   0xb7d33868 <+88>:	mov    (%esi),%eax
   0xb7d3386a <+90>:	test   %eax,%eax
   0xb7d3386c <+92>:	je     0xb7d338e2 <__backtrace_symbols+210>
   0xb7d3386e <+94>:	cmpb   $0x0,(%eax)
   0xb7d33871 <+97>:	je     0xb7d338e2 <__backtrace_symbols+210>
   0xb7d33873 <+99>:	sub    $0xc,%esp
   0xb7d33876 <+102>:	push   %eax
   0xb7d33877 <+103>:	call   0xb7cb46a0 <__strlen_ia32>
   0xb7d3387c <+108>:	mov    %eax,%edx
   0xb7d3387e <+110>:	mov    0x8(%esi),%eax
   0xb7d33881 <+113>:	add    $0x10,%esp
   0xb7d33884 <+116>:	test   %eax,%eax
   0xb7d33886 <+118>:	je     0xb7d33a50 <__backtrace_symbols+576>
   0xb7d3388c <+124>:	sub    $0xc,%esp
   0xb7d3388f <+127>:	mov    %edx,-0x38(%ebp)
   0xb7d33892 <+130>:	push   %eax
   0xb7d33893 <+131>:	call   0xb7cb46a0 <__strlen_ia32>
   0xb7d33898 <+136>:	mov    -0x38(%ebp),%edx
   0xb7d3389b <+139>:	add    $0x10,%esp
   0xb7d3389e <+142>:	lea    0x1b(%edi,%edx,1),%edi
   0xb7d338a2 <+146>:	add    $0x1,%ebx
   0xb7d338a5 <+149>:	add    $0x10,%esi
   0xb7d338a8 <+152>:	add    %eax,%edi
   0xb7d338aa <+154>:	mov    -0x1c(%ebp),%eax
   0xb7d338ad <+157>:	mov    (%eax),%eax
   0xb7d338af <+159>:	mov    %eax,-0xc(%esi)
   0xb7d338b2 <+162>:	cmp    %ebx,0xc(%ebp)
   0xb7d338b5 <+165>:	je     0xb7d338f0 <__backtrace_symbols+224>
   0xb7d338b7 <+167>:	mov    %esi,%esi
   0xb7d338b9 <+169>:	lea    0x0(%edi,%eiz,1),%edi
   0xb7d338c0 <+176>:	mov    0x8(%ebp),%eax
   0xb7d338c3 <+179>:	sub    $0xc,%esp
   0xb7d338c6 <+182>:	mov    -0x30(%ebp),%ecx
   0xb7d338c9 <+185>:	mov    %esi,%edx
   0xb7d338cb <+187>:	mov    (%eax,%ebx,4),%eax
   0xb7d338ce <+190>:	push   $0x0
   0xb7d338d0 <+192>:	call   0xb7d5bc80 <__GI__dl_addr>
   0xb7d338d5 <+197>:	mov    -0x2c(%ebp),%ecx
   0xb7d338d8 <+200>:	add    $0xc,%esp
   0xb7d338db <+203>:	test   %eax,%eax
   0xb7d338dd <+205>:	mov    %eax,(%ecx,%ebx,4)
   0xb7d338e0 <+208>:	jne    0xb7d33868 <__backtrace_symbols+88>
   0xb7d338e2 <+210>:	add    $0xd,%edi
   0xb7d338e5 <+213>:	add    $0x1,%ebx
   0xb7d338e8 <+216>:	add    $0x10,%esi
   0xb7d338eb <+219>:	cmp    %ebx,0xc(%ebp)
   0xb7d338ee <+222>:	jne    0xb7d338c0 <__backtrace_symbols+176>
   0xb7d338f0 <+224>:	mov    -0x3c(%ebp),%esi
   0xb7d338f3 <+227>:	sub    $0xc,%esp
   0xb7d338f6 <+230>:	mov    -0x34(%ebp),%ebx
   0xb7d338f9 <+233>:	add    %esi,%edi
   0xb7d338fb <+235>:	push   %edi
   0xb7d338fc <+236>:	mov    %edi,-0x4c(%ebp)
   0xb7d338ff <+239>:	call   0xb7c56740
=> 0xb7d33904 <+244>:	mov    %eax,%edi
   0xb7d33906 <+246>:	lea    (%eax,%esi,1),%esi
   0xb7d33909 <+249>:	mov    -0x34(%ebp),%eax
   0xb7d3390c <+252>:	add    $0x10,%esp
   0xb7d3390f <+255>:	xor    %ebx,%ebx
   0xb7d33911 <+257>:	test   %edi,%edi
   0xb7d33913 <+259>:	lea    -0x5772e(%eax),%ecx
   0xb7d33919 <+265>:	lea    -0x54cc1(%eax),%eax
   0xb7d3391f <+271>:	mov    %ecx,-0x44(%ebp)
   0xb7d33922 <+274>:	mov    %eax,-0x48(%ebp)
   0xb7d33925 <+277>:	je     0xb7d339ec <__backtrace_symbols+476>
   0xb7d3392b <+283>:	mov    %edi,-0x30(%ebp)
   0xb7d3392e <+286>:	mov    %esi,%edi
   0xb7d33930 <+288>:	mov    -0x40(%ebp),%esi
   0xb7d33933 <+291>:	jmp    0xb7d33994 <__backtrace_symbols+388>
   0xb7d33935 <+293>:	lea    0x0(%esi),%esi
   0xb7d33938 <+296>:	mov    0x8(%esi),%ecx
   0xb7d3393b <+299>:	test   %ecx,%ecx
   0xb7d3393d <+301>:	mov    %ecx,-0x3c(%ebp)
   0xb7d33940 <+304>:	je     0xb7d33a10 <__backtrace_symbols+512>
   0xb7d33946 <+310>:	mov    0xc(%esi),%ecx
   0xb7d33949 <+313>:	mov    0x8(%ebp),%edx
   0xb7d3394c <+316>:	mov    (%edx,%ebx,4),%edx
   0xb7d3394f <+319>:	cmp    %ecx,%edx
   0xb7d33951 <+321>:	mov    %edx,-0x38(%ebp)
   0xb7d33954 <+324>:	jb     0xb7d33a00 <__backtrace_symbols+496>
   0xb7d3395a <+330>:	sub    %ecx,%edx
   0xb7d3395c <+332>:	mov    $0x2b,%ecx
   0xb7d33961 <+337>:	mov    %edx,-0x40(%ebp)
   0xb7d33964 <+340>:	mov    -0x3c(%ebp),%edx
   0xb7d33967 <+343>:	test   %edx,%edx
   0xb7d33969 <+345>:	cmove  -0x44(%ebp),%edx
   0xb7d3396d <+349>:	sub    $0x4,%esp
   0xb7d33970 <+352>:	pushl  -0x38(%ebp)
   0xb7d33973 <+355>:	pushl  -0x40(%ebp)
   0xb7d33976 <+358>:	push   %ecx
   0xb7d33977 <+359>:	push   %edx
   0xb7d33978 <+360>:	push   %eax
   0xb7d33979 <+361>:	pushl  -0x48(%ebp)
   0xb7d3397c <+364>:	push   %edi
   0xb7d3397d <+365>:	call   0xb7c886e0 <__sprintf>
   0xb7d33982 <+370>:	lea    0x1(%edi,%eax,1),%edi
   0xb7d33986 <+374>:	add    $0x20,%esp
   0xb7d33989 <+377>:	add    $0x1,%ebx
   0xb7d3398c <+380>:	add    $0x10,%esi
   0xb7d3398f <+383>:	cmp    %ebx,0xc(%ebp)
   0xb7d33992 <+386>:	je     0xb7d339da <__backtrace_symbols+458>
   0xb7d33994 <+388>:	mov    -0x30(%ebp),%eax
   0xb7d33997 <+391>:	mov    %edi,(%eax,%ebx,4)
   0xb7d3399a <+394>:	mov    -0x2c(%ebp),%eax
   0xb7d3399d <+397>:	mov    (%eax,%ebx,4),%eax
   0xb7d339a0 <+400>:	test   %eax,%eax
   0xb7d339a2 <+402>:	je     0xb7d339af <__backtrace_symbols+415>
   0xb7d339a4 <+404>:	mov    (%esi),%eax
   0xb7d339a6 <+406>:	test   %eax,%eax
   0xb7d339a8 <+408>:	je     0xb7d339af <__backtrace_symbols+415>
   0xb7d339aa <+410>:	cmpb   $0x0,(%eax)
   0xb7d339ad <+413>:	jne    0xb7d33938 <__backtrace_symbols+296>
   0xb7d339af <+415>:	mov    0x8(%ebp),%eax
   0xb7d339b2 <+418>:	sub    $0x4,%esp
   0xb7d339b5 <+421>:	add    $0x10,%esi
   0xb7d339b8 <+424>:	pushl  (%eax,%ebx,4)
   0xb7d339bb <+427>:	mov    -0x34(%ebp),%eax
   0xb7d339be <+430>:	add    $0x1,%ebx
   0xb7d339c1 <+433>:	lea    -0x54cd6(%eax),%eax
   0xb7d339c7 <+439>:	push   %eax
   0xb7d339c8 <+440>:	push   %edi
   0xb7d339c9 <+441>:	call   0xb7c886e0 <__sprintf>
   0xb7d339ce <+446>:	add    $0x10,%esp
   0xb7d339d1 <+449>:	cmp    %ebx,0xc(%ebp)
   0xb7d339d4 <+452>:	lea    0x1(%edi,%eax,1),%edi
   0xb7d339d8 <+456>:	jne    0xb7d33994 <__backtrace_symbols+388>
   0xb7d339da <+458>:	mov    %edi,%esi
   0xb7d339dc <+460>:	mov    -0x4c(%ebp),%eax
   0xb7d339df <+463>:	mov    -0x30(%ebp),%edi
   0xb7d339e2 <+466>:	add    %edi,%eax
   0xb7d339e4 <+468>:	cmp    %eax,%esi
   0xb7d339e6 <+470>:	ja     0xb7d33a6f <__backtrace_symbols+607>
   0xb7d339ec <+476>:	lea    -0xc(%ebp),%esp
   0xb7d339ef <+479>:	mov    %edi,%eax
   0xb7d339f1 <+481>:	pop    %ebx
   0xb7d339f2 <+482>:	pop    %esi
   0xb7d339f3 <+483>:	pop    %edi
   0xb7d339f4 <+484>:	pop    %ebp
   0xb7d339f5 <+485>:	ret    
   0xb7d339f6 <+486>:	lea    0x0(%esi),%esi
   0xb7d339f9 <+489>:	lea    0x0(%edi,%eiz,1),%edi
   0xb7d33a00 <+496>:	sub    -0x38(%ebp),%ecx
   0xb7d33a03 <+499>:	mov    %ecx,-0x40(%ebp)
   0xb7d33a06 <+502>:	mov    $0x2d,%ecx
   0xb7d33a0b <+507>:	jmp    0xb7d33964 <__backtrace_symbols+340>
   0xb7d33a10 <+512>:	mov    0x4(%esi),%ecx
   0xb7d33a13 <+515>:	test   %ecx,%ecx
   0xb7d33a15 <+517>:	mov    %ecx,0xc(%esi)
   0xb7d33a18 <+520>:	jne    0xb7d33949 <__backtrace_symbols+313>
   0xb7d33a1e <+526>:	mov    0x8(%ebp),%ecx
   0xb7d33a21 <+529>:	sub    $0xc,%esp
   0xb7d33a24 <+532>:	pushl  (%ecx,%ebx,4)
   0xb7d33a27 <+535>:	pushl  -0x44(%ebp)
   0xb7d33a2a <+538>:	push   %eax
   0xb7d33a2b <+539>:	mov    -0x34(%ebp),%eax
   0xb7d33a2e <+542>:	lea    -0x54cdd(%eax),%eax
   0xb7d33a34 <+548>:	push   %eax
   0xb7d33a35 <+549>:	push   %edi
   0xb7d33a36 <+550>:	call   0xb7c886e0 <__sprintf>
   0xb7d33a3b <+555>:	add    $0x20,%esp
   0xb7d33a3e <+558>:	lea    0x1(%edi,%eax,1),%edi
   0xb7d33a42 <+562>:	jmp    0xb7d33989 <__backtrace_symbols+377>
   0xb7d33a47 <+567>:	mov    %esi,%esi
   0xb7d33a49 <+569>:	lea    0x0(%edi,%eiz,1),%edi
   0xb7d33a50 <+576>:	xor    %eax,%eax
   0xb7d33a52 <+578>:	jmp    0xb7d3389e <__backtrace_symbols+142>
   0xb7d33a57 <+583>:	mov    -0x34(%ebp),%ebx
   0xb7d33a5a <+586>:	sub    $0xc,%esp
   0xb7d33a5d <+589>:	pushl  -0x3c(%ebp)
   0xb7d33a60 <+592>:	call   0xb7c56740
   0xb7d33a65 <+597>:	add    $0x10,%esp
   0xb7d33a68 <+600>:	mov    %eax,%edi
   0xb7d33a6a <+602>:	jmp    0xb7d339ec <__backtrace_symbols+476>
   0xb7d33a6f <+607>:	mov    -0x34(%ebp),%ecx
   0xb7d33a72 <+610>:	lea    -0x51344(%ecx),%eax
   0xb7d33a78 <+616>:	push   %eax
   0xb7d33a79 <+617>:	lea    -0x54cd1(%ecx),%eax
   0xb7d33a7f <+623>:	push   $0x73
   0xb7d33a81 <+625>:	push   %eax
   0xb7d33a82 <+626>:	lea    -0x51380(%ecx),%eax
   0xb7d33a88 <+632>:	push   %eax
   0xb7d33a89 <+633>:	call   0xb7c63d60 <__GI___assert_fail>
End of assembler dump.
#6  0xb7e90a32 in zlog_backtrace_sigsafe () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function zlog_backtrace_sigsafe:
   0xb7e90960 <+0>:	push   %ebp
   0xb7e90961 <+1>:	mov    %esp,%ebp
   0xb7e90963 <+3>:	push   %edi
   0xb7e90964 <+4>:	push   %esi
   0xb7e90965 <+5>:	push   %ebx
   0xb7e90966 <+6>:	call   0xb7e62640
   0xb7e9096b <+11>:	add    $0xd80a5,%ebx
   0xb7e90971 <+17>:	sub    $0x1c4,%esp
   0xb7e90977 <+23>:	movl   $0x80,-0x1a0(%ebp)
   0xb7e90981 <+33>:	mov    %gs:0x14,%eax
   0xb7e90987 <+39>:	mov    %eax,-0x1c(%ebp)
   0xb7e9098a <+42>:	xor    %eax,%eax
   0xb7e9098c <+44>:	lea    -0x9c(%ebp),%eax
   0xb7e90992 <+50>:	push   $0x40
   0xb7e90994 <+52>:	mov    %eax,-0x1b0(%ebp)
   0xb7e9099a <+58>:	mov    %eax,-0x1a8(%ebp)
   0xb7e909a0 <+64>:	mov    %eax,-0x1a4(%ebp)
   0xb7e909a6 <+70>:	lea    -0x19c(%ebp),%eax
   0xb7e909ac <+76>:	push   %eax
   0xb7e909ad <+77>:	mov    %eax,-0x1bc(%ebp)
   0xb7e909b3 <+83>:	call   0xb7e5ddc0
   0xb7e909b8 <+88>:	mov    %eax,-0x1ac(%ebp)
   0xb7e909be <+94>:	sub    $0x1,%eax
   0xb7e909c1 <+97>:	add    $0x10,%esp
   0xb7e909c4 <+100>:	cmp    $0x3f,%eax
   0xb7e909c7 <+103>:	jbe    0xb7e909e8 <zlog_backtrace_sigsafe+136>
   0xb7e909c9 <+105>:	mov    -0x1c(%ebp),%eax
   0xb7e909cc <+108>:	xor    %gs:0x14,%eax
   0xb7e909d3 <+115>:	jne    0xb7e90ae9 <zlog_backtrace_sigsafe+393>
   0xb7e909d9 <+121>:	lea    -0xc(%ebp),%esp
   0xb7e909dc <+124>:	pop    %ebx
   0xb7e909dd <+125>:	pop    %esi
   0xb7e909de <+126>:	pop    %edi
   0xb7e909df <+127>:	pop    %ebp
   0xb7e909e0 <+128>:	ret    
   0xb7e909e1 <+129>:	lea    0x0(%esi,%eiz,1),%esi
   0xb7e909e8 <+136>:	mov    -0x1ac(%ebp),%edi
   0xb7e909ee <+142>:	lea    -0x6f848(%ebx),%eax
   0xb7e909f4 <+148>:	sub    $0x4,%esp
   0xb7e909f7 <+151>:	push   %edi
   0xb7e909f8 <+152>:	push   %eax
   0xb7e909f9 <+153>:	lea    -0x1a8(%ebp),%eax
   0xb7e909ff <+159>:	push   %eax
   0xb7e90a00 <+160>:	mov    %eax,-0x1b4(%ebp)
   0xb7e90a06 <+166>:	call   0xb7ee6da0 <bprintfrr>
   0xb7e90a0b <+171>:	pop    %eax
   0xb7e90a0c <+172>:	mov    -0x1a4(%ebp),%edx
   0xb7e90a12 <+178>:	mov    -0x1a8(%ebp),%eax
   0xb7e90a18 <+184>:	pop    %ecx
   0xb7e90a19 <+185>:	sub    %edx,%eax
   0xb7e90a1b <+187>:	push   %eax
   0xb7e90a1c <+188>:	push   %edx
   0xb7e90a1d <+189>:	call   0xb7ee1aa0 <zlog_sigsafe>
   0xb7e90a22 <+194>:	pop    %esi
   0xb7e90a23 <+195>:	pop    %eax
   0xb7e90a24 <+196>:	push   %edi
   0xb7e90a25 <+197>:	pushl  -0x1bc(%ebp)
   0xb7e90a2b <+203>:	xor    %esi,%esi
   0xb7e90a2d <+205>:	call   0xb7e5dad8
=> 0xb7e90a32 <+210>:	mov    %eax,%edi
   0xb7e90a34 <+212>:	lea    -0x6f4a4(%ebx),%eax
   0xb7e90a3a <+218>:	add    $0x10,%esp
   0xb7e90a3d <+221>:	mov    %eax,-0x1c0(%ebp)
   0xb7e90a43 <+227>:	lea    -0x6c60d(%ebx),%eax
   0xb7e90a49 <+233>:	mov    %eax,-0x1b8(%ebp)
   0xb7e90a4f <+239>:	jmp    0xb7e90a98 <zlog_backtrace_sigsafe+312>
   0xb7e90a51 <+241>:	lea    0x0(%esi,%eiz,1),%esi
   0xb7e90a58 <+248>:	sub    $0x4,%esp
   0xb7e90a5b <+251>:	pushl  (%edi,%esi,4)
   0xb7e90a5e <+254>:	pushl  -0x1b8(%ebp)
   0xb7e90a64 <+260>:	pushl  -0x1b4(%ebp)
   0xb7e90a6a <+266>:	call   0xb7ee6da0 <bprintfrr>
   0xb7e90a6f <+271>:	add    $0x10,%esp
   0xb7e90a72 <+274>:	mov    -0x1a8(%ebp),%edx
   0xb7e90a78 <+280>:	mov    -0x1a4(%ebp),%eax
   0xb7e90a7e <+286>:	sub    $0x8,%esp
   0xb7e90a81 <+289>:	add    $0x1,%esi
   0xb7e90a84 <+292>:	sub    %edx,%eax
   0xb7e90a86 <+294>:	push   %eax
   0xb7e90a87 <+295>:	push   %edx
   0xb7e90a88 <+296>:	call   0xb7ee1aa0 <zlog_sigsafe>
   0xb7e90a8d <+301>:	add    $0x10,%esp
   0xb7e90a90 <+304>:	cmp    %esi,-0x1ac(%ebp)
   0xb7e90a96 <+310>:	je     0xb7e90ad0 <zlog_backtrace_sigsafe+368>
   0xb7e90a98 <+312>:	mov    -0x1b0(%ebp),%eax
   0xb7e90a9e <+318>:	test   %edi,%edi
   0xb7e90aa0 <+320>:	mov    %eax,-0x1a4(%ebp)
   0xb7e90aa6 <+326>:	jne    0xb7e90a58 <zlog_backtrace_sigsafe+248>
   0xb7e90aa8 <+328>:	mov    -0x1bc(%ebp),%eax
   0xb7e90aae <+334>:	pushl  (%eax,%esi,4)
   0xb7e90ab1 <+337>:	push   %esi
   0xb7e90ab2 <+338>:	pushl  -0x1c0(%ebp)
   0xb7e90ab8 <+344>:	pushl  -0x1b4(%ebp)
   0xb7e90abe <+350>:	call   0xb7ee6da0 <bprintfrr>
   0xb7e90ac3 <+355>:	add    $0x10,%esp
   0xb7e90ac6 <+358>:	jmp    0xb7e90a72 <zlog_backtrace_sigsafe+274>
   0xb7e90ac8 <+360>:	nop
   0xb7e90ac9 <+361>:	lea    0x0(%esi,%eiz,1),%esi
   0xb7e90ad0 <+368>:	test   %edi,%edi
   0xb7e90ad2 <+370>:	je     0xb7e909c9 <zlog_backtrace_sigsafe+105>
   0xb7e90ad8 <+376>:	sub    $0xc,%esp
   0xb7e90adb <+379>:	push   %edi
   0xb7e90adc <+380>:	call   0xb7e5d6b8
   0xb7e90ae1 <+385>:	add    $0x10,%esp
   0xb7e90ae4 <+388>:	jmp    0xb7e909c9 <zlog_backtrace_sigsafe+105>
   0xb7e90ae9 <+393>:	call   0xb7ee7d60
End of assembler dump.
#7  0xb7e90bde in zlog_signal () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function zlog_signal:
   0xb7e90af0 <+0>:	push   %ebp
   0xb7e90af1 <+1>:	mov    %esp,%ebp
   0xb7e90af3 <+3>:	push   %edi
   0xb7e90af4 <+4>:	push   %esi
   0xb7e90af5 <+5>:	push   %ebx
   0xb7e90af6 <+6>:	lea    -0xc3(%ebp),%edi
   0xb7e90afc <+12>:	lea    -0xd0(%ebp),%esi
   0xb7e90b02 <+18>:	call   0xb7e62640
   0xb7e90b07 <+23>:	add    $0xd7f09,%ebx
   0xb7e90b0d <+29>:	sub    $0xe8,%esp
   0xb7e90b13 <+35>:	mov    0xc(%ebp),%eax
   0xb7e90b16 <+38>:	mov    %edi,-0xd0(%ebp)
   0xb7e90b1c <+44>:	mov    %gs:0x14,%ecx
   0xb7e90b23 <+51>:	mov    %ecx,-0x1c(%ebp)
   0xb7e90b26 <+54>:	xor    %ecx,%ecx
   0xb7e90b28 <+56>:	mov    %edi,-0xcc(%ebp)
   0xb7e90b2e <+62>:	movl   $0xa7,-0xc8(%ebp)
   0xb7e90b38 <+72>:	mov    %eax,-0xe0(%ebp)
   0xb7e90b3e <+78>:	mov    0x10(%ebp),%eax
   0xb7e90b41 <+81>:	mov    %eax,-0xe4(%ebp)
   0xb7e90b47 <+87>:	mov    0x14(%ebp),%eax
   0xb7e90b4a <+90>:	mov    %eax,-0xdc(%ebp)
   0xb7e90b50 <+96>:	lea    -0xd4(%ebp),%eax
   0xb7e90b56 <+102>:	push   %eax
   0xb7e90b57 <+103>:	call   0xb7e5d728
   0xb7e90b5c <+108>:	mov    -0xd4(%ebp),%eax
   0xb7e90b62 <+114>:	cltd   
   0xb7e90b63 <+115>:	mov    %edx,(%esp)
   0xb7e90b66 <+118>:	push   %eax
   0xb7e90b67 <+119>:	lea    -0x6f496(%ebx),%eax
   0xb7e90b6d <+125>:	pushl  0x8(%ebp)
   0xb7e90b70 <+128>:	push   %eax
   0xb7e90b71 <+129>:	push   %esi
   0xb7e90b72 <+130>:	call   0xb7ee6da0 <bprintfrr>
   0xb7e90b77 <+135>:	mov    -0xdc(%ebp),%eax
   0xb7e90b7d <+141>:	add    $0x20,%esp
   0xb7e90b80 <+144>:	test   %eax,%eax
   0xb7e90b82 <+146>:	je     0xb7e90c50 <zlog_signal+352>
   0xb7e90b88 <+152>:	push   %eax
   0xb7e90b89 <+153>:	mov    -0xe4(%ebp),%eax
   0xb7e90b8f <+159>:	pushl  0xc(%eax)
   0xb7e90b92 <+162>:	lea    -0x6f47b(%ebx),%eax
   0xb7e90b98 <+168>:	push   %eax
   0xb7e90b99 <+169>:	push   %esi
   0xb7e90b9a <+170>:	call   0xb7ee6da0 <bprintfrr>
   0xb7e90b9f <+175>:	add    $0x10,%esp
   0xb7e90ba2 <+178>:	lea    -0x6f44f(%ebx),%eax
   0xb7e90ba8 <+184>:	sub    $0x4,%esp
   0xb7e90bab <+187>:	pushl  -0xe0(%ebp)
   0xb7e90bb1 <+193>:	push   %eax
   0xb7e90bb2 <+194>:	push   %esi
   0xb7e90bb3 <+195>:	call   0xb7ee6da0 <bprintfrr>
   0xb7e90bb8 <+200>:	pop    %eax
   0xb7e90bb9 <+201>:	mov    -0xd0(%ebp),%edx
   0xb7e90bbf <+207>:	mov    -0xcc(%ebp),%eax
   0xb7e90bc5 <+213>:	pop    %ecx
   0xb7e90bc6 <+214>:	sub    %edx,%eax
   0xb7e90bc8 <+216>:	push   %eax
   0xb7e90bc9 <+217>:	push   %edx
   0xb7e90bca <+218>:	call   0xb7ee1aa0 <zlog_sigsafe>
   0xb7e90bcf <+223>:	pop    %eax
   0xb7e90bd0 <+224>:	pop    %edx
   0xb7e90bd1 <+225>:	pushl  -0xdc(%ebp)
   0xb7e90bd7 <+231>:	push   $0x2
   0xb7e90bd9 <+233>:	call   0xb7e90960 <zlog_backtrace_sigsafe>
=> 0xb7e90bde <+238>:	mov    0x308(%ebx),%eax
   0xb7e90be4 <+244>:	mov    %edi,-0xcc(%ebp)
   0xb7e90bea <+250>:	pop    %ecx
   0xb7e90beb <+251>:	pushl  (%eax)
   0xb7e90bed <+253>:	call   0xb7e5ddf0
   0xb7e90bf2 <+258>:	add    $0x10,%esp
   0xb7e90bf5 <+261>:	test   %eax,%eax
   0xb7e90bf7 <+263>:	je     0xb7e90c78 <zlog_signal+392>
   0xb7e90bf9 <+265>:	mov    0x34(%eax),%eax
   0xb7e90bfc <+268>:	sub    $0x8,%esp
   0xb7e90bff <+271>:	pushl  0x10(%eax)
   0xb7e90c02 <+274>:	pushl  0x8(%eax)
   0xb7e90c05 <+277>:	pushl  0xc(%eax)
   0xb7e90c08 <+280>:	pushl  0x14(%eax)
   0xb7e90c0b <+283>:	lea    -0x6f804(%ebx),%eax
   0xb7e90c11 <+289>:	push   %eax
   0xb7e90c12 <+290>:	push   %esi
   0xb7e90c13 <+291>:	call   0xb7ee6da0 <bprintfrr>
   0xb7e90c18 <+296>:	add    $0x20,%esp
   0xb7e90c1b <+299>:	mov    -0xd0(%ebp),%edx
   0xb7e90c21 <+305>:	mov    -0xcc(%ebp),%eax
   0xb7e90c27 <+311>:	sub    $0x8,%esp
   0xb7e90c2a <+314>:	sub    %edx,%eax
   0xb7e90c2c <+316>:	push   %eax
   0xb7e90c2d <+317>:	push   %edx
   0xb7e90c2e <+318>:	call   0xb7ee1aa0 <zlog_sigsafe>
   0xb7e90c33 <+323>:	add    $0x10,%esp
   0xb7e90c36 <+326>:	mov    -0x1c(%ebp),%eax
   0xb7e90c39 <+329>:	xor    %gs:0x14,%eax
   0xb7e90c40 <+336>:	jne    0xb7e90c8d <zlog_signal+413>
   0xb7e90c42 <+338>:	lea    -0xc(%ebp),%esp
   0xb7e90c45 <+341>:	pop    %ebx
   0xb7e90c46 <+342>:	pop    %esi
   0xb7e90c47 <+343>:	pop    %edi
   0xb7e90c48 <+344>:	pop    %ebp
   0xb7e90c49 <+345>:	ret    
   0xb7e90c4a <+346>:	lea    0x0(%esi),%esi
   0xb7e90c50 <+352>:	mov    -0xe4(%ebp),%eax
   0xb7e90c56 <+358>:	sub    $0x4,%esp
   0xb7e90c59 <+361>:	pushl  0xc(%eax)
   0xb7e90c5c <+364>:	lea    -0x6f460(%ebx),%eax
   0xb7e90c62 <+370>:	push   %eax
   0xb7e90c63 <+371>:	push   %esi
   0xb7e90c64 <+372>:	call   0xb7ee6da0 <bprintfrr>
   0xb7e90c69 <+377>:	add    $0x10,%esp
   0xb7e90c6c <+380>:	jmp    0xb7e90ba2 <zlog_signal+178>
   0xb7e90c71 <+385>:	lea    0x0(%esi,%eiz,1),%esi
   0xb7e90c78 <+392>:	lea    -0x6f828(%ebx),%eax
   0xb7e90c7e <+398>:	sub    $0x8,%esp
   0xb7e90c81 <+401>:	push   %eax
   0xb7e90c82 <+402>:	push   %esi
   0xb7e90c83 <+403>:	call   0xb7ee6da0 <bprintfrr>
   0xb7e90c88 <+408>:	add    $0x10,%esp
   0xb7e90c8b <+411>:	jmp    0xb7e90c1b <zlog_signal+299>
   0xb7e90c8d <+413>:	call   0xb7ee7d60
End of assembler dump.
#8  0xb7eba044 in ?? () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
#9  <signal handler called>
#10 0xb7f80cf5 in ?? ()

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17898/artifact/TOPOI386/ErrorLog/log_topotests.txt

<stdin>:960: space before tab in indent.
		    	       != AF_UNSPEC)
<stdin>:1529: trailing whitespace.
        
warning: 2 lines add whitespace errors.
Report for nhrp_peer.c | 6 issues
===============================================
< WARNING: line over 80 characters
< #1028: FILE: /tmp/f1-11283/nhrp_peer.c:1028:
< WARNING: line over 80 characters
< #1043: FILE: /tmp/f1-11283/nhrp_peer.c:1043:
< WARNING: Too many leading tabs - consider code refactoring
< #1045: FILE: /tmp/f1-11283/nhrp_peer.c:1045:
Report for nhrp_vty.c | 6 issues
===============================================
< ERROR: else should follow close brace '}'
< #655: FILE: /tmp/f1-11283/nhrp_vty.c:655:
< ERROR: code indent should use tabs where possible
< #672: FILE: /tmp/f1-11283/nhrp_vty.c:672:
< WARNING: please, no space before tabs
< #672: FILE: /tmp/f1-11283/nhrp_vty.c:672:

NetDEF-CI · 2021-03-23T02:19:11Z

Continuous Integration Result: FAILED

See below for issues.
CI System Testrun URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17902/

This is a comment from an automated CI system.
For questions and feedback in regards to this CI system, please feel free to email
Martin Winter - mwinter (at) opensourcerouting.org.

Get source / Pull Request: Successful

Building Stage: Successful

Basic Tests: Failed

Topotests Ubuntu 18.04 arm8 part 0: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPO0U18ARM8-17902/test

Topology Tests failed for Topotests Ubuntu 18.04 arm8 part 0
see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17902/artifact/TOPO0U18ARM8/ErrorLog/log_topotests.txt

Topotests Ubuntu 16.04 amd64 part 0: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1604-17902/test

Topology Tests failed for Topotests Ubuntu 16.04 amd64 part 0:

54	../sysdeps/unix/sysv/linux/raise.c: No such file or directory.
No function contains program counter for selected frame.

r1: nhrpd crashed. Core file found - Backtrace follows:
[New LWP 15941]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/nhrpd --log file:nhrpd.log --log-level debug -d'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007fd9545a4438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
  Id   Target Id         Frame 
* 1    Thread 0x7fd95566c880 (LWP 15941) 0x00007fd9545a4438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007fd9545a4438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
        resultvar = 0
        pid = 15941
        selftid = 15941
#1  0x00007fd9545a603a in __GI_abort () at abort.c:89
        save_stage = 2
        act = {__sigaction_handler = {sa_handler = 0x3833340035313631, sa_sigaction = 0x3833340035313631}, sa_mask = {__val = {8390891524071635753, 2865525649010281, 14837279937874036224, 0, 93872375544224, 93872375538016, 140735970826816, 140735970826800, 140571412724884, 140735970826864, 6, 140735970827504, 140571399832632, 140735970826848, 140571412724982, 140571403568448}}, sa_flags = 33752576, sa_restorer = 0x7fffa58c5a70}
        sigs = {__val = {32, 0 <repeats 15 times>}}
#2  0x00007fd955213655 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#3  <signal handler called>
No locals.
#4  0x00007fd9545a4438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
        resultvar = 0
        pid = 15941
        selftid = 15941
#5  0x00007fd9545a603a in __GI_abort () at abort.c:89
        save_stage = 2
        act = {__sigaction_handler = {sa_handler = 0x4, sa_sigaction = 0x4}, sa_mask = {__val = {140571418055976, 93872404514976, 140735970828400, 18779162368, 140571418050560, 93872373385218, 211, 93872373386704, 4294967295, 93872402693984, 140571400156556, 140571401253648, 140571401267296, 0, 140571401253648, 93872373385218}}, sa_flags = 1433419776, sa_restorer = 0x55605d784802}
        sigs = {__val = {32, 0 <repeats 15 times>}}
#6  0x00007fd95459cbe7 in __assert_fail_base (fmt=<optimized out>, assertion=assertion@entry=0x55605d784802 "nifp->peer_hash->count == 0", file=file@entry=0x55605d7847f0 "nhrpd/nhrp_peer.c", line=line@entry=211, function=function@entry=0x55605d784dd0 "nhrp_peer_interface_del") at assert.c:92
        str = 0x55605f40c980 "\330;\223T\331\177"
        total = 4096
#7  0x00007fd95459cc92 in __GI___assert_fail (assertion=0x55605d784802 "nifp->peer_hash->count == 0", file=0x55605d7847f0 "nhrpd/nhrp_peer.c", line=211, function=0x55605d784dd0 "nhrp_peer_interface_del") at assert.c:101
No locals.
#8  0x000055605d77832b in nhrp_peer_interface_del ()
No symbol table info available.
#9  0x000055605d773ec2 in ?? ()
No symbol table info available.
#10 0x00007fd9551df565 in if_delete_retain () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#11 0x00007fd9551e17b5 in if_delete () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#12 0x00007fd9551e1985 in if_terminate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#13 0x00007fd955225c75 in vrf_delete () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#14 0x00007fd955225fbb in vrf_terminate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#15 0x000055605d7752b5 in ?? ()
No symbol table info available.
#16 0x00007fd9552139e3 in quagga_sigevent_process () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#17 0x00007fd955222e55 in thread_fetch () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#18 0x00007fd9551e7de3 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#19 0x000055605d77008a in main ()
No symbol table info available.
Dump of assembler code for function __GI___assert_fail:
   0x00007fd95459cc50 <+0>:	push   %r13
   0x00007fd95459cc52 <+2>:	push   %r12
   0x00007fd95459cc54 <+4>:	mov    %rcx,%r13
   0x00007fd95459cc57 <+7>:	push   %rbp
   0x00007fd95459cc58 <+8>:	push   %rbx
   0x00007fd95459cc59 <+9>:	mov    %rsi,%rbp
   0x00007fd95459cc5c <+12>:	mov    %rdi,%rbx
   0x00007fd95459cc5f <+15>:	lea    0x1626aa(%rip),%rsi        # 0x7fd9546ff310
   0x00007fd95459cc66 <+22>:	lea    0x15f013(%rip),%rdi        # 0x7fd9546fbc80 <_libc_intl_domainname>
   0x00007fd95459cc6d <+29>:	mov    %edx,%r12d
   0x00007fd95459cc70 <+32>:	sub    $0x8,%rsp
   0x00007fd95459cc74 <+36>:	mov    $0x5,%edx
   0x00007fd95459cc79 <+41>:	callq  0x7fd95459d630 <__GI___dcgettext>
   0x00007fd95459cc7e <+46>:	mov    %r13,%r8
   0x00007fd95459cc81 <+49>:	mov    %r12d,%ecx
   0x00007fd95459cc84 <+52>:	mov    %rbp,%rdx
   0x00007fd95459cc87 <+55>:	mov    %rbx,%rsi
   0x00007fd95459cc8a <+58>:	mov    %rax,%rdi
   0x00007fd95459cc8d <+61>:	callq  0x7fd95459cad0 <__assert_fail_base>
End of assembler dump.
#8  0x000055605d77832b in nhrp_peer_interface_del ()
Dump of assembler code for function nhrp_peer_interface_del:
   0x000055605d778280 <+0>:	push   %rbp
   0x000055605d778281 <+1>:	mov    %rsp,%rbp
   0x000055605d778284 <+4>:	push   %rbx
   0x000055605d778285 <+5>:	sub    $0x8,%rsp
   0x000055605d778289 <+9>:	testb  $0x1,0x21d230(%rip)        # 0x55605d9954c0 <debug_flags>
   0x000055605d778290 <+16>:	mov    0xd0(%rdi),%rbx
   0x000055605d778297 <+23>:	jne    0x55605d7782e0 <nhrp_peer_interface_del+96>
   0x000055605d778299 <+25>:	mov    0x68(%rbx),%rdi
   0x000055605d77829d <+29>:	test   %rdi,%rdi
   0x000055605d7782a0 <+32>:	je     0x55605d7782d0 <nhrp_peer_interface_del+80>
   0x000055605d7782a2 <+34>:	lea    -0xa69(%rip),%rsi        # 0x55605d777840
   0x000055605d7782a9 <+41>:	xor    %edx,%edx
   0x000055605d7782ab <+43>:	callq  0x55605d76fa40
   0x000055605d7782b0 <+48>:	mov    0x68(%rbx),%rdi
   0x000055605d7782b4 <+52>:	cmpq   $0x0,0x20(%rdi)
   0x000055605d7782b9 <+57>:	jne    0x55605d77830c <nhrp_peer_interface_del+140>
   0x000055605d7782bb <+59>:	add    $0x8,%rsp
   0x000055605d7782bf <+63>:	pop    %rbx
   0x000055605d7782c0 <+64>:	pop    %rbp
   0x000055605d7782c1 <+65>:	jmpq   0x55605d76fb98
   0x000055605d7782c6 <+70>:	nopw   %cs:0x0(%rax,%rax,1)
   0x000055605d7782d0 <+80>:	add    $0x8,%rsp
   0x000055605d7782d4 <+84>:	pop    %rbx
   0x000055605d7782d5 <+85>:	pop    %rbp
   0x000055605d7782d6 <+86>:	retq   
   0x000055605d7782d7 <+87>:	nopw   0x0(%rax,%rax,1)
   0x000055605d7782e0 <+96>:	mov    0x68(%rbx),%rax
   0x000055605d7782e4 <+100>:	test   %rax,%rax
   0x000055605d7782e7 <+103>:	je     0x55605d778308 <nhrp_peer_interface_del+136>
   0x000055605d7782e9 <+105>:	mov    0x20(%rax),%rdx
   0x000055605d7782ed <+109>:	lea    0xbc9c(%rip),%rsi        # 0x55605d783f90
   0x000055605d7782f4 <+116>:	lea    0x216345(%rip),%rdi        # 0x55605d98e640
   0x000055605d7782fb <+123>:	xor    %eax,%eax
   0x000055605d7782fd <+125>:	callq  0x55605d7776b0
   0x000055605d778302 <+130>:	jmp    0x55605d778299 <nhrp_peer_interface_del+25>
   0x000055605d778304 <+132>:	nopl   0x0(%rax)
   0x000055605d778308 <+136>:	xor    %edx,%edx
   0x000055605d77830a <+138>:	jmp    0x55605d7782ed <nhrp_peer_interface_del+109>
   0x000055605d77830c <+140>:	lea    0xcabd(%rip),%rcx        # 0x55605d784dd0
   0x000055605d778313 <+147>:	lea    0xc4d6(%rip),%rsi        # 0x55605d7847f0
   0x000055605d77831a <+154>:	lea    0xc4e1(%rip),%rdi        # 0x55605d784802
   0x000055605d778321 <+161>:	mov    $0xd3,%edx
   0x000055605d778326 <+166>:	callq  0x55605d76f830
End of assembler dump.
#9  0x000055605d773ec2 in ?? ()
#10 0x00007fd9551df565 in if_delete_retain () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_delete_retain:
   0x00007fd9551df540 <+0>:	mov    0x2e86e1(%rip),%rax        # 0x7fd9554c7c28
   0x00007fd9551df547 <+7>:	push   %rbp
   0x00007fd9551df548 <+8>:	mov    %rsp,%rbp
   0x00007fd9551df54b <+11>:	push   %r12
   0x00007fd9551df54d <+13>:	push   %rbx
   0x00007fd9551df54e <+14>:	mov    0x8(%rax),%rbx
   0x00007fd9551df552 <+18>:	mov    %rdi,%r12
   0x00007fd9551df555 <+21>:	test   %rbx,%rbx
   0x00007fd9551df558 <+24>:	jne    0x7fd9551df56d <if_delete_retain+45>
   0x00007fd9551df55a <+26>:	jmp    0x7fd9551df588 <if_delete_retain+72>
   0x00007fd9551df55c <+28>:	nopl   0x0(%rax)
   0x00007fd9551df560 <+32>:	mov    %r12,%rdi
   0x00007fd9551df563 <+35>:	callq  *%rax
=> 0x00007fd9551df565 <+37>:	mov    (%rbx),%rbx
   0x00007fd9551df568 <+40>:	test   %rbx,%rbx
   0x00007fd9551df56b <+43>:	je     0x7fd9551df588 <if_delete_retain+72>
   0x00007fd9551df56d <+45>:	testb  $0x1,0x18(%rbx)
   0x00007fd9551df571 <+49>:	mov    0x8(%rbx),%rax
   0x00007fd9551df575 <+53>:	je     0x7fd9551df560 <if_delete_retain+32>
   0x00007fd9551df577 <+55>:	mov    0x10(%rbx),%rdi
   0x00007fd9551df57b <+59>:	mov    %r12,%rsi
   0x00007fd9551df57e <+62>:	callq  *%rax
   0x00007fd9551df580 <+64>:	mov    (%rbx),%rbx
   0x00007fd9551df583 <+67>:	test   %rbx,%rbx
   0x00007fd9551df586 <+70>:	jne    0x7fd9551df56d <if_delete_retain+45>
   0x00007fd9551df588 <+72>:	lea    0xf0(%r12),%rdi
   0x00007fd9551df590 <+80>:	callq  0x7fd955206b50 <qobj_unreg>
   0x00007fd9551df595 <+85>:	mov    0xc0(%r12),%rdi
   0x00007fd9551df59d <+93>:	callq  0x7fd9551e88f0 <list_delete_all_node>
   0x00007fd9551df5a2 <+98>:	pop    %rbx
   0x00007fd9551df5a3 <+99>:	mov    0xc8(%r12),%rdi
   0x00007fd9551df5ab <+107>:	pop    %r12
   0x00007fd9551df5ad <+109>:	pop    %rbp
   0x00007fd9551df5ae <+110>:	jmpq   0x7fd9551e88f0 <list_delete_all_node>
End of assembler dump.
#11 0x00007fd9551e17b5 in if_delete () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_delete:
   0x00007fd9551e1760 <+0>:	push   %rbp
   0x00007fd9551e1761 <+1>:	mov    %rsp,%rbp
   0x00007fd9551e1764 <+4>:	push   %r13
   0x00007fd9551e1766 <+6>:	push   %r12
   0x00007fd9551e1768 <+8>:	push   %rbx
   0x00007fd9551e1769 <+9>:	mov    %rdi,%r13
   0x00007fd9551e176c <+12>:	sub    $0x8,%rsp
   0x00007fd9551e1770 <+16>:	mov    (%rdi),%rbx
   0x00007fd9551e1773 <+19>:	mov    0xe8(%rbx),%edi
   0x00007fd9551e1779 <+25>:	callq  0x7fd955225960 <vrf_lookup_by_id>
   0x00007fd9551e177e <+30>:	test   %rax,%rax
   0x00007fd9551e1781 <+33>:	je     0x7fd9551e1897 <if_delete+311>
   0x00007fd9551e1787 <+39>:	lea    0x70(%rax),%rsi
   0x00007fd9551e178b <+43>:	lea    0x2d19fe(%rip),%rdi        # 0x7fd9554b3190
   0x00007fd9551e1792 <+50>:	mov    %rbx,%rdx
   0x00007fd9551e1795 <+53>:	mov    %rax,%r12
   0x00007fd9551e1798 <+56>:	callq  0x7fd9551fe3b0 <_rb_remove>
   0x00007fd9551e179d <+61>:	test   %rax,%rax
   0x00007fd9551e17a0 <+64>:	je     0x7fd9551e1868 <if_delete+264>
   0x00007fd9551e17a6 <+70>:	mov    0x54(%rbx),%eax
   0x00007fd9551e17a9 <+73>:	test   %eax,%eax
   0x00007fd9551e17ab <+75>:	jne    0x7fd9551e1818 <if_delete+184>
   0x00007fd9551e17ad <+77>:	mov    %rbx,%rdi
   0x00007fd9551e17b0 <+80>:	callq  0x7fd9551df540 <if_delete_retain>
=> 0x00007fd9551e17b5 <+85>:	lea    0xc0(%rbx),%rdi
   0x00007fd9551e17bc <+92>:	callq  0x7fd9551e8990 <list_delete>
   0x00007fd9551e17c1 <+97>:	lea    0xc8(%rbx),%rdi
   0x00007fd9551e17c8 <+104>:	callq  0x7fd9551e8990 <list_delete>
   0x00007fd9551e17cd <+109>:	mov    %rbx,%rdi
   0x00007fd9551e17d0 <+112>:	callq  0x7fd9551e1720 <if_link_params_free>
   0x00007fd9551e17d5 <+117>:	mov    0xa8(%rbx),%rsi
   0x00007fd9551e17dc <+124>:	mov    0x2e6745(%rip),%rdi        # 0x7fd9554c7f28
   0x00007fd9551e17e3 <+131>:	callq  0x7fd9551efbf0 <qfree>
   0x00007fd9551e17e8 <+136>:	lea    0x2e8191(%rip),%rdi        # 0x7fd9554c9980
   0x00007fd9551e17ef <+143>:	movq   $0x0,0xa8(%rbx)
   0x00007fd9551e17fa <+154>:	mov    %rbx,%rsi
   0x00007fd9551e17fd <+157>:	callq  0x7fd9551efbf0 <qfree>
   0x00007fd9551e1802 <+162>:	movq   $0x0,0x0(%r13)
   0x00007fd9551e180a <+170>:	add    $0x8,%rsp
   0x00007fd9551e180e <+174>:	pop    %rbx
   0x00007fd9551e180f <+175>:	pop    %r12
   0x00007fd9551e1811 <+177>:	pop    %r13
   0x00007fd9551e1813 <+179>:	pop    %rbp
   0x00007fd9551e1814 <+180>:	retq   
   0x00007fd9551e1815 <+181>:	nopl   (%rax)
   0x00007fd9551e1818 <+184>:	lea    0x78(%r12),%rsi
   0x00007fd9551e181d <+189>:	lea    0x2d194c(%rip),%rdi        # 0x7fd9554b3170
   0x00007fd9551e1824 <+196>:	mov    %rbx,%rdx
   0x00007fd9551e1827 <+199>:	callq  0x7fd9551fe3b0 <_rb_remove>
   0x00007fd9551e182c <+204>:	test   %rax,%rax
   0x00007fd9551e182f <+207>:	jne    0x7fd9551e17ad <if_delete+77>
   0x00007fd9551e1835 <+213>:	mov    0xe8(%rbx),%r9d
   0x00007fd9551e183c <+220>:	mov    0x54(%rbx),%r8d
   0x00007fd9551e1840 <+224>:	lea    0x6ad31(%rip),%rcx        # 0x7fd95524c578
   0x00007fd9551e1847 <+231>:	lea    0x6a362(%rip),%rsi        # 0x7fd95524bbb0
   0x00007fd9551e184e <+238>:	lea    0x2d108b(%rip),%rdi        # 0x7fd9554b28e0
   0x00007fd9551e1855 <+245>:	mov    $0x6000009,%edx
   0x00007fd9551e185a <+250>:	callq  0x7fd9551de7e0
   0x00007fd9551e185f <+255>:	jmpq   0x7fd9551e17ad <if_delete+77>
   0x00007fd9551e1864 <+260>:	nopl   0x0(%rax)
   0x00007fd9551e1868 <+264>:	mov    0xe8(%rbx),%r9d
   0x00007fd9551e186f <+271>:	lea    0x40(%rbx),%r8
   0x00007fd9551e1873 <+275>:	lea    0x6acfe(%rip),%rcx        # 0x7fd95524c578
   0x00007fd9551e187a <+282>:	lea    0x6a2cf(%rip),%rsi        # 0x7fd95524bb50
   0x00007fd9551e1881 <+289>:	lea    0x2d1098(%rip),%rdi        # 0x7fd9554b2920
   0x00007fd9551e1888 <+296>:	mov    $0x6000009,%edx
   0x00007fd9551e188d <+301>:	callq  0x7fd9551de7e0
   0x00007fd9551e1892 <+306>:	jmpq   0x7fd9551e17a6 <if_delete+70>
   0x00007fd9551e1897 <+311>:	lea    0x6acea(%rip),%rcx        # 0x7fd95524c588
   0x00007fd9551e189e <+318>:	lea    0x69da9(%rip),%rsi        # 0x7fd95524b64e
   0x00007fd9551e18a5 <+325>:	lea    0x82e0b(%rip),%rdi        # 0x7fd9552646b7
   0x00007fd9551e18ac <+332>:	mov    $0x133,%edx
   0x00007fd9551e18b1 <+337>:	callq  0x7fd9551ba768
End of assembler dump.
#12 0x00007fd9551e1985 in if_terminate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_terminate:
   0x00007fd9551e1910 <+0>:	push   %rbp
   0x00007fd9551e1911 <+1>:	mov    %rsp,%rbp
   0x00007fd9551e1914 <+4>:	push   %r13
   0x00007fd9551e1916 <+6>:	push   %r12
   0x00007fd9551e1918 <+8>:	push   %rbx
   0x00007fd9551e1919 <+9>:	sub    $0x18,%rsp
   0x00007fd9551e191d <+13>:	mov    %fs:0x28,%rax
   0x00007fd9551e1926 <+22>:	mov    %rax,-0x28(%rbp)
   0x00007fd9551e192a <+26>:	xor    %eax,%eax
   0x00007fd9551e192c <+28>:	cmpq   $0x0,0x70(%rdi)
   0x00007fd9551e1931 <+33>:	je     0x7fd9551e198c <if_terminate+124>
   0x00007fd9551e1933 <+35>:	lea    0x70(%rdi),%r13
   0x00007fd9551e1937 <+39>:	lea    -0x30(%rbp),%r12
   0x00007fd9551e193b <+43>:	mov    %rdi,%rbx
   0x00007fd9551e193e <+46>:	xchg   %ax,%ax
   0x00007fd9551e1940 <+48>:	lea    0x2d1849(%rip),%rdi        # 0x7fd9554b3190
   0x00007fd9551e1947 <+55>:	mov    %r13,%rsi
   0x00007fd9551e194a <+58>:	callq  0x7fd9551ff0e0 <_rb_root>
   0x00007fd9551e194f <+63>:	mov    0xe0(%rax),%rdi
   0x00007fd9551e1956 <+70>:	mov    %rax,-0x30(%rbp)
   0x00007fd9551e195a <+74>:	test   %rdi,%rdi
   0x00007fd9551e195d <+77>:	je     0x7fd9551e197d <if_terminate+109>
   0x00007fd9551e195f <+79>:	mov    0x50(%rdi),%eax
   0x00007fd9551e1962 <+82>:	movq   $0x0,0x68(%rdi)
   0x00007fd9551e196a <+90>:	test   %eax,%eax
   0x00007fd9551e196c <+92>:	je     0x7fd9551e19a6 <if_terminate+150>
   0x00007fd9551e196e <+94>:	sub    $0x1,%eax
   0x00007fd9551e1971 <+97>:	test   %eax,%eax
   0x00007fd9551e1973 <+99>:	mov    %eax,0x50(%rdi)
   0x00007fd9551e1976 <+102>:	jne    0x7fd9551e197d <if_terminate+109>
   0x00007fd9551e1978 <+104>:	callq  0x7fd95521dff0 <route_node_delete>
   0x00007fd9551e197d <+109>:	mov    %r12,%rdi
   0x00007fd9551e1980 <+112>:	callq  0x7fd9551e1760 <if_delete>
=> 0x00007fd9551e1985 <+117>:	cmpq   $0x0,0x70(%rbx)
   0x00007fd9551e198a <+122>:	jne    0x7fd9551e1940 <if_terminate+48>
   0x00007fd9551e198c <+124>:	mov    -0x28(%rbp),%rax
   0x00007fd9551e1990 <+128>:	xor    %fs:0x28,%rax
   0x00007fd9551e1999 <+137>:	jne    0x7fd9551e19c5 <if_terminate+181>
   0x00007fd9551e199b <+139>:	add    $0x18,%rsp
   0x00007fd9551e199f <+143>:	pop    %rbx
   0x00007fd9551e19a0 <+144>:	pop    %r12
   0x00007fd9551e19a2 <+146>:	pop    %r13
   0x00007fd9551e19a4 <+148>:	pop    %rbp
   0x00007fd9551e19a5 <+149>:	retq   
   0x00007fd9551e19a6 <+150>:	lea    0x6aa43(%rip),%rcx        # 0x7fd95524c3f0
   0x00007fd9551e19ad <+157>:	lea    0x6a011(%rip),%rsi        # 0x7fd95524b9c5
   0x00007fd9551e19b4 <+164>:	lea    0x6a016(%rip),%rdi        # 0x7fd95524b9d1
   0x00007fd9551e19bb <+171>:	mov    $0x102,%edx
   0x00007fd9551e19c0 <+176>:	callq  0x7fd9551ba768
   0x00007fd9551e19c5 <+181>:	callq  0x7fd9551ba6a0
End of assembler dump.
54	../sysdeps/unix/sysv/linux/raise.c: No such file or directory.
No function contains program counter for selected frame.

r2: nhrpd crashed. Core file found - Backtrace follows:
[New LWP 16011]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/nhrpd --log file:nhrpd.log --log-level debug -d'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007fadb0ad3438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
  Id   Target Id         Frame 
* 1    Thread 0x7fadb1b9b880 (LWP 16011) 0x00007fadb0ad3438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007fadb0ad3438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
        resultvar = 0
        pid = 16011
        selftid = 16011
#1  0x00007fadb0ad503a in __GI_abort () at abort.c:89
        save_stage = 2
        act = {__sigaction_handler = {sa_handler = 0x3833340035313631, sa_sigaction = 0x3833340035313631}, sa_mask = {__val = {8390891524071635753, 2865525649010281, 7177085468681690368, 117, 94775918197152, 94775918190944, 140736854763904, 140736854763888, 140383983103124, 140736854763952, 6, 140736854764592, 140383970210872, 140736854763936, 140383983103222, 140383973946688}}, sa_flags = 996400384, sa_restorer = 0x7fffda3c29b0}
        sigs = {__val = {32, 0 <repeats 15 times>}}
#2  0x00007fadb1742655 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#3  <signal handler called>
No locals.
#4  0x00007fadb0ad3438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
        resultvar = 0
        pid = 16011
        selftid = 16011
#5  0x00007fadb0ad503a in __GI_abort () at abort.c:89
        save_stage = 2
        act = {__sigaction_handler = {sa_handler = 0x4, sa_sigaction = 0x4}, sa_mask = {__val = {140383988434216, 94775932348672, 140736854765536, 20363863904, 140383988428800, 94775916038146, 211, 94775916039632, 4294967295, 94775930527584, 140383970534796, 140383971631888, 140383971645536, 0, 140383971631888, 94775916038146}}, sa_flags = -1312608256, sa_restorer = 0x5632bccf0802}
        sigs = {__val = {32, 0 <repeats 15 times>}}
#6  0x00007fadb0acbbe7 in __assert_fail_base (fmt=<optimized out>, assertion=assertion@entry=0x5632bccf0802 "nifp->peer_hash->count == 0", file=file@entry=0x5632bccf07f0 "nhrpd/nhrp_peer.c", line=line@entry=211, function=function@entry=0x5632bccf0dd0 "nhrp_peer_interface_del") at assert.c:92
        str = 0x5632bdb56980 "\320$2V"
        total = 4096
#7  0x00007fadb0acbc92 in __GI___assert_fail (assertion=0x5632bccf0802 "nifp->peer_hash->count == 0", file=0x5632bccf07f0 "nhrpd/nhrp_peer.c", line=211, function=0x5632bccf0dd0 "nhrp_peer_interface_del") at assert.c:101
No locals.
#8  0x00005632bcce432b in nhrp_peer_interface_del ()
No symbol table info available.
#9  0x00005632bccdfec2 in ?? ()
No symbol table info available.
#10 0x00007fadb170e565 in if_delete_retain () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#11 0x00007fadb17107b5 in if_delete () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#12 0x00007fadb1710985 in if_terminate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#13 0x00007fadb1754c75 in vrf_delete () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#14 0x00007fadb1754fbb in vrf_terminate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#15 0x00005632bcce12b5 in ?? ()
No symbol table info available.
#16 0x00007fadb17429e3 in quagga_sigevent_process () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#17 0x00007fadb1751e55 in thread_fetch () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#18 0x00007fadb1716de3 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#19 0x00005632bccdc08a in main ()
No symbol table info available.
Dump of assembler code for function __GI___assert_fail:
   0x00007fadb0acbc50 <+0>:	push   %r13
   0x00007fadb0acbc52 <+2>:	push   %r12
   0x00007fadb0acbc54 <+4>:	mov    %rcx,%r13
   0x00007fadb0acbc57 <+7>:	push   %rbp
   0x00007fadb0acbc58 <+8>:	push   %rbx
   0x00007fadb0acbc59 <+9>:	mov    %rsi,%rbp
   0x00007fadb0acbc5c <+12>:	mov    %rdi,%rbx
   0x00007fadb0acbc5f <+15>:	lea    0x1626aa(%rip),%rsi        # 0x7fadb0c2e310
   0x00007fadb0acbc66 <+22>:	lea    0x15f013(%rip),%rdi        # 0x7fadb0c2ac80 <_libc_intl_domainname>
   0x00007fadb0acbc6d <+29>:	mov    %edx,%r12d
   0x00007fadb0acbc70 <+32>:	sub    $0x8,%rsp
   0x00007fadb0acbc74 <+36>:	mov    $0x5,%edx
   0x00007fadb0acbc79 <+41>:	callq  0x7fadb0acc630 <__GI___dcgettext>
   0x00007fadb0acbc7e <+46>:	mov    %r13,%r8
   0x00007fadb0acbc81 <+49>:	mov    %r12d,%ecx
   0x00007fadb0acbc84 <+52>:	mov    %rbp,%rdx
   0x00007fadb0acbc87 <+55>:	mov    %rbx,%rsi
   0x00007fadb0acbc8a <+58>:	mov    %rax,%rdi
   0x00007fadb0acbc8d <+61>:	callq  0x7fadb0acbad0 <__assert_fail_base>
End of assembler dump.
#8  0x00005632bcce432b in nhrp_peer_interface_del ()
Dump of assembler code for function nhrp_peer_interface_del:
   0x00005632bcce4280 <+0>:	push   %rbp
   0x00005632bcce4281 <+1>:	mov    %rsp,%rbp
   0x00005632bcce4284 <+4>:	push   %rbx
   0x00005632bcce4285 <+5>:	sub    $0x8,%rsp
   0x00005632bcce4289 <+9>:	testb  $0x1,0x21d230(%rip)        # 0x5632bcf014c0 <debug_flags>
   0x00005632bcce4290 <+16>:	mov    0xd0(%rdi),%rbx
   0x00005632bcce4297 <+23>:	jne    0x5632bcce42e0 <nhrp_peer_interface_del+96>
   0x00005632bcce4299 <+25>:	mov    0x68(%rbx),%rdi
   0x00005632bcce429d <+29>:	test   %rdi,%rdi
   0x00005632bcce42a0 <+32>:	je     0x5632bcce42d0 <nhrp_peer_interface_del+80>
   0x00005632bcce42a2 <+34>:	lea    -0xa69(%rip),%rsi        # 0x5632bcce3840
   0x00005632bcce42a9 <+41>:	xor    %edx,%edx
   0x00005632bcce42ab <+43>:	callq  0x5632bccdba40
   0x00005632bcce42b0 <+48>:	mov    0x68(%rbx),%rdi
   0x00005632bcce42b4 <+52>:	cmpq   $0x0,0x20(%rdi)
   0x00005632bcce42b9 <+57>:	jne    0x5632bcce430c <nhrp_peer_interface_del+140>
   0x00005632bcce42bb <+59>:	add    $0x8,%rsp
   0x00005632bcce42bf <+63>:	pop    %rbx
   0x00005632bcce42c0 <+64>:	pop    %rbp
   0x00005632bcce42c1 <+65>:	jmpq   0x5632bccdbb98
   0x00005632bcce42c6 <+70>:	nopw   %cs:0x0(%rax,%rax,1)
   0x00005632bcce42d0 <+80>:	add    $0x8,%rsp
   0x00005632bcce42d4 <+84>:	pop    %rbx
   0x00005632bcce42d5 <+85>:	pop    %rbp
   0x00005632bcce42d6 <+86>:	retq   
   0x00005632bcce42d7 <+87>:	nopw   0x0(%rax,%rax,1)
   0x00005632bcce42e0 <+96>:	mov    0x68(%rbx),%rax
   0x00005632bcce42e4 <+100>:	test   %rax,%rax
   0x00005632bcce42e7 <+103>:	je     0x5632bcce4308 <nhrp_peer_interface_del+136>
   0x00005632bcce42e9 <+105>:	mov    0x20(%rax),%rdx
   0x00005632bcce42ed <+109>:	lea    0xbc9c(%rip),%rsi        # 0x5632bcceff90
   0x00005632bcce42f4 <+116>:	lea    0x216345(%rip),%rdi        # 0x5632bcefa640
   0x00005632bcce42fb <+123>:	xor    %eax,%eax
   0x00005632bcce42fd <+125>:	callq  0x5632bcce36b0
   0x00005632bcce4302 <+130>:	jmp    0x5632bcce4299 <nhrp_peer_interface_del+25>
   0x00005632bcce4304 <+132>:	nopl   0x0(%rax)
   0x00005632bcce4308 <+136>:	xor    %edx,%edx
   0x00005632bcce430a <+138>:	jmp    0x5632bcce42ed <nhrp_peer_interface_del+109>
   0x00005632bcce430c <+140>:	lea    0xcabd(%rip),%rcx        # 0x5632bccf0dd0
   0x00005632bcce4313 <+147>:	lea    0xc4d6(%rip),%rsi        # 0x5632bccf07f0
   0x00005632bcce431a <+154>:	lea    0xc4e1(%rip),%rdi        # 0x5632bccf0802
   0x00005632bcce4321 <+161>:	mov    $0xd3,%edx
   0x00005632bcce4326 <+166>:	callq  0x5632bccdb830
End of assembler dump.
#9  0x00005632bccdfec2 in ?? ()
#10 0x00007fadb170e565 in if_delete_retain () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_delete_retain:
   0x00007fadb170e540 <+0>:	mov    0x2e86e1(%rip),%rax        # 0x7fadb19f6c28
   0x00007fadb170e547 <+7>:	push   %rbp
   0x00007fadb170e548 <+8>:	mov    %rsp,%rbp
   0x00007fadb170e54b <+11>:	push   %r12
   0x00007fadb170e54d <+13>:	push   %rbx
   0x00007fadb170e54e <+14>:	mov    0x8(%rax),%rbx
   0x00007fadb170e552 <+18>:	mov    %rdi,%r12
   0x00007fadb170e555 <+21>:	test   %rbx,%rbx
   0x00007fadb170e558 <+24>:	jne    0x7fadb170e56d <if_delete_retain+45>
   0x00007fadb170e55a <+26>:	jmp    0x7fadb170e588 <if_delete_retain+72>
   0x00007fadb170e55c <+28>:	nopl   0x0(%rax)
   0x00007fadb170e560 <+32>:	mov    %r12,%rdi
   0x00007fadb170e563 <+35>:	callq  *%rax
=> 0x00007fadb170e565 <+37>:	mov    (%rbx),%rbx
   0x00007fadb170e568 <+40>:	test   %rbx,%rbx
   0x00007fadb170e56b <+43>:	je     0x7fadb170e588 <if_delete_retain+72>
   0x00007fadb170e56d <+45>:	testb  $0x1,0x18(%rbx)
   0x00007fadb170e571 <+49>:	mov    0x8(%rbx),%rax
   0x00007fadb170e575 <+53>:	je     0x7fadb170e560 <if_delete_retain+32>
   0x00007fadb170e577 <+55>:	mov    0x10(%rbx),%rdi
   0x00007fadb170e57b <+59>:	mov    %r12,%rsi
   0x00007fadb170e57e <+62>:	callq  *%rax
   0x00007fadb170e580 <+64>:	mov    (%rbx),%rbx
   0x00007fadb170e583 <+67>:	test   %rbx,%rbx
   0x00007fadb170e586 <+70>:	jne    0x7fadb170e56d <if_delete_retain+45>
   0x00007fadb170e588 <+72>:	lea    0xf0(%r12),%rdi
   0x00007fadb170e590 <+80>:	callq  0x7fadb1735b50 <qobj_unreg>
   0x00007fadb170e595 <+85>:	mov    0xc0(%r12),%rdi
   0x00007fadb170e59d <+93>:	callq  0x7fadb17178f0 <list_delete_all_node>
   0x00007fadb170e5a2 <+98>:	pop    %rbx
   0x00007fadb170e5a3 <+99>:	mov    0xc8(%r12),%rdi
   0x00007fadb170e5ab <+107>:	pop    %r12
   0x00007fadb170e5ad <+109>:	pop    %rbp
   0x00007fadb170e5ae <+110>:	jmpq   0x7fadb17178f0 <list_delete_all_node>
End of assembler dump.
#11 0x00007fadb17107b5 in if_delete () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_delete:
   0x00007fadb1710760 <+0>:	push   %rbp
   0x00007fadb1710761 <+1>:	mov    %rsp,%rbp
   0x00007fadb1710764 <+4>:	push   %r13
   0x00007fadb1710766 <+6>:	push   %r12
   0x00007fadb1710768 <+8>:	push   %rbx
   0x00007fadb1710769 <+9>:	mov    %rdi,%r13
   0x00007fadb171076c <+12>:	sub    $0x8,%rsp
   0x00007fadb1710770 <+16>:	mov    (%rdi),%rbx
   0x00007fadb1710773 <+19>:	mov    0xe8(%rbx),%edi
   0x00007fadb1710779 <+25>:	callq  0x7fadb1754960 <vrf_lookup_by_id>
   0x00007fadb171077e <+30>:	test   %rax,%rax
   0x00007fadb1710781 <+33>:	je     0x7fadb1710897 <if_delete+311>
   0x00007fadb1710787 <+39>:	lea    0x70(%rax),%rsi
   0x00007fadb171078b <+43>:	lea    0x2d19fe(%rip),%rdi        # 0x7fadb19e2190
   0x00007fadb1710792 <+50>:	mov    %rbx,%rdx
   0x00007fadb1710795 <+53>:	mov    %rax,%r12
   0x00007fadb1710798 <+56>:	callq  0x7fadb172d3b0 <_rb_remove>
   0x00007fadb171079d <+61>:	test   %rax,%rax
   0x00007fadb17107a0 <+64>:	je     0x7fadb1710868 <if_delete+264>
   0x00007fadb17107a6 <+70>:	mov    0x54(%rbx),%eax
   0x00007fadb17107a9 <+73>:	test   %eax,%eax
   0x00007fadb17107ab <+75>:	jne    0x7fadb1710818 <if_delete+184>
   0x00007fadb17107ad <+77>:	mov    %rbx,%rdi
   0x00007fadb17107b0 <+80>:	callq  0x7fadb170e540 <if_delete_retain>
=> 0x00007fadb17107b5 <+85>:	lea    0xc0(%rbx),%rdi
   0x00007fadb17107bc <+92>:	callq  0x7fadb1717990 <list_delete>
   0x00007fadb17107c1 <+97>:	lea    0xc8(%rbx),%rdi
   0x00007fadb17107c8 <+104>:	callq  0x7fadb1717990 <list_delete>
   0x00007fadb17107cd <+109>:	mov    %rbx,%rdi
   0x00007fadb17107d0 <+112>:	callq  0x7fadb1710720 <if_link_params_free>
   0x00007fadb17107d5 <+117>:	mov    0xa8(%rbx),%rsi
   0x00007fadb17107dc <+124>:	mov    0x2e6745(%rip),%rdi        # 0x7fadb19f6f28
   0x00007fadb17107e3 <+131>:	callq  0x7fadb171ebf0 <qfree>
   0x00007fadb17107e8 <+136>:	lea    0x2e8191(%rip),%rdi        # 0x7fadb19f8980
   0x00007fadb17107ef <+143>:	movq   $0x0,0xa8(%rbx)
   0x00007fadb17107fa <+154>:	mov    %rbx,%rsi
   0x00007fadb17107fd <+157>:	callq  0x7fadb171ebf0 <qfree>
   0x00007fadb1710802 <+162>:	movq   $0x0,0x0(%r13)
   0x00007fadb171080a <+170>:	add    $0x8,%rsp
   0x00007fadb171080e <+174>:	pop    %rbx
   0x00007fadb171080f <+175>:	pop    %r12
   0x00007fadb1710811 <+177>:	pop    %r13
   0x00007fadb1710813 <+179>:	pop    %rbp
   0x00007fadb1710814 <+180>:	retq   
   0x00007fadb1710815 <+181>:	nopl   (%rax)
   0x00007fadb1710818 <+184>:	lea    0x78(%r12),%rsi
   0x00007fadb171081d <+189>:	lea    0x2d194c(%rip),%rdi        # 0x7fadb19e2170
   0x00007fadb1710824 <+196>:	mov    %rbx,%rdx
   0x00007fadb1710827 <+199>:	callq  0x7fadb172d3b0 <_rb_remove>
   0x00007fadb171082c <+204>:	test   %rax,%rax
   0x00007fadb171082f <+207>:	jne    0x7fadb17107ad <if_delete+77>
   0x00007fadb1710835 <+213>:	mov    0xe8(%rbx),%r9d
   0x00007fadb171083c <+220>:	mov    0x54(%rbx),%r8d
   0x00007fadb1710840 <+224>:	lea    0x6ad31(%rip),%rcx        # 0x7fadb177b578
   0x00007fadb1710847 <+231>:	lea    0x6a362(%rip),%rsi        # 0x7fadb177abb0
   0x00007fadb171084e <+238>:	lea    0x2d108b(%rip),%rdi        # 0x7fadb19e18e0
   0x00007fadb1710855 <+245>:	mov    $0x6000009,%edx
   0x00007fadb171085a <+250>:	callq  0x7fadb170d7e0
   0x00007fadb171085f <+255>:	jmpq   0x7fadb17107ad <if_delete+77>
   0x00007fadb1710864 <+260>:	nopl   0x0(%rax)
   0x00007fadb1710868 <+264>:	mov    0xe8(%rbx),%r9d
   0x00007fadb171086f <+271>:	lea    0x40(%rbx),%r8
   0x00007fadb1710873 <+275>:	lea    0x6acfe(%rip),%rcx        # 0x7fadb177b578
   0x00007fadb171087a <+282>:	lea    0x6a2cf(%rip),%rsi        # 0x7fadb177ab50
   0x00007fadb1710881 <+289>:	lea    0x2d1098(%rip),%rdi        # 0x7fadb19e1920
   0x00007fadb1710888 <+296>:	mov    $0x6000009,%edx
   0x00007fadb171088d <+301>:	callq  0x7fadb170d7e0
   0x00007fadb1710892 <+306>:	jmpq   0x7fadb17107a6 <if_delete+70>
   0x00007fadb1710897 <+311>:	lea    0x6acea(%rip),%rcx        # 0x7fadb177b588
   0x00007fadb171089e <+318>:	lea    0x69da9(%rip),%rsi        # 0x7fadb177a64e
   0x00007fadb17108a5 <+325>:	lea    0x82e0b(%rip),%rdi        # 0x7fadb17936b7
   0x00007fadb17108ac <+332>:	mov    $0x133,%edx
   0x00007fadb17108b1 <+337>:	callq  0x7fadb16e9768
End of assembler dump.
#12 0x00007fadb1710985 in if_terminate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_terminate:
   0x00007fadb1710910 <+0>:	push   %rbp
   0x00007fadb1710911 <+1>:	mov    %rsp,%rbp
   0x00007fadb1710914 <+4>:	push   %r13
   0x00007fadb1710916 <+6>:	push   %r12
   0x00007fadb1710918 <+8>:	push   %rbx
   0x00007fadb1710919 <+9>:	sub    $0x18,%rsp
   0x00007fadb171091d <+13>:	mov    %fs:0x28,%rax
   0x00007fadb1710926 <+22>:	mov    %rax,-0x28(%rbp)
   0x00007fadb171092a <+26>:	xor    %eax,%eax
   0x00007fadb171092c <+28>:	cmpq   $0x0,0x70(%rdi)
   0x00007fadb1710931 <+33>:	je     0x7fadb171098c <if_terminate+124>
   0x00007fadb1710933 <+35>:	lea    0x70(%rdi),%r13
   0x00007fadb1710937 <+39>:	lea    -0x30(%rbp),%r12
   0x00007fadb171093b <+43>:	mov    %rdi,%rbx
   0x00007fadb171093e <+46>:	xchg   %ax,%ax
   0x00007fadb1710940 <+48>:	lea    0x2d1849(%rip),%rdi        # 0x7fadb19e2190
   0x00007fadb1710947 <+55>:	mov    %r13,%rsi
   0x00007fadb171094a <+58>:	callq  0x7fadb172e0e0 <_rb_root>
   0x00007fadb171094f <+63>:	mov    0xe0(%rax),%rdi
   0x00007fadb1710956 <+70>:	mov    %rax,-0x30(%rbp)
   0x00007fadb171095a <+74>:	test   %rdi,%rdi
   0x00007fadb171095d <+77>:	je     0x7fadb171097d <if_terminate+109>
   0x00007fadb171095f <+79>:	mov    0x50(%rdi),%eax
   0x00007fadb1710962 <+82>:	movq   $0x0,0x68(%rdi)
   0x00007fadb171096a <+90>:	test   %eax,%eax
   0x00007fadb171096c <+92>:	je     0x7fadb17109a6 <if_terminate+150>
   0x00007fadb171096e <+94>:	sub    $0x1,%eax
   0x00007fadb1710971 <+97>:	test   %eax,%eax
   0x00007fadb1710973 <+99>:	mov    %eax,0x50(%rdi)
   0x00007fadb1710976 <+102>:	jne    0x7fadb171097d <if_terminate+109>
   0x00007fadb1710978 <+104>:	callq  0x7fadb174cff0 <route_node_delete>
   0x00007fadb171097d <+109>:	mov    %r12,%rdi
   0x00007fadb1710980 <+112>:	callq  0x7fadb1710760 <if_delete>
=> 0x00007fadb1710985 <+117>:	cmpq   $0x0,0x70(%rbx)
   0x00007fadb171098a <+122>:	jne    0x7fadb1710940 <if_terminate+48>
   0x00007fadb171098c <+124>:	mov    -0x28(%rbp),%rax
   0x00007fadb1710990 <+128>:	xor    %fs:0x28,%rax
   0x00007fadb1710999 <+137>:	jne    0x7fadb17109c5 <if_terminate+181>
   0x00007fadb171099b <+139>:	add    $0x18,%rsp
   0x00007fadb171099f <+143>:	pop    %rbx
   0x00007fadb17109a0 <+144>:	pop    %r12
   0x00007fadb17109a2 <+146>:	pop    %r13
   0x00007fadb17109a4 <+148>:	pop    %rbp
   0x00007fadb17109a5 <+149>:	retq   
   0x00007fadb17109a6 <+150>:	lea    0x6aa43(%rip),%rcx        # 0x7fadb177b3f0
   0x00007fadb17109ad <+157>:	lea    0x6a011(%rip),%rsi        # 0x7fadb177a9c5
   0x00007fadb17109b4 <+164>:	lea    0x6a016(%rip),%rdi        # 0x7fadb177a9d1
   0x00007fadb17109bb <+171>:	mov    $0x102,%edx
   0x00007fadb17109c0 <+176>:	callq  0x7fadb16e9768
   0x00007fadb17109c5 <+181>:	callq  0x7fadb16e96a0
End of assembler dump.

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17902/artifact/TOPOU1604/ErrorLog/log_topotests.txt

Topotests Ubuntu 18.04 amd64 part 0: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1804-17902/test

Topology Tests failed for Topotests Ubuntu 18.04 amd64 part 0
see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17902/artifact/TOPOU1804/ErrorLog/log_topotests.txt

Topotests Ubuntu 16.04 i386 part 0: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOI386-17902/test

Topology Tests failed for Topotests Ubuntu 16.04 i386 part 0:

No function contains program counter for selected frame.
No function contains program counter for selected frame.
No function contains program counter for selected frame.
No function contains program counter for selected frame.

r1: nhrpd crashed. Core file found - Backtrace follows:
[New LWP 10616]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/nhrpd --log file:nhrpd.log --log-level debug -d'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f3bcf5 in ?? ()
  Id   Target Id         Frame 
* 1    Thread 0xb78027c0 (LWP 10616) 0xb7f3bcf5 in ?? ()
#0  0xb7f3bcf5 in ?? ()
No symbol table info available.
#1  <signal handler called>
No symbol table info available.
#2  0xb7f3bcf5 in ?? ()
No symbol table info available.
#3  0x004d1ab5 in ?? ()
No symbol table info available.
#4  0xb7e3e536 in if_delete_retain () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#5  0xb7e40a70 in if_delete () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#6  0xb7e40c7b in if_terminate () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#7  0xb7e875fa in vrf_delete () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#8  0xb7e879f6 in vrf_terminate () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#9  0x004d2ea3 in ?? ()
No symbol table info available.
#10 0xb7e753a1 in quagga_sigevent_process () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#11 0xb7e8486d in thread_fetch () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#12 0xb7e472e6 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#13 0x004cddaa in main ()
No symbol table info available.
#1  <signal handler called>
#2  0xb7f3bcf5 in ?? ()
#3  0x004d1ab5 in ?? ()
#4  0xb7e3e536 in if_delete_retain () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_delete_retain:
   0xb7e3e500 <+0>:	push   %ebp
   0xb7e3e501 <+1>:	mov    %esp,%ebp
   0xb7e3e503 <+3>:	push   %edi
   0xb7e3e504 <+4>:	push   %esi
   0xb7e3e505 <+5>:	push   %ebx
   0xb7e3e506 <+6>:	call   0xb7e1d640
   0xb7e3e50b <+11>:	add    $0xe5505,%ebx
   0xb7e3e511 <+17>:	sub    $0xc,%esp
   0xb7e3e514 <+20>:	mov    0x8(%ebp),%edi
   0xb7e3e517 <+23>:	mov    0x3f4(%ebx),%eax
   0xb7e3e51d <+29>:	mov    0x4(%eax),%esi
   0xb7e3e520 <+32>:	test   %esi,%esi
   0xb7e3e522 <+34>:	jne    0xb7e3e53f <if_delete_retain+63>
   0xb7e3e524 <+36>:	jmp    0xb7e3e55a <if_delete_retain+90>
   0xb7e3e526 <+38>:	lea    0x0(%esi),%esi
   0xb7e3e529 <+41>:	lea    0x0(%edi,%eiz,1),%edi
   0xb7e3e530 <+48>:	sub    $0xc,%esp
   0xb7e3e533 <+51>:	push   %edi
   0xb7e3e534 <+52>:	call   *%eax
=> 0xb7e3e536 <+54>:	mov    (%esi),%esi
   0xb7e3e538 <+56>:	add    $0x10,%esp
   0xb7e3e53b <+59>:	test   %esi,%esi
   0xb7e3e53d <+61>:	je     0xb7e3e55a <if_delete_retain+90>
   0xb7e3e53f <+63>:	testb  $0x1,0xc(%esi)
   0xb7e3e543 <+67>:	mov    0x4(%esi),%eax
   0xb7e3e546 <+70>:	je     0xb7e3e530 <if_delete_retain+48>
   0xb7e3e548 <+72>:	sub    $0x8,%esp
   0xb7e3e54b <+75>:	push   %edi
   0xb7e3e54c <+76>:	pushl  0x8(%esi)
   0xb7e3e54f <+79>:	call   *%eax
   0xb7e3e551 <+81>:	mov    (%esi),%esi
   0xb7e3e553 <+83>:	add    $0x10,%esp
   0xb7e3e556 <+86>:	test   %esi,%esi
   0xb7e3e558 <+88>:	jne    0xb7e3e53f <if_delete_retain+63>
   0xb7e3e55a <+90>:	lea    0xa8(%edi),%eax
   0xb7e3e560 <+96>:	sub    $0xc,%esp
   0xb7e3e563 <+99>:	push   %eax
   0xb7e3e564 <+100>:	call   0xb7e67710 <qobj_unreg>
   0xb7e3e569 <+105>:	pop    %eax
   0xb7e3e56a <+106>:	pushl  0x8c(%edi)
   0xb7e3e570 <+112>:	call   0xb7e47e00 <list_delete_all_node>
   0xb7e3e575 <+117>:	pop    %edx
   0xb7e3e576 <+118>:	pushl  0x90(%edi)
   0xb7e3e57c <+124>:	call   0xb7e47e00 <list_delete_all_node>
   0xb7e3e581 <+129>:	lea    -0xc(%ebp),%esp
   0xb7e3e584 <+132>:	pop    %ebx
   0xb7e3e585 <+133>:	pop    %esi
   0xb7e3e586 <+134>:	pop    %edi
   0xb7e3e587 <+135>:	pop    %ebp
   0xb7e3e588 <+136>:	ret    
End of assembler dump.
#5  0xb7e40a70 in if_delete () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_delete:
   0xb7e40a10 <+0>:	push   %ebp
   0xb7e40a11 <+1>:	mov    %esp,%ebp
   0xb7e40a13 <+3>:	push   %edi
   0xb7e40a14 <+4>:	push   %esi
   0xb7e40a15 <+5>:	push   %ebx
   0xb7e40a16 <+6>:	call   0xb7e1d640
   0xb7e40a1b <+11>:	add    $0xe2ff5,%ebx
   0xb7e40a21 <+17>:	sub    $0x18,%esp
   0xb7e40a24 <+20>:	mov    0x8(%ebp),%eax
   0xb7e40a27 <+23>:	mov    (%eax),%esi
   0xb7e40a29 <+25>:	pushl  0xa0(%esi)
   0xb7e40a2f <+31>:	call   0xb7e87290 <vrf_lookup_by_id>
   0xb7e40a34 <+36>:	add    $0x10,%esp
   0xb7e40a37 <+39>:	test   %eax,%eax
   0xb7e40a39 <+41>:	je     0xb7e40b64 <if_delete+340>
   0xb7e40a3f <+47>:	mov    %eax,%edi
   0xb7e40a41 <+49>:	lea    0x4c(%eax),%eax
   0xb7e40a44 <+52>:	sub    $0x4,%esp
   0xb7e40a47 <+55>:	push   %esi
   0xb7e40a48 <+56>:	push   %eax
   0xb7e40a49 <+57>:	lea    -0xf110(%ebx),%eax
   0xb7e40a4f <+63>:	push   %eax
   0xb7e40a50 <+64>:	call   0xb7e5ead0 <_rb_remove>
   0xb7e40a55 <+69>:	add    $0x10,%esp
   0xb7e40a58 <+72>:	test   %eax,%eax
   0xb7e40a5a <+74>:	je     0xb7e40b30 <if_delete+288>
   0xb7e40a60 <+80>:	mov    0x34(%esi),%eax
   0xb7e40a63 <+83>:	test   %eax,%eax
   0xb7e40a65 <+85>:	jne    0xb7e40ad8 <if_delete+200>
   0xb7e40a67 <+87>:	sub    $0xc,%esp
   0xb7e40a6a <+90>:	push   %esi
   0xb7e40a6b <+91>:	call   0xb7e3e500 <if_delete_retain>
=> 0xb7e40a70 <+96>:	lea    0x8c(%esi),%eax
   0xb7e40a76 <+102>:	mov    %eax,(%esp)
   0xb7e40a79 <+105>:	call   0xb7e47eb0 <list_delete>
   0xb7e40a7e <+110>:	lea    0x90(%esi),%eax
   0xb7e40a84 <+116>:	mov    %eax,(%esp)
   0xb7e40a87 <+119>:	call   0xb7e47eb0 <list_delete>
   0xb7e40a8c <+124>:	mov    %esi,(%esp)
   0xb7e40a8f <+127>:	call   0xb7e409d0 <if_link_params_free>
   0xb7e40a94 <+132>:	pop    %eax
   0xb7e40a95 <+133>:	pop    %edx
   0xb7e40a96 <+134>:	pushl  0x80(%esi)
   0xb7e40a9c <+140>:	pushl  0x590(%ebx)
   0xb7e40aa2 <+146>:	call   0xb7e4f6d0 <qfree>
   0xb7e40aa7 <+151>:	movl   $0x0,0x80(%esi)
   0xb7e40ab1 <+161>:	lea    0x1450(%ebx),%eax
   0xb7e40ab7 <+167>:	pop    %ecx
   0xb7e40ab8 <+168>:	pop    %edi
   0xb7e40ab9 <+169>:	push   %esi
   0xb7e40aba <+170>:	push   %eax
   0xb7e40abb <+171>:	call   0xb7e4f6d0 <qfree>
   0xb7e40ac0 <+176>:	mov    0x8(%ebp),%eax
   0xb7e40ac3 <+179>:	add    $0x10,%esp
   0xb7e40ac6 <+182>:	movl   $0x0,(%eax)
   0xb7e40acc <+188>:	lea    -0xc(%ebp),%esp
   0xb7e40acf <+191>:	pop    %ebx
   0xb7e40ad0 <+192>:	pop    %esi
   0xb7e40ad1 <+193>:	pop    %edi
   0xb7e40ad2 <+194>:	pop    %ebp
   0xb7e40ad3 <+195>:	ret    
   0xb7e40ad4 <+196>:	lea    0x0(%esi,%eiz,1),%esi
   0xb7e40ad8 <+200>:	lea    0x50(%edi),%edx
   0xb7e40adb <+203>:	lea    -0xf120(%ebx),%eax
   0xb7e40ae1 <+209>:	sub    $0x4,%esp
   0xb7e40ae4 <+212>:	push   %esi
   0xb7e40ae5 <+213>:	push   %edx
   0xb7e40ae6 <+214>:	push   %eax
   0xb7e40ae7 <+215>:	call   0xb7e5ead0 <_rb_remove>
   0xb7e40aec <+220>:	add    $0x10,%esp
   0xb7e40aef <+223>:	test   %eax,%eax
   0xb7e40af1 <+225>:	jne    0xb7e40a67 <if_delete+87>
   0xb7e40af7 <+231>:	lea    -0x76000(%ebx),%eax
   0xb7e40afd <+237>:	sub    $0x8,%esp
   0xb7e40b00 <+240>:	pushl  0xa0(%esi)
   0xb7e40b06 <+246>:	pushl  0x34(%esi)
   0xb7e40b09 <+249>:	push   %eax
   0xb7e40b0a <+250>:	lea    -0x76914(%ebx),%eax
   0xb7e40b10 <+256>:	push   $0x6000009
   0xb7e40b15 <+261>:	push   %eax
   0xb7e40b16 <+262>:	lea    -0xf650(%ebx),%eax
   0xb7e40b1c <+268>:	push   %eax
   0xb7e40b1d <+269>:	call   0xb7e3d650
   0xb7e40b22 <+274>:	add    $0x20,%esp
   0xb7e40b25 <+277>:	jmp    0xb7e40a67 <if_delete+87>
   0xb7e40b2a <+282>:	lea    0x0(%esi),%esi
   0xb7e40b30 <+288>:	lea    0x20(%esi),%eax
   0xb7e40b33 <+291>:	sub    $0x8,%esp
   0xb7e40b36 <+294>:	pushl  0xa0(%esi)
   0xb7e40b3c <+300>:	push   %eax
   0xb7e40b3d <+301>:	lea    -0x76000(%ebx),%eax
   0xb7e40b43 <+307>:	push   %eax
   0xb7e40b44 <+308>:	lea    -0x76970(%ebx),%eax
   0xb7e40b4a <+314>:	push   $0x6000009
   0xb7e40b4f <+319>:	push   %eax
   0xb7e40b50 <+320>:	lea    -0xf610(%ebx),%eax
   0xb7e40b56 <+326>:	push   %eax
   0xb7e40b57 <+327>:	call   0xb7e3d650
   0xb7e40b5c <+332>:	add    $0x20,%esp
   0xb7e40b5f <+335>:	jmp    0xb7e40a60 <if_delete+80>
   0xb7e40b64 <+340>:	lea    -0x75ff4(%ebx),%eax
   0xb7e40b6a <+346>:	push   %eax
   0xb7e40b6b <+347>:	lea    -0x76e6a(%ebx),%eax
   0xb7e40b71 <+353>:	push   $0x133
   0xb7e40b76 <+358>:	push   %eax
   0xb7e40b77 <+359>:	lea    -0x5ecfd(%ebx),%eax
   0xb7e40b7d <+365>:	push   %eax
   0xb7e40b7e <+366>:	call   0xb7e18e58
End of assembler dump.
No function contains program counter for selected frame.
No function contains program counter for selected frame.
No function contains program counter for selected frame.
No function contains program counter for selected frame.

r2: nhrpd crashed. Core file found - Backtrace follows:
[New LWP 10686]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/nhrpd --log file:nhrpd.log --log-level debug -d'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7efacf5 in ?? ()
  Id   Target Id         Frame 
* 1    Thread 0xb77c17c0 (LWP 10686) 0xb7efacf5 in ?? ()
#0  0xb7efacf5 in ?? ()
No symbol table info available.
#1  <signal handler called>
No symbol table info available.
#2  0xb7efacf5 in ?? ()
No symbol table info available.
#3  0x004feab5 in ?? ()
No symbol table info available.
#4  0xb7dfd536 in if_delete_retain () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#5  0xb7dffa70 in if_delete () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#6  0xb7dffc7b in if_terminate () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#7  0xb7e465fa in vrf_delete () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#8  0xb7e469f6 in vrf_terminate () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#9  0x004ffea3 in ?? ()
No symbol table info available.
#10 0xb7e343a1 in quagga_sigevent_process () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#11 0xb7e4386d in thread_fetch () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#12 0xb7e062e6 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#13 0x004fadaa in main ()
No symbol table info available.
#1  <signal handler called>
#2  0xb7efacf5 in ?? ()
#3  0x004feab5 in ?? ()
#4  0xb7dfd536 in if_delete_retain () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_delete_retain:
   0xb7dfd500 <+0>:	push   %ebp
   0xb7dfd501 <+1>:	mov    %esp,%ebp
   0xb7dfd503 <+3>:	push   %edi
   0xb7dfd504 <+4>:	push   %esi
   0xb7dfd505 <+5>:	push   %ebx
   0xb7dfd506 <+6>:	call   0xb7ddc640
   0xb7dfd50b <+11>:	add    $0xe5505,%ebx
   0xb7dfd511 <+17>:	sub    $0xc,%esp
   0xb7dfd514 <+20>:	mov    0x8(%ebp),%edi
   0xb7dfd517 <+23>:	mov    0x3f4(%ebx),%eax
   0xb7dfd51d <+29>:	mov    0x4(%eax),%esi
   0xb7dfd520 <+32>:	test   %esi,%esi
   0xb7dfd522 <+34>:	jne    0xb7dfd53f <if_delete_retain+63>
   0xb7dfd524 <+36>:	jmp    0xb7dfd55a <if_delete_retain+90>
   0xb7dfd526 <+38>:	lea    0x0(%esi),%esi
   0xb7dfd529 <+41>:	lea    0x0(%edi,%eiz,1),%edi
   0xb7dfd530 <+48>:	sub    $0xc,%esp
   0xb7dfd533 <+51>:	push   %edi
   0xb7dfd534 <+52>:	call   *%eax
=> 0xb7dfd536 <+54>:	mov    (%esi),%esi
   0xb7dfd538 <+56>:	add    $0x10,%esp
   0xb7dfd53b <+59>:	test   %esi,%esi
   0xb7dfd53d <+61>:	je     0xb7dfd55a <if_delete_retain+90>
   0xb7dfd53f <+63>:	testb  $0x1,0xc(%esi)
   0xb7dfd543 <+67>:	mov    0x4(%esi),%eax
   0xb7dfd546 <+70>:	je     0xb7dfd530 <if_delete_retain+48>
   0xb7dfd548 <+72>:	sub    $0x8,%esp
   0xb7dfd54b <+75>:	push   %edi
   0xb7dfd54c <+76>:	pushl  0x8(%esi)
   0xb7dfd54f <+79>:	call   *%eax
   0xb7dfd551 <+81>:	mov    (%esi),%esi
   0xb7dfd553 <+83>:	add    $0x10,%esp
   0xb7dfd556 <+86>:	test   %esi,%esi
   0xb7dfd558 <+88>:	jne    0xb7dfd53f <if_delete_retain+63>
   0xb7dfd55a <+90>:	lea    0xa8(%edi),%eax
   0xb7dfd560 <+96>:	sub    $0xc,%esp
   0xb7dfd563 <+99>:	push   %eax
   0xb7dfd564 <+100>:	call   0xb7e26710 <qobj_unreg>
   0xb7dfd569 <+105>:	pop    %eax
   0xb7dfd56a <+106>:	pushl  0x8c(%edi)
   0xb7dfd570 <+112>:	call   0xb7e06e00 <list_delete_all_node>
   0xb7dfd575 <+117>:	pop    %edx
   0xb7dfd576 <+118>:	pushl  0x90(%edi)
   0xb7dfd57c <+124>:	call   0xb7e06e00 <list_delete_all_node>
   0xb7dfd581 <+129>:	lea    -0xc(%ebp),%esp
   0xb7dfd584 <+132>:	pop    %ebx
   0xb7dfd585 <+133>:	pop    %esi
   0xb7dfd586 <+134>:	pop    %edi
   0xb7dfd587 <+135>:	pop    %ebp
   0xb7dfd588 <+136>:	ret    
End of assembler dump.
#5  0xb7dffa70 in if_delete () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_delete:
   0xb7dffa10 <+0>:	push   %ebp
   0xb7dffa11 <+1>:	mov    %esp,%ebp
   0xb7dffa13 <+3>:	push   %edi
   0xb7dffa14 <+4>:	push   %esi
   0xb7dffa15 <+5>:	push   %ebx
   0xb7dffa16 <+6>:	call   0xb7ddc640
   0xb7dffa1b <+11>:	add    $0xe2ff5,%ebx
   0xb7dffa21 <+17>:	sub    $0x18,%esp
   0xb7dffa24 <+20>:	mov    0x8(%ebp),%eax
   0xb7dffa27 <+23>:	mov    (%eax),%esi
   0xb7dffa29 <+25>:	pushl  0xa0(%esi)
   0xb7dffa2f <+31>:	call   0xb7e46290 <vrf_lookup_by_id>
   0xb7dffa34 <+36>:	add    $0x10,%esp
   0xb7dffa37 <+39>:	test   %eax,%eax
   0xb7dffa39 <+41>:	je     0xb7dffb64 <if_delete+340>
   0xb7dffa3f <+47>:	mov    %eax,%edi
   0xb7dffa41 <+49>:	lea    0x4c(%eax),%eax
   0xb7dffa44 <+52>:	sub    $0x4,%esp
   0xb7dffa47 <+55>:	push   %esi
   0xb7dffa48 <+56>:	push   %eax
   0xb7dffa49 <+57>:	lea    -0xf110(%ebx),%eax
   0xb7dffa4f <+63>:	push   %eax
   0xb7dffa50 <+64>:	call   0xb7e1dad0 <_rb_remove>
   0xb7dffa55 <+69>:	add    $0x10,%esp
   0xb7dffa58 <+72>:	test   %eax,%eax
   0xb7dffa5a <+74>:	je     0xb7dffb30 <if_delete+288>
   0xb7dffa60 <+80>:	mov    0x34(%esi),%eax
   0xb7dffa63 <+83>:	test   %eax,%eax
   0xb7dffa65 <+85>:	jne    0xb7dffad8 <if_delete+200>
   0xb7dffa67 <+87>:	sub    $0xc,%esp
   0xb7dffa6a <+90>:	push   %esi
   0xb7dffa6b <+91>:	call   0xb7dfd500 <if_delete_retain>
=> 0xb7dffa70 <+96>:	lea    0x8c(%esi),%eax
   0xb7dffa76 <+102>:	mov    %eax,(%esp)
   0xb7dffa79 <+105>:	call   0xb7e06eb0 <list_delete>
   0xb7dffa7e <+110>:	lea    0x90(%esi),%eax
   0xb7dffa84 <+116>:	mov    %eax,(%esp)
   0xb7dffa87 <+119>:	call   0xb7e06eb0 <list_delete>
   0xb7dffa8c <+124>:	mov    %esi,(%esp)
   0xb7dffa8f <+127>:	call   0xb7dff9d0 <if_link_params_free>
   0xb7dffa94 <+132>:	pop    %eax
   0xb7dffa95 <+133>:	pop    %edx
   0xb7dffa96 <+134>:	pushl  0x80(%esi)
   0xb7dffa9c <+140>:	pushl  0x590(%ebx)
   0xb7dffaa2 <+146>:	call   0xb7e0e6d0 <qfree>
   0xb7dffaa7 <+151>:	movl   $0x0,0x80(%esi)
   0xb7dffab1 <+161>:	lea    0x1450(%ebx),%eax
   0xb7dffab7 <+167>:	pop    %ecx
   0xb7dffab8 <+168>:	pop    %edi
   0xb7dffab9 <+169>:	push   %esi
   0xb7dffaba <+170>:	push   %eax
   0xb7dffabb <+171>:	call   0xb7e0e6d0 <qfree>
   0xb7dffac0 <+176>:	mov    0x8(%ebp),%eax
   0xb7dffac3 <+179>:	add    $0x10,%esp
   0xb7dffac6 <+182>:	movl   $0x0,(%eax)
   0xb7dffacc <+188>:	lea    -0xc(%ebp),%esp
   0xb7dffacf <+191>:	pop    %ebx
   0xb7dffad0 <+192>:	pop    %esi
   0xb7dffad1 <+193>:	pop    %edi
   0xb7dffad2 <+194>:	pop    %ebp
   0xb7dffad3 <+195>:	ret    
   0xb7dffad4 <+196>:	lea    0x0(%esi,%eiz,1),%esi
   0xb7dffad8 <+200>:	lea    0x50(%edi),%edx
   0xb7dffadb <+203>:	lea    -0xf120(%ebx),%eax
   0xb7dffae1 <+209>:	sub    $0x4,%esp
   0xb7dffae4 <+212>:	push   %esi
   0xb7dffae5 <+213>:	push   %edx
   0xb7dffae6 <+214>:	push   %eax
   0xb7dffae7 <+215>:	call   0xb7e1dad0 <_rb_remove>
   0xb7dffaec <+220>:	add    $0x10,%esp
   0xb7dffaef <+223>:	test   %eax,%eax
   0xb7dffaf1 <+225>:	jne    0xb7dffa67 <if_delete+87>
   0xb7dffaf7 <+231>:	lea    -0x76000(%ebx),%eax
   0xb7dffafd <+237>:	sub    $0x8,%esp
   0xb7dffb00 <+240>:	pushl  0xa0(%esi)
   0xb7dffb06 <+246>:	pushl  0x34(%esi)
   0xb7dffb09 <+249>:	push   %eax
   0xb7dffb0a <+250>:	lea    -0x76914(%ebx),%eax
   0xb7dffb10 <+256>:	push   $0x6000009
   0xb7dffb15 <+261>:	push   %eax
   0xb7dffb16 <+262>:	lea    -0xf650(%ebx),%eax
   0xb7dffb1c <+268>:	push   %eax
   0xb7dffb1d <+269>:	call   0xb7dfc650
   0xb7dffb22 <+274>:	add    $0x20,%esp
   0xb7dffb25 <+277>:	jmp    0xb7dffa67 <if_delete+87>
   0xb7dffb2a <+282>:	lea    0x0(%esi),%esi
   0xb7dffb30 <+288>:	lea    0x20(%esi),%eax
   0xb7dffb33 <+291>:	sub    $0x8,%esp
   0xb7dffb36 <+294>:	pushl  0xa0(%esi)
   0xb7dffb3c <+300>:	push   %eax
   0xb7dffb3d <+301>:	lea    -0x76000(%ebx),%eax
   0xb7dffb43 <+307>:	push   %eax
   0xb7dffb44 <+308>:	lea    -0x76970(%ebx),%eax
   0xb7dffb4a <+314>:	push   $0x6000009
   0xb7dffb4f <+319>:	push   %eax
   0xb7dffb50 <+320>:	lea    -0xf610(%ebx),%eax
   0xb7dffb56 <+326>:	push   %eax
   0xb7dffb57 <+327>:	call   0xb7dfc650
   0xb7dffb5c <+332>:	add    $0x20,%esp
   0xb7dffb5f <+335>:	jmp    0xb7dffa60 <if_delete+80>
   0xb7dffb64 <+340>:	lea    -0x75ff4(%ebx),%eax
   0xb7dffb6a <+346>:	push   %eax
   0xb7dffb6b <+347>:	lea    -0x76e6a(%ebx),%eax
   0xb7dffb71 <+353>:	push   $0x133
   0xb7dffb76 <+358>:	push   %eax
   0xb7dffb77 <+359>:	lea    -0x5ecfd(%ebx),%eax
   0xb7dffb7d <+365>:	push   %eax
   0xb7dffb7e <+366>:	call   0xb7dd7e58
End of assembler dump.

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17902/artifact/TOPOI386/ErrorLog/log_topotests.txt

Topotests Ubuntu 18.04 arm8 part 4: Failed (click for details)

Topotests Ubuntu 18.04 arm8 part 4: No useful log found

Successful on other platforms/tests

Addresssanitizer topotests part 4
Topotests Ubuntu 16.04 amd64 part 4
Topotests Ubuntu 18.04 amd64 part 1
Addresssanitizer topotests part 2
Topotests Ubuntu 18.04 arm8 part 3
Topotests Ubuntu 16.04 i386 part 5
Topotests Ubuntu 16.04 amd64 part 9
CentOS 7 rpm pkg check
Topotests Ubuntu 18.04 amd64 part 8
Debian 9 deb pkg check
Addresssanitizer topotests part 9
Topotests Ubuntu 18.04 arm8 part 7
Topotests Ubuntu 18.04 arm8 part 2
Topotests Ubuntu 18.04 amd64 part 2
Topotests Ubuntu 18.04 arm8 part 8
Addresssanitizer topotests part 7
Topotests Ubuntu 16.04 amd64 part 2
Topotests Ubuntu 16.04 i386 part 9
Topotests Ubuntu 18.04 amd64 part 6
Topotests Ubuntu 16.04 amd64 part 6
Static analyzer (clang)
Topotests Ubuntu 18.04 arm8 part 5
Ubuntu 18.04 deb pkg check
Addresssanitizer topotests part 5
Ubuntu 16.04 deb pkg check
Topotests Ubuntu 18.04 amd64 part 5
Topotests Ubuntu 16.04 amd64 part 8
Addresssanitizer topotests part 3
Topotests Ubuntu 16.04 i386 part 7
Debian 8 deb pkg check
Addresssanitizer topotests part 0
IPv4 ldp protocol on Ubuntu 18.04
Topotests Ubuntu 18.04 amd64 part 3
Topotests Ubuntu 18.04 arm8 part 1
Topotests Ubuntu 16.04 amd64 part 1
Topotests Ubuntu 16.04 i386 part 4
Addresssanitizer topotests part 1
IPv6 protocols on Ubuntu 18.04
Topotests Ubuntu 18.04 amd64 part 4
Topotests Ubuntu 16.04 amd64 part 5
Topotests Ubuntu 18.04 arm8 part 9
Topotests Ubuntu 16.04 i386 part 1
Topotests Ubuntu 16.04 i386 part 6
Addresssanitizer topotests part 6
Addresssanitizer topotests part 8
Topotests Ubuntu 18.04 amd64 part 7
Debian 10 deb pkg check
Topotests Ubuntu 16.04 amd64 part 3
Topotests Ubuntu 18.04 arm8 part 6
IPv4 protocols on Ubuntu 18.04
Topotests Ubuntu 18.04 amd64 part 9
Topotests Ubuntu 16.04 i386 part 3
Topotests Ubuntu 16.04 amd64 part 7
Fedora 29 rpm pkg check
Ubuntu 20.04 deb pkg check
Topotests Ubuntu 16.04 i386 part 2
Topotests Ubuntu 16.04 i386 part 8

Warnings Generated during build:

Checkout code: Successful with additional warnings

Topotests Ubuntu 18.04 arm8 part 0: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPO0U18ARM8-17902/test

Topology Tests failed for Topotests Ubuntu 18.04 arm8 part 0
see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17902/artifact/TOPO0U18ARM8/ErrorLog/log_topotests.txt

Topotests Ubuntu 16.04 amd64 part 0: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1604-17902/test

Topology Tests failed for Topotests Ubuntu 16.04 amd64 part 0:

54	../sysdeps/unix/sysv/linux/raise.c: No such file or directory.
No function contains program counter for selected frame.

r1: nhrpd crashed. Core file found - Backtrace follows:
[New LWP 15941]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/nhrpd --log file:nhrpd.log --log-level debug -d'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007fd9545a4438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
  Id   Target Id         Frame 
* 1    Thread 0x7fd95566c880 (LWP 15941) 0x00007fd9545a4438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007fd9545a4438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
        resultvar = 0
        pid = 15941
        selftid = 15941
#1  0x00007fd9545a603a in __GI_abort () at abort.c:89
        save_stage = 2
        act = {__sigaction_handler = {sa_handler = 0x3833340035313631, sa_sigaction = 0x3833340035313631}, sa_mask = {__val = {8390891524071635753, 2865525649010281, 14837279937874036224, 0, 93872375544224, 93872375538016, 140735970826816, 140735970826800, 140571412724884, 140735970826864, 6, 140735970827504, 140571399832632, 140735970826848, 140571412724982, 140571403568448}}, sa_flags = 33752576, sa_restorer = 0x7fffa58c5a70}
        sigs = {__val = {32, 0 <repeats 15 times>}}
#2  0x00007fd955213655 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#3  <signal handler called>
No locals.
#4  0x00007fd9545a4438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
        resultvar = 0
        pid = 15941
        selftid = 15941
#5  0x00007fd9545a603a in __GI_abort () at abort.c:89
        save_stage = 2
        act = {__sigaction_handler = {sa_handler = 0x4, sa_sigaction = 0x4}, sa_mask = {__val = {140571418055976, 93872404514976, 140735970828400, 18779162368, 140571418050560, 93872373385218, 211, 93872373386704, 4294967295, 93872402693984, 140571400156556, 140571401253648, 140571401267296, 0, 140571401253648, 93872373385218}}, sa_flags = 1433419776, sa_restorer = 0x55605d784802}
        sigs = {__val = {32, 0 <repeats 15 times>}}
#6  0x00007fd95459cbe7 in __assert_fail_base (fmt=<optimized out>, assertion=assertion@entry=0x55605d784802 "nifp->peer_hash->count == 0", file=file@entry=0x55605d7847f0 "nhrpd/nhrp_peer.c", line=line@entry=211, function=function@entry=0x55605d784dd0 "nhrp_peer_interface_del") at assert.c:92
        str = 0x55605f40c980 "\330;\223T\331\177"
        total = 4096
#7  0x00007fd95459cc92 in __GI___assert_fail (assertion=0x55605d784802 "nifp->peer_hash->count == 0", file=0x55605d7847f0 "nhrpd/nhrp_peer.c", line=211, function=0x55605d784dd0 "nhrp_peer_interface_del") at assert.c:101
No locals.
#8  0x000055605d77832b in nhrp_peer_interface_del ()
No symbol table info available.
#9  0x000055605d773ec2 in ?? ()
No symbol table info available.
#10 0x00007fd9551df565 in if_delete_retain () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#11 0x00007fd9551e17b5 in if_delete () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#12 0x00007fd9551e1985 in if_terminate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#13 0x00007fd955225c75 in vrf_delete () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#14 0x00007fd955225fbb in vrf_terminate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#15 0x000055605d7752b5 in ?? ()
No symbol table info available.
#16 0x00007fd9552139e3 in quagga_sigevent_process () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#17 0x00007fd955222e55 in thread_fetch () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#18 0x00007fd9551e7de3 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#19 0x000055605d77008a in main ()
No symbol table info available.
Dump of assembler code for function __GI___assert_fail:
   0x00007fd95459cc50 <+0>:	push   %r13
   0x00007fd95459cc52 <+2>:	push   %r12
   0x00007fd95459cc54 <+4>:	mov    %rcx,%r13
   0x00007fd95459cc57 <+7>:	push   %rbp
   0x00007fd95459cc58 <+8>:	push   %rbx
   0x00007fd95459cc59 <+9>:	mov    %rsi,%rbp
   0x00007fd95459cc5c <+12>:	mov    %rdi,%rbx
   0x00007fd95459cc5f <+15>:	lea    0x1626aa(%rip),%rsi        # 0x7fd9546ff310
   0x00007fd95459cc66 <+22>:	lea    0x15f013(%rip),%rdi        # 0x7fd9546fbc80 <_libc_intl_domainname>
   0x00007fd95459cc6d <+29>:	mov    %edx,%r12d
   0x00007fd95459cc70 <+32>:	sub    $0x8,%rsp
   0x00007fd95459cc74 <+36>:	mov    $0x5,%edx
   0x00007fd95459cc79 <+41>:	callq  0x7fd95459d630 <__GI___dcgettext>
   0x00007fd95459cc7e <+46>:	mov    %r13,%r8
   0x00007fd95459cc81 <+49>:	mov    %r12d,%ecx
   0x00007fd95459cc84 <+52>:	mov    %rbp,%rdx
   0x00007fd95459cc87 <+55>:	mov    %rbx,%rsi
   0x00007fd95459cc8a <+58>:	mov    %rax,%rdi
   0x00007fd95459cc8d <+61>:	callq  0x7fd95459cad0 <__assert_fail_base>
End of assembler dump.
#8  0x000055605d77832b in nhrp_peer_interface_del ()
Dump of assembler code for function nhrp_peer_interface_del:
   0x000055605d778280 <+0>:	push   %rbp
   0x000055605d778281 <+1>:	mov    %rsp,%rbp
   0x000055605d778284 <+4>:	push   %rbx
   0x000055605d778285 <+5>:	sub    $0x8,%rsp
   0x000055605d778289 <+9>:	testb  $0x1,0x21d230(%rip)        # 0x55605d9954c0 <debug_flags>
   0x000055605d778290 <+16>:	mov    0xd0(%rdi),%rbx
   0x000055605d778297 <+23>:	jne    0x55605d7782e0 <nhrp_peer_interface_del+96>
   0x000055605d778299 <+25>:	mov    0x68(%rbx),%rdi
   0x000055605d77829d <+29>:	test   %rdi,%rdi
   0x000055605d7782a0 <+32>:	je     0x55605d7782d0 <nhrp_peer_interface_del+80>
   0x000055605d7782a2 <+34>:	lea    -0xa69(%rip),%rsi        # 0x55605d777840
   0x000055605d7782a9 <+41>:	xor    %edx,%edx
   0x000055605d7782ab <+43>:	callq  0x55605d76fa40
   0x000055605d7782b0 <+48>:	mov    0x68(%rbx),%rdi
   0x000055605d7782b4 <+52>:	cmpq   $0x0,0x20(%rdi)
   0x000055605d7782b9 <+57>:	jne    0x55605d77830c <nhrp_peer_interface_del+140>
   0x000055605d7782bb <+59>:	add    $0x8,%rsp
   0x000055605d7782bf <+63>:	pop    %rbx
   0x000055605d7782c0 <+64>:	pop    %rbp
   0x000055605d7782c1 <+65>:	jmpq   0x55605d76fb98
   0x000055605d7782c6 <+70>:	nopw   %cs:0x0(%rax,%rax,1)
   0x000055605d7782d0 <+80>:	add    $0x8,%rsp
   0x000055605d7782d4 <+84>:	pop    %rbx
   0x000055605d7782d5 <+85>:	pop    %rbp
   0x000055605d7782d6 <+86>:	retq   
   0x000055605d7782d7 <+87>:	nopw   0x0(%rax,%rax,1)
   0x000055605d7782e0 <+96>:	mov    0x68(%rbx),%rax
   0x000055605d7782e4 <+100>:	test   %rax,%rax
   0x000055605d7782e7 <+103>:	je     0x55605d778308 <nhrp_peer_interface_del+136>
   0x000055605d7782e9 <+105>:	mov    0x20(%rax),%rdx
   0x000055605d7782ed <+109>:	lea    0xbc9c(%rip),%rsi        # 0x55605d783f90
   0x000055605d7782f4 <+116>:	lea    0x216345(%rip),%rdi        # 0x55605d98e640
   0x000055605d7782fb <+123>:	xor    %eax,%eax
   0x000055605d7782fd <+125>:	callq  0x55605d7776b0
   0x000055605d778302 <+130>:	jmp    0x55605d778299 <nhrp_peer_interface_del+25>
   0x000055605d778304 <+132>:	nopl   0x0(%rax)
   0x000055605d778308 <+136>:	xor    %edx,%edx
   0x000055605d77830a <+138>:	jmp    0x55605d7782ed <nhrp_peer_interface_del+109>
   0x000055605d77830c <+140>:	lea    0xcabd(%rip),%rcx        # 0x55605d784dd0
   0x000055605d778313 <+147>:	lea    0xc4d6(%rip),%rsi        # 0x55605d7847f0
   0x000055605d77831a <+154>:	lea    0xc4e1(%rip),%rdi        # 0x55605d784802
   0x000055605d778321 <+161>:	mov    $0xd3,%edx
   0x000055605d778326 <+166>:	callq  0x55605d76f830
End of assembler dump.
#9  0x000055605d773ec2 in ?? ()
#10 0x00007fd9551df565 in if_delete_retain () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_delete_retain:
   0x00007fd9551df540 <+0>:	mov    0x2e86e1(%rip),%rax        # 0x7fd9554c7c28
   0x00007fd9551df547 <+7>:	push   %rbp
   0x00007fd9551df548 <+8>:	mov    %rsp,%rbp
   0x00007fd9551df54b <+11>:	push   %r12
   0x00007fd9551df54d <+13>:	push   %rbx
   0x00007fd9551df54e <+14>:	mov    0x8(%rax),%rbx
   0x00007fd9551df552 <+18>:	mov    %rdi,%r12
   0x00007fd9551df555 <+21>:	test   %rbx,%rbx
   0x00007fd9551df558 <+24>:	jne    0x7fd9551df56d <if_delete_retain+45>
   0x00007fd9551df55a <+26>:	jmp    0x7fd9551df588 <if_delete_retain+72>
   0x00007fd9551df55c <+28>:	nopl   0x0(%rax)
   0x00007fd9551df560 <+32>:	mov    %r12,%rdi
   0x00007fd9551df563 <+35>:	callq  *%rax
=> 0x00007fd9551df565 <+37>:	mov    (%rbx),%rbx
   0x00007fd9551df568 <+40>:	test   %rbx,%rbx
   0x00007fd9551df56b <+43>:	je     0x7fd9551df588 <if_delete_retain+72>
   0x00007fd9551df56d <+45>:	testb  $0x1,0x18(%rbx)
   0x00007fd9551df571 <+49>:	mov    0x8(%rbx),%rax
   0x00007fd9551df575 <+53>:	je     0x7fd9551df560 <if_delete_retain+32>
   0x00007fd9551df577 <+55>:	mov    0x10(%rbx),%rdi
   0x00007fd9551df57b <+59>:	mov    %r12,%rsi
   0x00007fd9551df57e <+62>:	callq  *%rax
   0x00007fd9551df580 <+64>:	mov    (%rbx),%rbx
   0x00007fd9551df583 <+67>:	test   %rbx,%rbx
   0x00007fd9551df586 <+70>:	jne    0x7fd9551df56d <if_delete_retain+45>
   0x00007fd9551df588 <+72>:	lea    0xf0(%r12),%rdi
   0x00007fd9551df590 <+80>:	callq  0x7fd955206b50 <qobj_unreg>
   0x00007fd9551df595 <+85>:	mov    0xc0(%r12),%rdi
   0x00007fd9551df59d <+93>:	callq  0x7fd9551e88f0 <list_delete_all_node>
   0x00007fd9551df5a2 <+98>:	pop    %rbx
   0x00007fd9551df5a3 <+99>:	mov    0xc8(%r12),%rdi
   0x00007fd9551df5ab <+107>:	pop    %r12
   0x00007fd9551df5ad <+109>:	pop    %rbp
   0x00007fd9551df5ae <+110>:	jmpq   0x7fd9551e88f0 <list_delete_all_node>
End of assembler dump.
#11 0x00007fd9551e17b5 in if_delete () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_delete:
   0x00007fd9551e1760 <+0>:	push   %rbp
   0x00007fd9551e1761 <+1>:	mov    %rsp,%rbp
   0x00007fd9551e1764 <+4>:	push   %r13
   0x00007fd9551e1766 <+6>:	push   %r12
   0x00007fd9551e1768 <+8>:	push   %rbx
   0x00007fd9551e1769 <+9>:	mov    %rdi,%r13
   0x00007fd9551e176c <+12>:	sub    $0x8,%rsp
   0x00007fd9551e1770 <+16>:	mov    (%rdi),%rbx
   0x00007fd9551e1773 <+19>:	mov    0xe8(%rbx),%edi
   0x00007fd9551e1779 <+25>:	callq  0x7fd955225960 <vrf_lookup_by_id>
   0x00007fd9551e177e <+30>:	test   %rax,%rax
   0x00007fd9551e1781 <+33>:	je     0x7fd9551e1897 <if_delete+311>
   0x00007fd9551e1787 <+39>:	lea    0x70(%rax),%rsi
   0x00007fd9551e178b <+43>:	lea    0x2d19fe(%rip),%rdi        # 0x7fd9554b3190
   0x00007fd9551e1792 <+50>:	mov    %rbx,%rdx
   0x00007fd9551e1795 <+53>:	mov    %rax,%r12
   0x00007fd9551e1798 <+56>:	callq  0x7fd9551fe3b0 <_rb_remove>
   0x00007fd9551e179d <+61>:	test   %rax,%rax
   0x00007fd9551e17a0 <+64>:	je     0x7fd9551e1868 <if_delete+264>
   0x00007fd9551e17a6 <+70>:	mov    0x54(%rbx),%eax
   0x00007fd9551e17a9 <+73>:	test   %eax,%eax
   0x00007fd9551e17ab <+75>:	jne    0x7fd9551e1818 <if_delete+184>
   0x00007fd9551e17ad <+77>:	mov    %rbx,%rdi
   0x00007fd9551e17b0 <+80>:	callq  0x7fd9551df540 <if_delete_retain>
=> 0x00007fd9551e17b5 <+85>:	lea    0xc0(%rbx),%rdi
   0x00007fd9551e17bc <+92>:	callq  0x7fd9551e8990 <list_delete>
   0x00007fd9551e17c1 <+97>:	lea    0xc8(%rbx),%rdi
   0x00007fd9551e17c8 <+104>:	callq  0x7fd9551e8990 <list_delete>
   0x00007fd9551e17cd <+109>:	mov    %rbx,%rdi
   0x00007fd9551e17d0 <+112>:	callq  0x7fd9551e1720 <if_link_params_free>
   0x00007fd9551e17d5 <+117>:	mov    0xa8(%rbx),%rsi
   0x00007fd9551e17dc <+124>:	mov    0x2e6745(%rip),%rdi        # 0x7fd9554c7f28
   0x00007fd9551e17e3 <+131>:	callq  0x7fd9551efbf0 <qfree>
   0x00007fd9551e17e8 <+136>:	lea    0x2e8191(%rip),%rdi        # 0x7fd9554c9980
   0x00007fd9551e17ef <+143>:	movq   $0x0,0xa8(%rbx)
   0x00007fd9551e17fa <+154>:	mov    %rbx,%rsi
   0x00007fd9551e17fd <+157>:	callq  0x7fd9551efbf0 <qfree>
   0x00007fd9551e1802 <+162>:	movq   $0x0,0x0(%r13)
   0x00007fd9551e180a <+170>:	add    $0x8,%rsp
   0x00007fd9551e180e <+174>:	pop    %rbx
   0x00007fd9551e180f <+175>:	pop    %r12
   0x00007fd9551e1811 <+177>:	pop    %r13
   0x00007fd9551e1813 <+179>:	pop    %rbp
   0x00007fd9551e1814 <+180>:	retq   
   0x00007fd9551e1815 <+181>:	nopl   (%rax)
   0x00007fd9551e1818 <+184>:	lea    0x78(%r12),%rsi
   0x00007fd9551e181d <+189>:	lea    0x2d194c(%rip),%rdi        # 0x7fd9554b3170
   0x00007fd9551e1824 <+196>:	mov    %rbx,%rdx
   0x00007fd9551e1827 <+199>:	callq  0x7fd9551fe3b0 <_rb_remove>
   0x00007fd9551e182c <+204>:	test   %rax,%rax
   0x00007fd9551e182f <+207>:	jne    0x7fd9551e17ad <if_delete+77>
   0x00007fd9551e1835 <+213>:	mov    0xe8(%rbx),%r9d
   0x00007fd9551e183c <+220>:	mov    0x54(%rbx),%r8d
   0x00007fd9551e1840 <+224>:	lea    0x6ad31(%rip),%rcx        # 0x7fd95524c578
   0x00007fd9551e1847 <+231>:	lea    0x6a362(%rip),%rsi        # 0x7fd95524bbb0
   0x00007fd9551e184e <+238>:	lea    0x2d108b(%rip),%rdi        # 0x7fd9554b28e0
   0x00007fd9551e1855 <+245>:	mov    $0x6000009,%edx
   0x00007fd9551e185a <+250>:	callq  0x7fd9551de7e0
   0x00007fd9551e185f <+255>:	jmpq   0x7fd9551e17ad <if_delete+77>
   0x00007fd9551e1864 <+260>:	nopl   0x0(%rax)
   0x00007fd9551e1868 <+264>:	mov    0xe8(%rbx),%r9d
   0x00007fd9551e186f <+271>:	lea    0x40(%rbx),%r8
   0x00007fd9551e1873 <+275>:	lea    0x6acfe(%rip),%rcx        # 0x7fd95524c578
   0x00007fd9551e187a <+282>:	lea    0x6a2cf(%rip),%rsi        # 0x7fd95524bb50
   0x00007fd9551e1881 <+289>:	lea    0x2d1098(%rip),%rdi        # 0x7fd9554b2920
   0x00007fd9551e1888 <+296>:	mov    $0x6000009,%edx
   0x00007fd9551e188d <+301>:	callq  0x7fd9551de7e0
   0x00007fd9551e1892 <+306>:	jmpq   0x7fd9551e17a6 <if_delete+70>
   0x00007fd9551e1897 <+311>:	lea    0x6acea(%rip),%rcx        # 0x7fd95524c588
   0x00007fd9551e189e <+318>:	lea    0x69da9(%rip),%rsi        # 0x7fd95524b64e
   0x00007fd9551e18a5 <+325>:	lea    0x82e0b(%rip),%rdi        # 0x7fd9552646b7
   0x00007fd9551e18ac <+332>:	mov    $0x133,%edx
   0x00007fd9551e18b1 <+337>:	callq  0x7fd9551ba768
End of assembler dump.
#12 0x00007fd9551e1985 in if_terminate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_terminate:
   0x00007fd9551e1910 <+0>:	push   %rbp
   0x00007fd9551e1911 <+1>:	mov    %rsp,%rbp
   0x00007fd9551e1914 <+4>:	push   %r13
   0x00007fd9551e1916 <+6>:	push   %r12
   0x00007fd9551e1918 <+8>:	push   %rbx
   0x00007fd9551e1919 <+9>:	sub    $0x18,%rsp
   0x00007fd9551e191d <+13>:	mov    %fs:0x28,%rax
   0x00007fd9551e1926 <+22>:	mov    %rax,-0x28(%rbp)
   0x00007fd9551e192a <+26>:	xor    %eax,%eax
   0x00007fd9551e192c <+28>:	cmpq   $0x0,0x70(%rdi)
   0x00007fd9551e1931 <+33>:	je     0x7fd9551e198c <if_terminate+124>
   0x00007fd9551e1933 <+35>:	lea    0x70(%rdi),%r13
   0x00007fd9551e1937 <+39>:	lea    -0x30(%rbp),%r12
   0x00007fd9551e193b <+43>:	mov    %rdi,%rbx
   0x00007fd9551e193e <+46>:	xchg   %ax,%ax
   0x00007fd9551e1940 <+48>:	lea    0x2d1849(%rip),%rdi        # 0x7fd9554b3190
   0x00007fd9551e1947 <+55>:	mov    %r13,%rsi
   0x00007fd9551e194a <+58>:	callq  0x7fd9551ff0e0 <_rb_root>
   0x00007fd9551e194f <+63>:	mov    0xe0(%rax),%rdi
   0x00007fd9551e1956 <+70>:	mov    %rax,-0x30(%rbp)
   0x00007fd9551e195a <+74>:	test   %rdi,%rdi
   0x00007fd9551e195d <+77>:	je     0x7fd9551e197d <if_terminate+109>
   0x00007fd9551e195f <+79>:	mov    0x50(%rdi),%eax
   0x00007fd9551e1962 <+82>:	movq   $0x0,0x68(%rdi)
   0x00007fd9551e196a <+90>:	test   %eax,%eax
   0x00007fd9551e196c <+92>:	je     0x7fd9551e19a6 <if_terminate+150>
   0x00007fd9551e196e <+94>:	sub    $0x1,%eax
   0x00007fd9551e1971 <+97>:	test   %eax,%eax
   0x00007fd9551e1973 <+99>:	mov    %eax,0x50(%rdi)
   0x00007fd9551e1976 <+102>:	jne    0x7fd9551e197d <if_terminate+109>
   0x00007fd9551e1978 <+104>:	callq  0x7fd95521dff0 <route_node_delete>
   0x00007fd9551e197d <+109>:	mov    %r12,%rdi
   0x00007fd9551e1980 <+112>:	callq  0x7fd9551e1760 <if_delete>
=> 0x00007fd9551e1985 <+117>:	cmpq   $0x0,0x70(%rbx)
   0x00007fd9551e198a <+122>:	jne    0x7fd9551e1940 <if_terminate+48>
   0x00007fd9551e198c <+124>:	mov    -0x28(%rbp),%rax
   0x00007fd9551e1990 <+128>:	xor    %fs:0x28,%rax
   0x00007fd9551e1999 <+137>:	jne    0x7fd9551e19c5 <if_terminate+181>
   0x00007fd9551e199b <+139>:	add    $0x18,%rsp
   0x00007fd9551e199f <+143>:	pop    %rbx
   0x00007fd9551e19a0 <+144>:	pop    %r12
   0x00007fd9551e19a2 <+146>:	pop    %r13
   0x00007fd9551e19a4 <+148>:	pop    %rbp
   0x00007fd9551e19a5 <+149>:	retq   
   0x00007fd9551e19a6 <+150>:	lea    0x6aa43(%rip),%rcx        # 0x7fd95524c3f0
   0x00007fd9551e19ad <+157>:	lea    0x6a011(%rip),%rsi        # 0x7fd95524b9c5
   0x00007fd9551e19b4 <+164>:	lea    0x6a016(%rip),%rdi        # 0x7fd95524b9d1
   0x00007fd9551e19bb <+171>:	mov    $0x102,%edx
   0x00007fd9551e19c0 <+176>:	callq  0x7fd9551ba768
   0x00007fd9551e19c5 <+181>:	callq  0x7fd9551ba6a0
End of assembler dump.
54	../sysdeps/unix/sysv/linux/raise.c: No such file or directory.
No function contains program counter for selected frame.

r2: nhrpd crashed. Core file found - Backtrace follows:
[New LWP 16011]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/nhrpd --log file:nhrpd.log --log-level debug -d'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007fadb0ad3438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
  Id   Target Id         Frame 
* 1    Thread 0x7fadb1b9b880 (LWP 16011) 0x00007fadb0ad3438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007fadb0ad3438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
        resultvar = 0
        pid = 16011
        selftid = 16011
#1  0x00007fadb0ad503a in __GI_abort () at abort.c:89
        save_stage = 2
        act = {__sigaction_handler = {sa_handler = 0x3833340035313631, sa_sigaction = 0x3833340035313631}, sa_mask = {__val = {8390891524071635753, 2865525649010281, 7177085468681690368, 117, 94775918197152, 94775918190944, 140736854763904, 140736854763888, 140383983103124, 140736854763952, 6, 140736854764592, 140383970210872, 140736854763936, 140383983103222, 140383973946688}}, sa_flags = 996400384, sa_restorer = 0x7fffda3c29b0}
        sigs = {__val = {32, 0 <repeats 15 times>}}
#2  0x00007fadb1742655 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#3  <signal handler called>
No locals.
#4  0x00007fadb0ad3438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
        resultvar = 0
        pid = 16011
        selftid = 16011
#5  0x00007fadb0ad503a in __GI_abort () at abort.c:89
        save_stage = 2
        act = {__sigaction_handler = {sa_handler = 0x4, sa_sigaction = 0x4}, sa_mask = {__val = {140383988434216, 94775932348672, 140736854765536, 20363863904, 140383988428800, 94775916038146, 211, 94775916039632, 4294967295, 94775930527584, 140383970534796, 140383971631888, 140383971645536, 0, 140383971631888, 94775916038146}}, sa_flags = -1312608256, sa_restorer = 0x5632bccf0802}
        sigs = {__val = {32, 0 <repeats 15 times>}}
#6  0x00007fadb0acbbe7 in __assert_fail_base (fmt=<optimized out>, assertion=assertion@entry=0x5632bccf0802 "nifp->peer_hash->count == 0", file=file@entry=0x5632bccf07f0 "nhrpd/nhrp_peer.c", line=line@entry=211, function=function@entry=0x5632bccf0dd0 "nhrp_peer_interface_del") at assert.c:92
        str = 0x5632bdb56980 "\320$2V"
        total = 4096
#7  0x00007fadb0acbc92 in __GI___assert_fail (assertion=0x5632bccf0802 "nifp->peer_hash->count == 0", file=0x5632bccf07f0 "nhrpd/nhrp_peer.c", line=211, function=0x5632bccf0dd0 "nhrp_peer_interface_del") at assert.c:101
No locals.
#8  0x00005632bcce432b in nhrp_peer_interface_del ()
No symbol table info available.
#9  0x00005632bccdfec2 in ?? ()
No symbol table info available.
#10 0x00007fadb170e565 in if_delete_retain () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#11 0x00007fadb17107b5 in if_delete () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#12 0x00007fadb1710985 in if_terminate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#13 0x00007fadb1754c75 in vrf_delete () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#14 0x00007fadb1754fbb in vrf_terminate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#15 0x00005632bcce12b5 in ?? ()
No symbol table info available.
#16 0x00007fadb17429e3 in quagga_sigevent_process () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#17 0x00007fadb1751e55 in thread_fetch () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#18 0x00007fadb1716de3 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#19 0x00005632bccdc08a in main ()
No symbol table info available.
Dump of assembler code for function __GI___assert_fail:
   0x00007fadb0acbc50 <+0>:	push   %r13
   0x00007fadb0acbc52 <+2>:	push   %r12
   0x00007fadb0acbc54 <+4>:	mov    %rcx,%r13
   0x00007fadb0acbc57 <+7>:	push   %rbp
   0x00007fadb0acbc58 <+8>:	push   %rbx
   0x00007fadb0acbc59 <+9>:	mov    %rsi,%rbp
   0x00007fadb0acbc5c <+12>:	mov    %rdi,%rbx
   0x00007fadb0acbc5f <+15>:	lea    0x1626aa(%rip),%rsi        # 0x7fadb0c2e310
   0x00007fadb0acbc66 <+22>:	lea    0x15f013(%rip),%rdi        # 0x7fadb0c2ac80 <_libc_intl_domainname>
   0x00007fadb0acbc6d <+29>:	mov    %edx,%r12d
   0x00007fadb0acbc70 <+32>:	sub    $0x8,%rsp
   0x00007fadb0acbc74 <+36>:	mov    $0x5,%edx
   0x00007fadb0acbc79 <+41>:	callq  0x7fadb0acc630 <__GI___dcgettext>
   0x00007fadb0acbc7e <+46>:	mov    %r13,%r8
   0x00007fadb0acbc81 <+49>:	mov    %r12d,%ecx
   0x00007fadb0acbc84 <+52>:	mov    %rbp,%rdx
   0x00007fadb0acbc87 <+55>:	mov    %rbx,%rsi
   0x00007fadb0acbc8a <+58>:	mov    %rax,%rdi
   0x00007fadb0acbc8d <+61>:	callq  0x7fadb0acbad0 <__assert_fail_base>
End of assembler dump.
#8  0x00005632bcce432b in nhrp_peer_interface_del ()
Dump of assembler code for function nhrp_peer_interface_del:
   0x00005632bcce4280 <+0>:	push   %rbp
   0x00005632bcce4281 <+1>:	mov    %rsp,%rbp
   0x00005632bcce4284 <+4>:	push   %rbx
   0x00005632bcce4285 <+5>:	sub    $0x8,%rsp
   0x00005632bcce4289 <+9>:	testb  $0x1,0x21d230(%rip)        # 0x5632bcf014c0 <debug_flags>
   0x00005632bcce4290 <+16>:	mov    0xd0(%rdi),%rbx
   0x00005632bcce4297 <+23>:	jne    0x5632bcce42e0 <nhrp_peer_interface_del+96>
   0x00005632bcce4299 <+25>:	mov    0x68(%rbx),%rdi
   0x00005632bcce429d <+29>:	test   %rdi,%rdi
   0x00005632bcce42a0 <+32>:	je     0x5632bcce42d0 <nhrp_peer_interface_del+80>
   0x00005632bcce42a2 <+34>:	lea    -0xa69(%rip),%rsi        # 0x5632bcce3840
   0x00005632bcce42a9 <+41>:	xor    %edx,%edx
   0x00005632bcce42ab <+43>:	callq  0x5632bccdba40
   0x00005632bcce42b0 <+48>:	mov    0x68(%rbx),%rdi
   0x00005632bcce42b4 <+52>:	cmpq   $0x0,0x20(%rdi)
   0x00005632bcce42b9 <+57>:	jne    0x5632bcce430c <nhrp_peer_interface_del+140>
   0x00005632bcce42bb <+59>:	add    $0x8,%rsp
   0x00005632bcce42bf <+63>:	pop    %rbx
   0x00005632bcce42c0 <+64>:	pop    %rbp
   0x00005632bcce42c1 <+65>:	jmpq   0x5632bccdbb98
   0x00005632bcce42c6 <+70>:	nopw   %cs:0x0(%rax,%rax,1)
   0x00005632bcce42d0 <+80>:	add    $0x8,%rsp
   0x00005632bcce42d4 <+84>:	pop    %rbx
   0x00005632bcce42d5 <+85>:	pop    %rbp
   0x00005632bcce42d6 <+86>:	retq   
   0x00005632bcce42d7 <+87>:	nopw   0x0(%rax,%rax,1)
   0x00005632bcce42e0 <+96>:	mov    0x68(%rbx),%rax
   0x00005632bcce42e4 <+100>:	test   %rax,%rax
   0x00005632bcce42e7 <+103>:	je     0x5632bcce4308 <nhrp_peer_interface_del+136>
   0x00005632bcce42e9 <+105>:	mov    0x20(%rax),%rdx
   0x00005632bcce42ed <+109>:	lea    0xbc9c(%rip),%rsi        # 0x5632bcceff90
   0x00005632bcce42f4 <+116>:	lea    0x216345(%rip),%rdi        # 0x5632bcefa640
   0x00005632bcce42fb <+123>:	xor    %eax,%eax
   0x00005632bcce42fd <+125>:	callq  0x5632bcce36b0
   0x00005632bcce4302 <+130>:	jmp    0x5632bcce4299 <nhrp_peer_interface_del+25>
   0x00005632bcce4304 <+132>:	nopl   0x0(%rax)
   0x00005632bcce4308 <+136>:	xor    %edx,%edx
   0x00005632bcce430a <+138>:	jmp    0x5632bcce42ed <nhrp_peer_interface_del+109>
   0x00005632bcce430c <+140>:	lea    0xcabd(%rip),%rcx        # 0x5632bccf0dd0
   0x00005632bcce4313 <+147>:	lea    0xc4d6(%rip),%rsi        # 0x5632bccf07f0
   0x00005632bcce431a <+154>:	lea    0xc4e1(%rip),%rdi        # 0x5632bccf0802
   0x00005632bcce4321 <+161>:	mov    $0xd3,%edx
   0x00005632bcce4326 <+166>:	callq  0x5632bccdb830
End of assembler dump.
#9  0x00005632bccdfec2 in ?? ()
#10 0x00007fadb170e565 in if_delete_retain () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_delete_retain:
   0x00007fadb170e540 <+0>:	mov    0x2e86e1(%rip),%rax        # 0x7fadb19f6c28
   0x00007fadb170e547 <+7>:	push   %rbp
   0x00007fadb170e548 <+8>:	mov    %rsp,%rbp
   0x00007fadb170e54b <+11>:	push   %r12
   0x00007fadb170e54d <+13>:	push   %rbx
   0x00007fadb170e54e <+14>:	mov    0x8(%rax),%rbx
   0x00007fadb170e552 <+18>:	mov    %rdi,%r12
   0x00007fadb170e555 <+21>:	test   %rbx,%rbx
   0x00007fadb170e558 <+24>:	jne    0x7fadb170e56d <if_delete_retain+45>
   0x00007fadb170e55a <+26>:	jmp    0x7fadb170e588 <if_delete_retain+72>
   0x00007fadb170e55c <+28>:	nopl   0x0(%rax)
   0x00007fadb170e560 <+32>:	mov    %r12,%rdi
   0x00007fadb170e563 <+35>:	callq  *%rax
=> 0x00007fadb170e565 <+37>:	mov    (%rbx),%rbx
   0x00007fadb170e568 <+40>:	test   %rbx,%rbx
   0x00007fadb170e56b <+43>:	je     0x7fadb170e588 <if_delete_retain+72>
   0x00007fadb170e56d <+45>:	testb  $0x1,0x18(%rbx)
   0x00007fadb170e571 <+49>:	mov    0x8(%rbx),%rax
   0x00007fadb170e575 <+53>:	je     0x7fadb170e560 <if_delete_retain+32>
   0x00007fadb170e577 <+55>:	mov    0x10(%rbx),%rdi
   0x00007fadb170e57b <+59>:	mov    %r12,%rsi
   0x00007fadb170e57e <+62>:	callq  *%rax
   0x00007fadb170e580 <+64>:	mov    (%rbx),%rbx
   0x00007fadb170e583 <+67>:	test   %rbx,%rbx
   0x00007fadb170e586 <+70>:	jne    0x7fadb170e56d <if_delete_retain+45>
   0x00007fadb170e588 <+72>:	lea    0xf0(%r12),%rdi
   0x00007fadb170e590 <+80>:	callq  0x7fadb1735b50 <qobj_unreg>
   0x00007fadb170e595 <+85>:	mov    0xc0(%r12),%rdi
   0x00007fadb170e59d <+93>:	callq  0x7fadb17178f0 <list_delete_all_node>
   0x00007fadb170e5a2 <+98>:	pop    %rbx
   0x00007fadb170e5a3 <+99>:	mov    0xc8(%r12),%rdi
   0x00007fadb170e5ab <+107>:	pop    %r12
   0x00007fadb170e5ad <+109>:	pop    %rbp
   0x00007fadb170e5ae <+110>:	jmpq   0x7fadb17178f0 <list_delete_all_node>
End of assembler dump.
#11 0x00007fadb17107b5 in if_delete () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_delete:
   0x00007fadb1710760 <+0>:	push   %rbp
   0x00007fadb1710761 <+1>:	mov    %rsp,%rbp
   0x00007fadb1710764 <+4>:	push   %r13
   0x00007fadb1710766 <+6>:	push   %r12
   0x00007fadb1710768 <+8>:	push   %rbx
   0x00007fadb1710769 <+9>:	mov    %rdi,%r13
   0x00007fadb171076c <+12>:	sub    $0x8,%rsp
   0x00007fadb1710770 <+16>:	mov    (%rdi),%rbx
   0x00007fadb1710773 <+19>:	mov    0xe8(%rbx),%edi
   0x00007fadb1710779 <+25>:	callq  0x7fadb1754960 <vrf_lookup_by_id>
   0x00007fadb171077e <+30>:	test   %rax,%rax
   0x00007fadb1710781 <+33>:	je     0x7fadb1710897 <if_delete+311>
   0x00007fadb1710787 <+39>:	lea    0x70(%rax),%rsi
   0x00007fadb171078b <+43>:	lea    0x2d19fe(%rip),%rdi        # 0x7fadb19e2190
   0x00007fadb1710792 <+50>:	mov    %rbx,%rdx
   0x00007fadb1710795 <+53>:	mov    %rax,%r12
   0x00007fadb1710798 <+56>:	callq  0x7fadb172d3b0 <_rb_remove>
   0x00007fadb171079d <+61>:	test   %rax,%rax
   0x00007fadb17107a0 <+64>:	je     0x7fadb1710868 <if_delete+264>
   0x00007fadb17107a6 <+70>:	mov    0x54(%rbx),%eax
   0x00007fadb17107a9 <+73>:	test   %eax,%eax
   0x00007fadb17107ab <+75>:	jne    0x7fadb1710818 <if_delete+184>
   0x00007fadb17107ad <+77>:	mov    %rbx,%rdi
   0x00007fadb17107b0 <+80>:	callq  0x7fadb170e540 <if_delete_retain>
=> 0x00007fadb17107b5 <+85>:	lea    0xc0(%rbx),%rdi
   0x00007fadb17107bc <+92>:	callq  0x7fadb1717990 <list_delete>
   0x00007fadb17107c1 <+97>:	lea    0xc8(%rbx),%rdi
   0x00007fadb17107c8 <+104>:	callq  0x7fadb1717990 <list_delete>
   0x00007fadb17107cd <+109>:	mov    %rbx,%rdi
   0x00007fadb17107d0 <+112>:	callq  0x7fadb1710720 <if_link_params_free>
   0x00007fadb17107d5 <+117>:	mov    0xa8(%rbx),%rsi
   0x00007fadb17107dc <+124>:	mov    0x2e6745(%rip),%rdi        # 0x7fadb19f6f28
   0x00007fadb17107e3 <+131>:	callq  0x7fadb171ebf0 <qfree>
   0x00007fadb17107e8 <+136>:	lea    0x2e8191(%rip),%rdi        # 0x7fadb19f8980
   0x00007fadb17107ef <+143>:	movq   $0x0,0xa8(%rbx)
   0x00007fadb17107fa <+154>:	mov    %rbx,%rsi
   0x00007fadb17107fd <+157>:	callq  0x7fadb171ebf0 <qfree>
   0x00007fadb1710802 <+162>:	movq   $0x0,0x0(%r13)
   0x00007fadb171080a <+170>:	add    $0x8,%rsp
   0x00007fadb171080e <+174>:	pop    %rbx
   0x00007fadb171080f <+175>:	pop    %r12
   0x00007fadb1710811 <+177>:	pop    %r13
   0x00007fadb1710813 <+179>:	pop    %rbp
   0x00007fadb1710814 <+180>:	retq   
   0x00007fadb1710815 <+181>:	nopl   (%rax)
   0x00007fadb1710818 <+184>:	lea    0x78(%r12),%rsi
   0x00007fadb171081d <+189>:	lea    0x2d194c(%rip),%rdi        # 0x7fadb19e2170
   0x00007fadb1710824 <+196>:	mov    %rbx,%rdx
   0x00007fadb1710827 <+199>:	callq  0x7fadb172d3b0 <_rb_remove>
   0x00007fadb171082c <+204>:	test   %rax,%rax
   0x00007fadb171082f <+207>:	jne    0x7fadb17107ad <if_delete+77>
   0x00007fadb1710835 <+213>:	mov    0xe8(%rbx),%r9d
   0x00007fadb171083c <+220>:	mov    0x54(%rbx),%r8d
   0x00007fadb1710840 <+224>:	lea    0x6ad31(%rip),%rcx        # 0x7fadb177b578
   0x00007fadb1710847 <+231>:	lea    0x6a362(%rip),%rsi        # 0x7fadb177abb0
   0x00007fadb171084e <+238>:	lea    0x2d108b(%rip),%rdi        # 0x7fadb19e18e0
   0x00007fadb1710855 <+245>:	mov    $0x6000009,%edx
   0x00007fadb171085a <+250>:	callq  0x7fadb170d7e0
   0x00007fadb171085f <+255>:	jmpq   0x7fadb17107ad <if_delete+77>
   0x00007fadb1710864 <+260>:	nopl   0x0(%rax)
   0x00007fadb1710868 <+264>:	mov    0xe8(%rbx),%r9d
   0x00007fadb171086f <+271>:	lea    0x40(%rbx),%r8
   0x00007fadb1710873 <+275>:	lea    0x6acfe(%rip),%rcx        # 0x7fadb177b578
   0x00007fadb171087a <+282>:	lea    0x6a2cf(%rip),%rsi        # 0x7fadb177ab50
   0x00007fadb1710881 <+289>:	lea    0x2d1098(%rip),%rdi        # 0x7fadb19e1920
   0x00007fadb1710888 <+296>:	mov    $0x6000009,%edx
   0x00007fadb171088d <+301>:	callq  0x7fadb170d7e0
   0x00007fadb1710892 <+306>:	jmpq   0x7fadb17107a6 <if_delete+70>
   0x00007fadb1710897 <+311>:	lea    0x6acea(%rip),%rcx        # 0x7fadb177b588
   0x00007fadb171089e <+318>:	lea    0x69da9(%rip),%rsi        # 0x7fadb177a64e
   0x00007fadb17108a5 <+325>:	lea    0x82e0b(%rip),%rdi        # 0x7fadb17936b7
   0x00007fadb17108ac <+332>:	mov    $0x133,%edx
   0x00007fadb17108b1 <+337>:	callq  0x7fadb16e9768
End of assembler dump.
#12 0x00007fadb1710985 in if_terminate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_terminate:
   0x00007fadb1710910 <+0>:	push   %rbp
   0x00007fadb1710911 <+1>:	mov    %rsp,%rbp
   0x00007fadb1710914 <+4>:	push   %r13
   0x00007fadb1710916 <+6>:	push   %r12
   0x00007fadb1710918 <+8>:	push   %rbx
   0x00007fadb1710919 <+9>:	sub    $0x18,%rsp
   0x00007fadb171091d <+13>:	mov    %fs:0x28,%rax
   0x00007fadb1710926 <+22>:	mov    %rax,-0x28(%rbp)
   0x00007fadb171092a <+26>:	xor    %eax,%eax
   0x00007fadb171092c <+28>:	cmpq   $0x0,0x70(%rdi)
   0x00007fadb1710931 <+33>:	je     0x7fadb171098c <if_terminate+124>
   0x00007fadb1710933 <+35>:	lea    0x70(%rdi),%r13
   0x00007fadb1710937 <+39>:	lea    -0x30(%rbp),%r12
   0x00007fadb171093b <+43>:	mov    %rdi,%rbx
   0x00007fadb171093e <+46>:	xchg   %ax,%ax
   0x00007fadb1710940 <+48>:	lea    0x2d1849(%rip),%rdi        # 0x7fadb19e2190
   0x00007fadb1710947 <+55>:	mov    %r13,%rsi
   0x00007fadb171094a <+58>:	callq  0x7fadb172e0e0 <_rb_root>
   0x00007fadb171094f <+63>:	mov    0xe0(%rax),%rdi
   0x00007fadb1710956 <+70>:	mov    %rax,-0x30(%rbp)
   0x00007fadb171095a <+74>:	test   %rdi,%rdi
   0x00007fadb171095d <+77>:	je     0x7fadb171097d <if_terminate+109>
   0x00007fadb171095f <+79>:	mov    0x50(%rdi),%eax
   0x00007fadb1710962 <+82>:	movq   $0x0,0x68(%rdi)
   0x00007fadb171096a <+90>:	test   %eax,%eax
   0x00007fadb171096c <+92>:	je     0x7fadb17109a6 <if_terminate+150>
   0x00007fadb171096e <+94>:	sub    $0x1,%eax
   0x00007fadb1710971 <+97>:	test   %eax,%eax
   0x00007fadb1710973 <+99>:	mov    %eax,0x50(%rdi)
   0x00007fadb1710976 <+102>:	jne    0x7fadb171097d <if_terminate+109>
   0x00007fadb1710978 <+104>:	callq  0x7fadb174cff0 <route_node_delete>
   0x00007fadb171097d <+109>:	mov    %r12,%rdi
   0x00007fadb1710980 <+112>:	callq  0x7fadb1710760 <if_delete>
=> 0x00007fadb1710985 <+117>:	cmpq   $0x0,0x70(%rbx)
   0x00007fadb171098a <+122>:	jne    0x7fadb1710940 <if_terminate+48>
   0x00007fadb171098c <+124>:	mov    -0x28(%rbp),%rax
   0x00007fadb1710990 <+128>:	xor    %fs:0x28,%rax
   0x00007fadb1710999 <+137>:	jne    0x7fadb17109c5 <if_terminate+181>
   0x00007fadb171099b <+139>:	add    $0x18,%rsp
   0x00007fadb171099f <+143>:	pop    %rbx
   0x00007fadb17109a0 <+144>:	pop    %r12
   0x00007fadb17109a2 <+146>:	pop    %r13
   0x00007fadb17109a4 <+148>:	pop    %rbp
   0x00007fadb17109a5 <+149>:	retq   
   0x00007fadb17109a6 <+150>:	lea    0x6aa43(%rip),%rcx        # 0x7fadb177b3f0
   0x00007fadb17109ad <+157>:	lea    0x6a011(%rip),%rsi        # 0x7fadb177a9c5
   0x00007fadb17109b4 <+164>:	lea    0x6a016(%rip),%rdi        # 0x7fadb177a9d1
   0x00007fadb17109bb <+171>:	mov    $0x102,%edx
   0x00007fadb17109c0 <+176>:	callq  0x7fadb16e9768
   0x00007fadb17109c5 <+181>:	callq  0x7fadb16e96a0
End of assembler dump.

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17902/artifact/TOPOU1604/ErrorLog/log_topotests.txt

Topotests Ubuntu 18.04 amd64 part 0: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1804-17902/test

Topology Tests failed for Topotests Ubuntu 18.04 amd64 part 0
see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17902/artifact/TOPOU1804/ErrorLog/log_topotests.txt

Topotests Ubuntu 16.04 i386 part 0: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOI386-17902/test

Topology Tests failed for Topotests Ubuntu 16.04 i386 part 0:

No function contains program counter for selected frame.
No function contains program counter for selected frame.
No function contains program counter for selected frame.
No function contains program counter for selected frame.

r1: nhrpd crashed. Core file found - Backtrace follows:
[New LWP 10616]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/nhrpd --log file:nhrpd.log --log-level debug -d'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7f3bcf5 in ?? ()
  Id   Target Id         Frame 
* 1    Thread 0xb78027c0 (LWP 10616) 0xb7f3bcf5 in ?? ()
#0  0xb7f3bcf5 in ?? ()
No symbol table info available.
#1  <signal handler called>
No symbol table info available.
#2  0xb7f3bcf5 in ?? ()
No symbol table info available.
#3  0x004d1ab5 in ?? ()
No symbol table info available.
#4  0xb7e3e536 in if_delete_retain () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#5  0xb7e40a70 in if_delete () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#6  0xb7e40c7b in if_terminate () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#7  0xb7e875fa in vrf_delete () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#8  0xb7e879f6 in vrf_terminate () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#9  0x004d2ea3 in ?? ()
No symbol table info available.
#10 0xb7e753a1 in quagga_sigevent_process () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#11 0xb7e8486d in thread_fetch () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#12 0xb7e472e6 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#13 0x004cddaa in main ()
No symbol table info available.
#1  <signal handler called>
#2  0xb7f3bcf5 in ?? ()
#3  0x004d1ab5 in ?? ()
#4  0xb7e3e536 in if_delete_retain () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_delete_retain:
   0xb7e3e500 <+0>:	push   %ebp
   0xb7e3e501 <+1>:	mov    %esp,%ebp
   0xb7e3e503 <+3>:	push   %edi
   0xb7e3e504 <+4>:	push   %esi
   0xb7e3e505 <+5>:	push   %ebx
   0xb7e3e506 <+6>:	call   0xb7e1d640
   0xb7e3e50b <+11>:	add    $0xe5505,%ebx
   0xb7e3e511 <+17>:	sub    $0xc,%esp
   0xb7e3e514 <+20>:	mov    0x8(%ebp),%edi
   0xb7e3e517 <+23>:	mov    0x3f4(%ebx),%eax
   0xb7e3e51d <+29>:	mov    0x4(%eax),%esi
   0xb7e3e520 <+32>:	test   %esi,%esi
   0xb7e3e522 <+34>:	jne    0xb7e3e53f <if_delete_retain+63>
   0xb7e3e524 <+36>:	jmp    0xb7e3e55a <if_delete_retain+90>
   0xb7e3e526 <+38>:	lea    0x0(%esi),%esi
   0xb7e3e529 <+41>:	lea    0x0(%edi,%eiz,1),%edi
   0xb7e3e530 <+48>:	sub    $0xc,%esp
   0xb7e3e533 <+51>:	push   %edi
   0xb7e3e534 <+52>:	call   *%eax
=> 0xb7e3e536 <+54>:	mov    (%esi),%esi
   0xb7e3e538 <+56>:	add    $0x10,%esp
   0xb7e3e53b <+59>:	test   %esi,%esi
   0xb7e3e53d <+61>:	je     0xb7e3e55a <if_delete_retain+90>
   0xb7e3e53f <+63>:	testb  $0x1,0xc(%esi)
   0xb7e3e543 <+67>:	mov    0x4(%esi),%eax
   0xb7e3e546 <+70>:	je     0xb7e3e530 <if_delete_retain+48>
   0xb7e3e548 <+72>:	sub    $0x8,%esp
   0xb7e3e54b <+75>:	push   %edi
   0xb7e3e54c <+76>:	pushl  0x8(%esi)
   0xb7e3e54f <+79>:	call   *%eax
   0xb7e3e551 <+81>:	mov    (%esi),%esi
   0xb7e3e553 <+83>:	add    $0x10,%esp
   0xb7e3e556 <+86>:	test   %esi,%esi
   0xb7e3e558 <+88>:	jne    0xb7e3e53f <if_delete_retain+63>
   0xb7e3e55a <+90>:	lea    0xa8(%edi),%eax
   0xb7e3e560 <+96>:	sub    $0xc,%esp
   0xb7e3e563 <+99>:	push   %eax
   0xb7e3e564 <+100>:	call   0xb7e67710 <qobj_unreg>
   0xb7e3e569 <+105>:	pop    %eax
   0xb7e3e56a <+106>:	pushl  0x8c(%edi)
   0xb7e3e570 <+112>:	call   0xb7e47e00 <list_delete_all_node>
   0xb7e3e575 <+117>:	pop    %edx
   0xb7e3e576 <+118>:	pushl  0x90(%edi)
   0xb7e3e57c <+124>:	call   0xb7e47e00 <list_delete_all_node>
   0xb7e3e581 <+129>:	lea    -0xc(%ebp),%esp
   0xb7e3e584 <+132>:	pop    %ebx
   0xb7e3e585 <+133>:	pop    %esi
   0xb7e3e586 <+134>:	pop    %edi
   0xb7e3e587 <+135>:	pop    %ebp
   0xb7e3e588 <+136>:	ret    
End of assembler dump.
#5  0xb7e40a70 in if_delete () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_delete:
   0xb7e40a10 <+0>:	push   %ebp
   0xb7e40a11 <+1>:	mov    %esp,%ebp
   0xb7e40a13 <+3>:	push   %edi
   0xb7e40a14 <+4>:	push   %esi
   0xb7e40a15 <+5>:	push   %ebx
   0xb7e40a16 <+6>:	call   0xb7e1d640
   0xb7e40a1b <+11>:	add    $0xe2ff5,%ebx
   0xb7e40a21 <+17>:	sub    $0x18,%esp
   0xb7e40a24 <+20>:	mov    0x8(%ebp),%eax
   0xb7e40a27 <+23>:	mov    (%eax),%esi
   0xb7e40a29 <+25>:	pushl  0xa0(%esi)
   0xb7e40a2f <+31>:	call   0xb7e87290 <vrf_lookup_by_id>
   0xb7e40a34 <+36>:	add    $0x10,%esp
   0xb7e40a37 <+39>:	test   %eax,%eax
   0xb7e40a39 <+41>:	je     0xb7e40b64 <if_delete+340>
   0xb7e40a3f <+47>:	mov    %eax,%edi
   0xb7e40a41 <+49>:	lea    0x4c(%eax),%eax
   0xb7e40a44 <+52>:	sub    $0x4,%esp
   0xb7e40a47 <+55>:	push   %esi
   0xb7e40a48 <+56>:	push   %eax
   0xb7e40a49 <+57>:	lea    -0xf110(%ebx),%eax
   0xb7e40a4f <+63>:	push   %eax
   0xb7e40a50 <+64>:	call   0xb7e5ead0 <_rb_remove>
   0xb7e40a55 <+69>:	add    $0x10,%esp
   0xb7e40a58 <+72>:	test   %eax,%eax
   0xb7e40a5a <+74>:	je     0xb7e40b30 <if_delete+288>
   0xb7e40a60 <+80>:	mov    0x34(%esi),%eax
   0xb7e40a63 <+83>:	test   %eax,%eax
   0xb7e40a65 <+85>:	jne    0xb7e40ad8 <if_delete+200>
   0xb7e40a67 <+87>:	sub    $0xc,%esp
   0xb7e40a6a <+90>:	push   %esi
   0xb7e40a6b <+91>:	call   0xb7e3e500 <if_delete_retain>
=> 0xb7e40a70 <+96>:	lea    0x8c(%esi),%eax
   0xb7e40a76 <+102>:	mov    %eax,(%esp)
   0xb7e40a79 <+105>:	call   0xb7e47eb0 <list_delete>
   0xb7e40a7e <+110>:	lea    0x90(%esi),%eax
   0xb7e40a84 <+116>:	mov    %eax,(%esp)
   0xb7e40a87 <+119>:	call   0xb7e47eb0 <list_delete>
   0xb7e40a8c <+124>:	mov    %esi,(%esp)
   0xb7e40a8f <+127>:	call   0xb7e409d0 <if_link_params_free>
   0xb7e40a94 <+132>:	pop    %eax
   0xb7e40a95 <+133>:	pop    %edx
   0xb7e40a96 <+134>:	pushl  0x80(%esi)
   0xb7e40a9c <+140>:	pushl  0x590(%ebx)
   0xb7e40aa2 <+146>:	call   0xb7e4f6d0 <qfree>
   0xb7e40aa7 <+151>:	movl   $0x0,0x80(%esi)
   0xb7e40ab1 <+161>:	lea    0x1450(%ebx),%eax
   0xb7e40ab7 <+167>:	pop    %ecx
   0xb7e40ab8 <+168>:	pop    %edi
   0xb7e40ab9 <+169>:	push   %esi
   0xb7e40aba <+170>:	push   %eax
   0xb7e40abb <+171>:	call   0xb7e4f6d0 <qfree>
   0xb7e40ac0 <+176>:	mov    0x8(%ebp),%eax
   0xb7e40ac3 <+179>:	add    $0x10,%esp
   0xb7e40ac6 <+182>:	movl   $0x0,(%eax)
   0xb7e40acc <+188>:	lea    -0xc(%ebp),%esp
   0xb7e40acf <+191>:	pop    %ebx
   0xb7e40ad0 <+192>:	pop    %esi
   0xb7e40ad1 <+193>:	pop    %edi
   0xb7e40ad2 <+194>:	pop    %ebp
   0xb7e40ad3 <+195>:	ret    
   0xb7e40ad4 <+196>:	lea    0x0(%esi,%eiz,1),%esi
   0xb7e40ad8 <+200>:	lea    0x50(%edi),%edx
   0xb7e40adb <+203>:	lea    -0xf120(%ebx),%eax
   0xb7e40ae1 <+209>:	sub    $0x4,%esp
   0xb7e40ae4 <+212>:	push   %esi
   0xb7e40ae5 <+213>:	push   %edx
   0xb7e40ae6 <+214>:	push   %eax
   0xb7e40ae7 <+215>:	call   0xb7e5ead0 <_rb_remove>
   0xb7e40aec <+220>:	add    $0x10,%esp
   0xb7e40aef <+223>:	test   %eax,%eax
   0xb7e40af1 <+225>:	jne    0xb7e40a67 <if_delete+87>
   0xb7e40af7 <+231>:	lea    -0x76000(%ebx),%eax
   0xb7e40afd <+237>:	sub    $0x8,%esp
   0xb7e40b00 <+240>:	pushl  0xa0(%esi)
   0xb7e40b06 <+246>:	pushl  0x34(%esi)
   0xb7e40b09 <+249>:	push   %eax
   0xb7e40b0a <+250>:	lea    -0x76914(%ebx),%eax
   0xb7e40b10 <+256>:	push   $0x6000009
   0xb7e40b15 <+261>:	push   %eax
   0xb7e40b16 <+262>:	lea    -0xf650(%ebx),%eax
   0xb7e40b1c <+268>:	push   %eax
   0xb7e40b1d <+269>:	call   0xb7e3d650
   0xb7e40b22 <+274>:	add    $0x20,%esp
   0xb7e40b25 <+277>:	jmp    0xb7e40a67 <if_delete+87>
   0xb7e40b2a <+282>:	lea    0x0(%esi),%esi
   0xb7e40b30 <+288>:	lea    0x20(%esi),%eax
   0xb7e40b33 <+291>:	sub    $0x8,%esp
   0xb7e40b36 <+294>:	pushl  0xa0(%esi)
   0xb7e40b3c <+300>:	push   %eax
   0xb7e40b3d <+301>:	lea    -0x76000(%ebx),%eax
   0xb7e40b43 <+307>:	push   %eax
   0xb7e40b44 <+308>:	lea    -0x76970(%ebx),%eax
   0xb7e40b4a <+314>:	push   $0x6000009
   0xb7e40b4f <+319>:	push   %eax
   0xb7e40b50 <+320>:	lea    -0xf610(%ebx),%eax
   0xb7e40b56 <+326>:	push   %eax
   0xb7e40b57 <+327>:	call   0xb7e3d650
   0xb7e40b5c <+332>:	add    $0x20,%esp
   0xb7e40b5f <+335>:	jmp    0xb7e40a60 <if_delete+80>
   0xb7e40b64 <+340>:	lea    -0x75ff4(%ebx),%eax
   0xb7e40b6a <+346>:	push   %eax
   0xb7e40b6b <+347>:	lea    -0x76e6a(%ebx),%eax
   0xb7e40b71 <+353>:	push   $0x133
   0xb7e40b76 <+358>:	push   %eax
   0xb7e40b77 <+359>:	lea    -0x5ecfd(%ebx),%eax
   0xb7e40b7d <+365>:	push   %eax
   0xb7e40b7e <+366>:	call   0xb7e18e58
End of assembler dump.
No function contains program counter for selected frame.
No function contains program counter for selected frame.
No function contains program counter for selected frame.
No function contains program counter for selected frame.

r2: nhrpd crashed. Core file found - Backtrace follows:
[New LWP 10686]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/nhrpd --log file:nhrpd.log --log-level debug -d'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7efacf5 in ?? ()
  Id   Target Id         Frame 
* 1    Thread 0xb77c17c0 (LWP 10686) 0xb7efacf5 in ?? ()
#0  0xb7efacf5 in ?? ()
No symbol table info available.
#1  <signal handler called>
No symbol table info available.
#2  0xb7efacf5 in ?? ()
No symbol table info available.
#3  0x004feab5 in ?? ()
No symbol table info available.
#4  0xb7dfd536 in if_delete_retain () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#5  0xb7dffa70 in if_delete () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#6  0xb7dffc7b in if_terminate () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#7  0xb7e465fa in vrf_delete () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#8  0xb7e469f6 in vrf_terminate () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#9  0x004ffea3 in ?? ()
No symbol table info available.
#10 0xb7e343a1 in quagga_sigevent_process () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#11 0xb7e4386d in thread_fetch () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#12 0xb7e062e6 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#13 0x004fadaa in main ()
No symbol table info available.
#1  <signal handler called>
#2  0xb7efacf5 in ?? ()
#3  0x004feab5 in ?? ()
#4  0xb7dfd536 in if_delete_retain () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_delete_retain:
   0xb7dfd500 <+0>:	push   %ebp
   0xb7dfd501 <+1>:	mov    %esp,%ebp
   0xb7dfd503 <+3>:	push   %edi
   0xb7dfd504 <+4>:	push   %esi
   0xb7dfd505 <+5>:	push   %ebx
   0xb7dfd506 <+6>:	call   0xb7ddc640
   0xb7dfd50b <+11>:	add    $0xe5505,%ebx
   0xb7dfd511 <+17>:	sub    $0xc,%esp
   0xb7dfd514 <+20>:	mov    0x8(%ebp),%edi
   0xb7dfd517 <+23>:	mov    0x3f4(%ebx),%eax
   0xb7dfd51d <+29>:	mov    0x4(%eax),%esi
   0xb7dfd520 <+32>:	test   %esi,%esi
   0xb7dfd522 <+34>:	jne    0xb7dfd53f <if_delete_retain+63>
   0xb7dfd524 <+36>:	jmp    0xb7dfd55a <if_delete_retain+90>
   0xb7dfd526 <+38>:	lea    0x0(%esi),%esi
   0xb7dfd529 <+41>:	lea    0x0(%edi,%eiz,1),%edi
   0xb7dfd530 <+48>:	sub    $0xc,%esp
   0xb7dfd533 <+51>:	push   %edi
   0xb7dfd534 <+52>:	call   *%eax
=> 0xb7dfd536 <+54>:	mov    (%esi),%esi
   0xb7dfd538 <+56>:	add    $0x10,%esp
   0xb7dfd53b <+59>:	test   %esi,%esi
   0xb7dfd53d <+61>:	je     0xb7dfd55a <if_delete_retain+90>
   0xb7dfd53f <+63>:	testb  $0x1,0xc(%esi)
   0xb7dfd543 <+67>:	mov    0x4(%esi),%eax
   0xb7dfd546 <+70>:	je     0xb7dfd530 <if_delete_retain+48>
   0xb7dfd548 <+72>:	sub    $0x8,%esp
   0xb7dfd54b <+75>:	push   %edi
   0xb7dfd54c <+76>:	pushl  0x8(%esi)
   0xb7dfd54f <+79>:	call   *%eax
   0xb7dfd551 <+81>:	mov    (%esi),%esi
   0xb7dfd553 <+83>:	add    $0x10,%esp
   0xb7dfd556 <+86>:	test   %esi,%esi
   0xb7dfd558 <+88>:	jne    0xb7dfd53f <if_delete_retain+63>
   0xb7dfd55a <+90>:	lea    0xa8(%edi),%eax
   0xb7dfd560 <+96>:	sub    $0xc,%esp
   0xb7dfd563 <+99>:	push   %eax
   0xb7dfd564 <+100>:	call   0xb7e26710 <qobj_unreg>
   0xb7dfd569 <+105>:	pop    %eax
   0xb7dfd56a <+106>:	pushl  0x8c(%edi)
   0xb7dfd570 <+112>:	call   0xb7e06e00 <list_delete_all_node>
   0xb7dfd575 <+117>:	pop    %edx
   0xb7dfd576 <+118>:	pushl  0x90(%edi)
   0xb7dfd57c <+124>:	call   0xb7e06e00 <list_delete_all_node>
   0xb7dfd581 <+129>:	lea    -0xc(%ebp),%esp
   0xb7dfd584 <+132>:	pop    %ebx
   0xb7dfd585 <+133>:	pop    %esi
   0xb7dfd586 <+134>:	pop    %edi
   0xb7dfd587 <+135>:	pop    %ebp
   0xb7dfd588 <+136>:	ret    
End of assembler dump.
#5  0xb7dffa70 in if_delete () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_delete:
   0xb7dffa10 <+0>:	push   %ebp
   0xb7dffa11 <+1>:	mov    %esp,%ebp
   0xb7dffa13 <+3>:	push   %edi
   0xb7dffa14 <+4>:	push   %esi
   0xb7dffa15 <+5>:	push   %ebx
   0xb7dffa16 <+6>:	call   0xb7ddc640
   0xb7dffa1b <+11>:	add    $0xe2ff5,%ebx
   0xb7dffa21 <+17>:	sub    $0x18,%esp
   0xb7dffa24 <+20>:	mov    0x8(%ebp),%eax
   0xb7dffa27 <+23>:	mov    (%eax),%esi
   0xb7dffa29 <+25>:	pushl  0xa0(%esi)
   0xb7dffa2f <+31>:	call   0xb7e46290 <vrf_lookup_by_id>
   0xb7dffa34 <+36>:	add    $0x10,%esp
   0xb7dffa37 <+39>:	test   %eax,%eax
   0xb7dffa39 <+41>:	je     0xb7dffb64 <if_delete+340>
   0xb7dffa3f <+47>:	mov    %eax,%edi
   0xb7dffa41 <+49>:	lea    0x4c(%eax),%eax
   0xb7dffa44 <+52>:	sub    $0x4,%esp
   0xb7dffa47 <+55>:	push   %esi
   0xb7dffa48 <+56>:	push   %eax
   0xb7dffa49 <+57>:	lea    -0xf110(%ebx),%eax
   0xb7dffa4f <+63>:	push   %eax
   0xb7dffa50 <+64>:	call   0xb7e1dad0 <_rb_remove>
   0xb7dffa55 <+69>:	add    $0x10,%esp
   0xb7dffa58 <+72>:	test   %eax,%eax
   0xb7dffa5a <+74>:	je     0xb7dffb30 <if_delete+288>
   0xb7dffa60 <+80>:	mov    0x34(%esi),%eax
   0xb7dffa63 <+83>:	test   %eax,%eax
   0xb7dffa65 <+85>:	jne    0xb7dffad8 <if_delete+200>
   0xb7dffa67 <+87>:	sub    $0xc,%esp
   0xb7dffa6a <+90>:	push   %esi
   0xb7dffa6b <+91>:	call   0xb7dfd500 <if_delete_retain>
=> 0xb7dffa70 <+96>:	lea    0x8c(%esi),%eax
   0xb7dffa76 <+102>:	mov    %eax,(%esp)
   0xb7dffa79 <+105>:	call   0xb7e06eb0 <list_delete>
   0xb7dffa7e <+110>:	lea    0x90(%esi),%eax
   0xb7dffa84 <+116>:	mov    %eax,(%esp)
   0xb7dffa87 <+119>:	call   0xb7e06eb0 <list_delete>
   0xb7dffa8c <+124>:	mov    %esi,(%esp)
   0xb7dffa8f <+127>:	call   0xb7dff9d0 <if_link_params_free>
   0xb7dffa94 <+132>:	pop    %eax
   0xb7dffa95 <+133>:	pop    %edx
   0xb7dffa96 <+134>:	pushl  0x80(%esi)
   0xb7dffa9c <+140>:	pushl  0x590(%ebx)
   0xb7dffaa2 <+146>:	call   0xb7e0e6d0 <qfree>
   0xb7dffaa7 <+151>:	movl   $0x0,0x80(%esi)
   0xb7dffab1 <+161>:	lea    0x1450(%ebx),%eax
   0xb7dffab7 <+167>:	pop    %ecx
   0xb7dffab8 <+168>:	pop    %edi
   0xb7dffab9 <+169>:	push   %esi
   0xb7dffaba <+170>:	push   %eax
   0xb7dffabb <+171>:	call   0xb7e0e6d0 <qfree>
   0xb7dffac0 <+176>:	mov    0x8(%ebp),%eax
   0xb7dffac3 <+179>:	add    $0x10,%esp
   0xb7dffac6 <+182>:	movl   $0x0,(%eax)
   0xb7dffacc <+188>:	lea    -0xc(%ebp),%esp
   0xb7dffacf <+191>:	pop    %ebx
   0xb7dffad0 <+192>:	pop    %esi
   0xb7dffad1 <+193>:	pop    %edi
   0xb7dffad2 <+194>:	pop    %ebp
   0xb7dffad3 <+195>:	ret    
   0xb7dffad4 <+196>:	lea    0x0(%esi,%eiz,1),%esi
   0xb7dffad8 <+200>:	lea    0x50(%edi),%edx
   0xb7dffadb <+203>:	lea    -0xf120(%ebx),%eax
   0xb7dffae1 <+209>:	sub    $0x4,%esp
   0xb7dffae4 <+212>:	push   %esi
   0xb7dffae5 <+213>:	push   %edx
   0xb7dffae6 <+214>:	push   %eax
   0xb7dffae7 <+215>:	call   0xb7e1dad0 <_rb_remove>
   0xb7dffaec <+220>:	add    $0x10,%esp
   0xb7dffaef <+223>:	test   %eax,%eax
   0xb7dffaf1 <+225>:	jne    0xb7dffa67 <if_delete+87>
   0xb7dffaf7 <+231>:	lea    -0x76000(%ebx),%eax
   0xb7dffafd <+237>:	sub    $0x8,%esp
   0xb7dffb00 <+240>:	pushl  0xa0(%esi)
   0xb7dffb06 <+246>:	pushl  0x34(%esi)
   0xb7dffb09 <+249>:	push   %eax
   0xb7dffb0a <+250>:	lea    -0x76914(%ebx),%eax
   0xb7dffb10 <+256>:	push   $0x6000009
   0xb7dffb15 <+261>:	push   %eax
   0xb7dffb16 <+262>:	lea    -0xf650(%ebx),%eax
   0xb7dffb1c <+268>:	push   %eax
   0xb7dffb1d <+269>:	call   0xb7dfc650
   0xb7dffb22 <+274>:	add    $0x20,%esp
   0xb7dffb25 <+277>:	jmp    0xb7dffa67 <if_delete+87>
   0xb7dffb2a <+282>:	lea    0x0(%esi),%esi
   0xb7dffb30 <+288>:	lea    0x20(%esi),%eax
   0xb7dffb33 <+291>:	sub    $0x8,%esp
   0xb7dffb36 <+294>:	pushl  0xa0(%esi)
   0xb7dffb3c <+300>:	push   %eax
   0xb7dffb3d <+301>:	lea    -0x76000(%ebx),%eax
   0xb7dffb43 <+307>:	push   %eax
   0xb7dffb44 <+308>:	lea    -0x76970(%ebx),%eax
   0xb7dffb4a <+314>:	push   $0x6000009
   0xb7dffb4f <+319>:	push   %eax
   0xb7dffb50 <+320>:	lea    -0xf610(%ebx),%eax
   0xb7dffb56 <+326>:	push   %eax
   0xb7dffb57 <+327>:	call   0xb7dfc650
   0xb7dffb5c <+332>:	add    $0x20,%esp
   0xb7dffb5f <+335>:	jmp    0xb7dffa60 <if_delete+80>
   0xb7dffb64 <+340>:	lea    -0x75ff4(%ebx),%eax
   0xb7dffb6a <+346>:	push   %eax
   0xb7dffb6b <+347>:	lea    -0x76e6a(%ebx),%eax
   0xb7dffb71 <+353>:	push   $0x133
   0xb7dffb76 <+358>:	push   %eax
   0xb7dffb77 <+359>:	lea    -0x5ecfd(%ebx),%eax
   0xb7dffb7d <+365>:	push   %eax
   0xb7dffb7e <+366>:	call   0xb7dd7e58
End of assembler dump.

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17902/artifact/TOPOI386/ErrorLog/log_topotests.txt

Topotests Ubuntu 18.04 arm8 part 4: Failed (click for details)

Topotests Ubuntu 18.04 arm8 part 4: No useful log found

<stdin>:956: space before tab in indent.
		    	       != AF_UNSPEC)
<stdin>:1525: trailing whitespace.
        
warning: 2 lines add whitespace errors.
Report for nhrp_peer.c | 6 issues
===============================================
< WARNING: line over 80 characters
< #1028: FILE: /tmp/f1-24994/nhrp_peer.c:1028:
< WARNING: line over 80 characters
< #1043: FILE: /tmp/f1-24994/nhrp_peer.c:1043:
< WARNING: Too many leading tabs - consider code refactoring
< #1045: FILE: /tmp/f1-24994/nhrp_peer.c:1045:
Report for nhrp_vty.c | 6 issues
===============================================
< ERROR: else should follow close brace '}'
< #655: FILE: /tmp/f1-24994/nhrp_vty.c:655:
< ERROR: code indent should use tabs where possible
< #672: FILE: /tmp/f1-24994/nhrp_vty.c:672:
< WARNING: please, no space before tabs
< #672: FILE: /tmp/f1-24994/nhrp_vty.c:672:

LabN-CI · 2021-03-24T05:10:39Z

💚 Basic BGPD CI results: SUCCESS, 0 tests failed

Results table

_	_
Result	SUCCESS git merge/8240 `925794e`
Date	03/24/2021
Start	00:31:05
Finish	01:10:36
Run-Time	39:31
Total	1815
Pass	1815
Fail	0
Valgrind-Errors	0
Valgrind-Loss	0
Details	vncregress-2021-03-24-00:31:05.txt
Log	autoscript-2021-03-24-00:32:12.log.bz2
Memory	500 480 430

For details, please contact louberger

NetDEF-CI · 2021-03-24T06:45:50Z

Continuous Integration Result: FAILED

See below for issues.
CI System Testrun URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17943/

This is a comment from an automated CI system.
For questions and feedback in regards to this CI system, please feel free to email
Martin Winter - mwinter (at) opensourcerouting.org.

Get source / Pull Request: Successful

Building Stage: Successful

Basic Tests: Failed

Topotests Ubuntu 18.04 amd64 part 0: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1804-17943/test

Topology Tests failed for Topotests Ubuntu 18.04 amd64 part 0
see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17943/artifact/TOPOU1804/ErrorLog/log_topotests.txt

Topotests Ubuntu 18.04 arm8 part 0: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPO0U18ARM8-17943/test

Topology Tests failed for Topotests Ubuntu 18.04 arm8 part 0
see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17943/artifact/TOPO0U18ARM8/ErrorLog/log_topotests.txt

Topotests Ubuntu 16.04 amd64 part 0: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1604-17943/test

Topology Tests failed for Topotests Ubuntu 16.04 amd64 part 0:

54	../sysdeps/unix/sysv/linux/raise.c: No such file or directory.
No function contains program counter for selected frame.

r1: nhrpd crashed. Core file found - Backtrace follows:
[New LWP 22543]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/nhrpd --log file:nhrpd.log --log-level debug -d'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f6b483e0438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
  Id   Target Id         Frame 
* 1    Thread 0x7f6b494a8880 (LWP 22543) 0x00007f6b483e0438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f6b483e0438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
        resultvar = 0
        pid = 22543
        selftid = 22543
#1  0x00007f6b483e203a in __GI_abort () at abort.c:89
        save_stage = 2
        act = {__sigaction_handler = {sa_handler = 0x3833340035313631, sa_sigaction = 0x3833340035313631}, sa_mask = {__val = {8390891524071635753, 2865525649010281, 16348078259409462528, 0, 94106500929952, 94106500923744, 140722824141440, 140722824141424, 140098763144340, 140722824141488, 6, 140722824142128, 140098750252088, 140722824141472, 140098763144438, 140098753987904}}, sa_flags = -1537006336, sa_restorer = 0x7ffc95f1dab0}
        sigs = {__val = {32, 0 <repeats 15 times>}}
#2  0x00007f6b4904f655 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#3  <signal handler called>
No locals.
#4  0x00007f6b483e0438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
        resultvar = 0
        pid = 22543
        selftid = 22543
#5  0x00007f6b483e203a in __GI_abort () at abort.c:89
        save_stage = 2
        act = {__sigaction_handler = {sa_handler = 0x4, sa_sigaction = 0x4}, sa_mask = {__val = {140098768475432, 94106525575328, 140722824143024, 20971988736, 140098768470016, 94106498770978, 211, 94106498772464, 4294967295, 94106523754336, 140098750576012, 140098751673104, 140098751686752, 0, 140098751673104, 94106498770978}}, sa_flags = 1230241792, sa_restorer = 0x5596e06e2822}
        sigs = {__val = {32, 0 <repeats 15 times>}}
#6  0x00007f6b483d8be7 in __assert_fail_base (fmt=<optimized out>, assertion=assertion@entry=0x5596e06e2822 "nifp->peer_hash->count == 0", file=file@entry=0x5596e06e2810 "nhrpd/nhrp_peer.c", line=line@entry=211, function=function@entry=0x5596e06e2df0 "nhrp_peer_interface_del") at assert.c:92
        str = 0x5596e1f4a980 "\330\373vHk\177"
        total = 4096
#7  0x00007f6b483d8c92 in __GI___assert_fail (assertion=0x5596e06e2822 "nifp->peer_hash->count == 0", file=0x5596e06e2810 "nhrpd/nhrp_peer.c", line=211, function=0x5596e06e2df0 "nhrp_peer_interface_del") at assert.c:101
No locals.
#8  0x00005596e06d634b in nhrp_peer_interface_del ()
No symbol table info available.
#9  0x00005596e06d1ee2 in ?? ()
No symbol table info available.
#10 0x00007f6b4901b565 in if_delete_retain () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#11 0x00007f6b4901d7b5 in if_delete () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#12 0x00007f6b4901d985 in if_terminate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#13 0x00007f6b49061c75 in vrf_delete () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#14 0x00007f6b49061fbb in vrf_terminate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#15 0x00005596e06d32d5 in ?? ()
No symbol table info available.
#16 0x00007f6b4904f9e3 in quagga_sigevent_process () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#17 0x00007f6b4905ee55 in thread_fetch () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#18 0x00007f6b49023de3 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#19 0x00005596e06ce08a in main ()
No symbol table info available.
Dump of assembler code for function __GI___assert_fail:
   0x00007f6b483d8c50 <+0>:	push   %r13
   0x00007f6b483d8c52 <+2>:	push   %r12
   0x00007f6b483d8c54 <+4>:	mov    %rcx,%r13
   0x00007f6b483d8c57 <+7>:	push   %rbp
   0x00007f6b483d8c58 <+8>:	push   %rbx
   0x00007f6b483d8c59 <+9>:	mov    %rsi,%rbp
   0x00007f6b483d8c5c <+12>:	mov    %rdi,%rbx
   0x00007f6b483d8c5f <+15>:	lea    0x1626aa(%rip),%rsi        # 0x7f6b4853b310
   0x00007f6b483d8c66 <+22>:	lea    0x15f013(%rip),%rdi        # 0x7f6b48537c80 <_libc_intl_domainname>
   0x00007f6b483d8c6d <+29>:	mov    %edx,%r12d
   0x00007f6b483d8c70 <+32>:	sub    $0x8,%rsp
   0x00007f6b483d8c74 <+36>:	mov    $0x5,%edx
   0x00007f6b483d8c79 <+41>:	callq  0x7f6b483d9630 <__GI___dcgettext>
   0x00007f6b483d8c7e <+46>:	mov    %r13,%r8
   0x00007f6b483d8c81 <+49>:	mov    %r12d,%ecx
   0x00007f6b483d8c84 <+52>:	mov    %rbp,%rdx
   0x00007f6b483d8c87 <+55>:	mov    %rbx,%rsi
   0x00007f6b483d8c8a <+58>:	mov    %rax,%rdi
   0x00007f6b483d8c8d <+61>:	callq  0x7f6b483d8ad0 <__assert_fail_base>
End of assembler dump.
#8  0x00005596e06d634b in nhrp_peer_interface_del ()
Dump of assembler code for function nhrp_peer_interface_del:
   0x00005596e06d62a0 <+0>:	push   %rbp
   0x00005596e06d62a1 <+1>:	mov    %rsp,%rbp
   0x00005596e06d62a4 <+4>:	push   %rbx
   0x00005596e06d62a5 <+5>:	sub    $0x8,%rsp
   0x00005596e06d62a9 <+9>:	testb  $0x1,0x21d210(%rip)        # 0x5596e08f34c0 <debug_flags>
   0x00005596e06d62b0 <+16>:	mov    0xd0(%rdi),%rbx
   0x00005596e06d62b7 <+23>:	jne    0x5596e06d6300 <nhrp_peer_interface_del+96>
   0x00005596e06d62b9 <+25>:	mov    0x68(%rbx),%rdi
   0x00005596e06d62bd <+29>:	test   %rdi,%rdi
   0x00005596e06d62c0 <+32>:	je     0x5596e06d62f0 <nhrp_peer_interface_del+80>
   0x00005596e06d62c2 <+34>:	lea    -0xa69(%rip),%rsi        # 0x5596e06d5860
   0x00005596e06d62c9 <+41>:	xor    %edx,%edx
   0x00005596e06d62cb <+43>:	callq  0x5596e06cda40
   0x00005596e06d62d0 <+48>:	mov    0x68(%rbx),%rdi
   0x00005596e06d62d4 <+52>:	cmpq   $0x0,0x20(%rdi)
   0x00005596e06d62d9 <+57>:	jne    0x5596e06d632c <nhrp_peer_interface_del+140>
   0x00005596e06d62db <+59>:	add    $0x8,%rsp
   0x00005596e06d62df <+63>:	pop    %rbx
   0x00005596e06d62e0 <+64>:	pop    %rbp
   0x00005596e06d62e1 <+65>:	jmpq   0x5596e06cdb98
   0x00005596e06d62e6 <+70>:	nopw   %cs:0x0(%rax,%rax,1)
   0x00005596e06d62f0 <+80>:	add    $0x8,%rsp
   0x00005596e06d62f4 <+84>:	pop    %rbx
   0x00005596e06d62f5 <+85>:	pop    %rbp
   0x00005596e06d62f6 <+86>:	retq   
   0x00005596e06d62f7 <+87>:	nopw   0x0(%rax,%rax,1)
   0x00005596e06d6300 <+96>:	mov    0x68(%rbx),%rax
   0x00005596e06d6304 <+100>:	test   %rax,%rax
   0x00005596e06d6307 <+103>:	je     0x5596e06d6328 <nhrp_peer_interface_del+136>
   0x00005596e06d6309 <+105>:	mov    0x20(%rax),%rdx
   0x00005596e06d630d <+109>:	lea    0xbc9c(%rip),%rsi        # 0x5596e06e1fb0
   0x00005596e06d6314 <+116>:	lea    0x216325(%rip),%rdi        # 0x5596e08ec640
   0x00005596e06d631b <+123>:	xor    %eax,%eax
   0x00005596e06d631d <+125>:	callq  0x5596e06d56d0
   0x00005596e06d6322 <+130>:	jmp    0x5596e06d62b9 <nhrp_peer_interface_del+25>
   0x00005596e06d6324 <+132>:	nopl   0x0(%rax)
   0x00005596e06d6328 <+136>:	xor    %edx,%edx
   0x00005596e06d632a <+138>:	jmp    0x5596e06d630d <nhrp_peer_interface_del+109>
   0x00005596e06d632c <+140>:	lea    0xcabd(%rip),%rcx        # 0x5596e06e2df0
   0x00005596e06d6333 <+147>:	lea    0xc4d6(%rip),%rsi        # 0x5596e06e2810
   0x00005596e06d633a <+154>:	lea    0xc4e1(%rip),%rdi        # 0x5596e06e2822
   0x00005596e06d6341 <+161>:	mov    $0xd3,%edx
   0x00005596e06d6346 <+166>:	callq  0x5596e06cd830
End of assembler dump.
#9  0x00005596e06d1ee2 in ?? ()
#10 0x00007f6b4901b565 in if_delete_retain () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_delete_retain:
   0x00007f6b4901b540 <+0>:	mov    0x2e86e1(%rip),%rax        # 0x7f6b49303c28
   0x00007f6b4901b547 <+7>:	push   %rbp
   0x00007f6b4901b548 <+8>:	mov    %rsp,%rbp
   0x00007f6b4901b54b <+11>:	push   %r12
   0x00007f6b4901b54d <+13>:	push   %rbx
   0x00007f6b4901b54e <+14>:	mov    0x8(%rax),%rbx
   0x00007f6b4901b552 <+18>:	mov    %rdi,%r12
   0x00007f6b4901b555 <+21>:	test   %rbx,%rbx
   0x00007f6b4901b558 <+24>:	jne    0x7f6b4901b56d <if_delete_retain+45>
   0x00007f6b4901b55a <+26>:	jmp    0x7f6b4901b588 <if_delete_retain+72>
   0x00007f6b4901b55c <+28>:	nopl   0x0(%rax)
   0x00007f6b4901b560 <+32>:	mov    %r12,%rdi
   0x00007f6b4901b563 <+35>:	callq  *%rax
=> 0x00007f6b4901b565 <+37>:	mov    (%rbx),%rbx
   0x00007f6b4901b568 <+40>:	test   %rbx,%rbx
   0x00007f6b4901b56b <+43>:	je     0x7f6b4901b588 <if_delete_retain+72>
   0x00007f6b4901b56d <+45>:	testb  $0x1,0x18(%rbx)
   0x00007f6b4901b571 <+49>:	mov    0x8(%rbx),%rax
   0x00007f6b4901b575 <+53>:	je     0x7f6b4901b560 <if_delete_retain+32>
   0x00007f6b4901b577 <+55>:	mov    0x10(%rbx),%rdi
   0x00007f6b4901b57b <+59>:	mov    %r12,%rsi
   0x00007f6b4901b57e <+62>:	callq  *%rax
   0x00007f6b4901b580 <+64>:	mov    (%rbx),%rbx
   0x00007f6b4901b583 <+67>:	test   %rbx,%rbx
   0x00007f6b4901b586 <+70>:	jne    0x7f6b4901b56d <if_delete_retain+45>
   0x00007f6b4901b588 <+72>:	lea    0xf0(%r12),%rdi
   0x00007f6b4901b590 <+80>:	callq  0x7f6b49042b50 <qobj_unreg>
   0x00007f6b4901b595 <+85>:	mov    0xc0(%r12),%rdi
   0x00007f6b4901b59d <+93>:	callq  0x7f6b490248f0 <list_delete_all_node>
   0x00007f6b4901b5a2 <+98>:	pop    %rbx
   0x00007f6b4901b5a3 <+99>:	mov    0xc8(%r12),%rdi
   0x00007f6b4901b5ab <+107>:	pop    %r12
   0x00007f6b4901b5ad <+109>:	pop    %rbp
   0x00007f6b4901b5ae <+110>:	jmpq   0x7f6b490248f0 <list_delete_all_node>
End of assembler dump.
#11 0x00007f6b4901d7b5 in if_delete () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_delete:
   0x00007f6b4901d760 <+0>:	push   %rbp
   0x00007f6b4901d761 <+1>:	mov    %rsp,%rbp
   0x00007f6b4901d764 <+4>:	push   %r13
   0x00007f6b4901d766 <+6>:	push   %r12
   0x00007f6b4901d768 <+8>:	push   %rbx
   0x00007f6b4901d769 <+9>:	mov    %rdi,%r13
   0x00007f6b4901d76c <+12>:	sub    $0x8,%rsp
   0x00007f6b4901d770 <+16>:	mov    (%rdi),%rbx
   0x00007f6b4901d773 <+19>:	mov    0xe8(%rbx),%edi
   0x00007f6b4901d779 <+25>:	callq  0x7f6b49061960 <vrf_lookup_by_id>
   0x00007f6b4901d77e <+30>:	test   %rax,%rax
   0x00007f6b4901d781 <+33>:	je     0x7f6b4901d897 <if_delete+311>
   0x00007f6b4901d787 <+39>:	lea    0x70(%rax),%rsi
   0x00007f6b4901d78b <+43>:	lea    0x2d19fe(%rip),%rdi        # 0x7f6b492ef190
   0x00007f6b4901d792 <+50>:	mov    %rbx,%rdx
   0x00007f6b4901d795 <+53>:	mov    %rax,%r12
   0x00007f6b4901d798 <+56>:	callq  0x7f6b4903a3b0 <_rb_remove>
   0x00007f6b4901d79d <+61>:	test   %rax,%rax
   0x00007f6b4901d7a0 <+64>:	je     0x7f6b4901d868 <if_delete+264>
   0x00007f6b4901d7a6 <+70>:	mov    0x54(%rbx),%eax
   0x00007f6b4901d7a9 <+73>:	test   %eax,%eax
   0x00007f6b4901d7ab <+75>:	jne    0x7f6b4901d818 <if_delete+184>
   0x00007f6b4901d7ad <+77>:	mov    %rbx,%rdi
   0x00007f6b4901d7b0 <+80>:	callq  0x7f6b4901b540 <if_delete_retain>
=> 0x00007f6b4901d7b5 <+85>:	lea    0xc0(%rbx),%rdi
   0x00007f6b4901d7bc <+92>:	callq  0x7f6b49024990 <list_delete>
   0x00007f6b4901d7c1 <+97>:	lea    0xc8(%rbx),%rdi
   0x00007f6b4901d7c8 <+104>:	callq  0x7f6b49024990 <list_delete>
   0x00007f6b4901d7cd <+109>:	mov    %rbx,%rdi
   0x00007f6b4901d7d0 <+112>:	callq  0x7f6b4901d720 <if_link_params_free>
   0x00007f6b4901d7d5 <+117>:	mov    0xa8(%rbx),%rsi
   0x00007f6b4901d7dc <+124>:	mov    0x2e6745(%rip),%rdi        # 0x7f6b49303f28
   0x00007f6b4901d7e3 <+131>:	callq  0x7f6b4902bbf0 <qfree>
   0x00007f6b4901d7e8 <+136>:	lea    0x2e8191(%rip),%rdi        # 0x7f6b49305980
   0x00007f6b4901d7ef <+143>:	movq   $0x0,0xa8(%rbx)
   0x00007f6b4901d7fa <+154>:	mov    %rbx,%rsi
   0x00007f6b4901d7fd <+157>:	callq  0x7f6b4902bbf0 <qfree>
   0x00007f6b4901d802 <+162>:	movq   $0x0,0x0(%r13)
   0x00007f6b4901d80a <+170>:	add    $0x8,%rsp
   0x00007f6b4901d80e <+174>:	pop    %rbx
   0x00007f6b4901d80f <+175>:	pop    %r12
   0x00007f6b4901d811 <+177>:	pop    %r13
   0x00007f6b4901d813 <+179>:	pop    %rbp
   0x00007f6b4901d814 <+180>:	retq   
   0x00007f6b4901d815 <+181>:	nopl   (%rax)
   0x00007f6b4901d818 <+184>:	lea    0x78(%r12),%rsi
   0x00007f6b4901d81d <+189>:	lea    0x2d194c(%rip),%rdi        # 0x7f6b492ef170
   0x00007f6b4901d824 <+196>:	mov    %rbx,%rdx
   0x00007f6b4901d827 <+199>:	callq  0x7f6b4903a3b0 <_rb_remove>
   0x00007f6b4901d82c <+204>:	test   %rax,%rax
   0x00007f6b4901d82f <+207>:	jne    0x7f6b4901d7ad <if_delete+77>
   0x00007f6b4901d835 <+213>:	mov    0xe8(%rbx),%r9d
   0x00007f6b4901d83c <+220>:	mov    0x54(%rbx),%r8d
   0x00007f6b4901d840 <+224>:	lea    0x6ad31(%rip),%rcx        # 0x7f6b49088578
   0x00007f6b4901d847 <+231>:	lea    0x6a362(%rip),%rsi        # 0x7f6b49087bb0
   0x00007f6b4901d84e <+238>:	lea    0x2d108b(%rip),%rdi        # 0x7f6b492ee8e0
   0x00007f6b4901d855 <+245>:	mov    $0x6000009,%edx
   0x00007f6b4901d85a <+250>:	callq  0x7f6b4901a7e0
   0x00007f6b4901d85f <+255>:	jmpq   0x7f6b4901d7ad <if_delete+77>
   0x00007f6b4901d864 <+260>:	nopl   0x0(%rax)
   0x00007f6b4901d868 <+264>:	mov    0xe8(%rbx),%r9d
   0x00007f6b4901d86f <+271>:	lea    0x40(%rbx),%r8
   0x00007f6b4901d873 <+275>:	lea    0x6acfe(%rip),%rcx        # 0x7f6b49088578
   0x00007f6b4901d87a <+282>:	lea    0x6a2cf(%rip),%rsi        # 0x7f6b49087b50
   0x00007f6b4901d881 <+289>:	lea    0x2d1098(%rip),%rdi        # 0x7f6b492ee920
   0x00007f6b4901d888 <+296>:	mov    $0x6000009,%edx
   0x00007f6b4901d88d <+301>:	callq  0x7f6b4901a7e0
   0x00007f6b4901d892 <+306>:	jmpq   0x7f6b4901d7a6 <if_delete+70>
   0x00007f6b4901d897 <+311>:	lea    0x6acea(%rip),%rcx        # 0x7f6b49088588
   0x00007f6b4901d89e <+318>:	lea    0x69da9(%rip),%rsi        # 0x7f6b4908764e
   0x00007f6b4901d8a5 <+325>:	lea    0x82e0b(%rip),%rdi        # 0x7f6b490a06b7
   0x00007f6b4901d8ac <+332>:	mov    $0x133,%edx
   0x00007f6b4901d8b1 <+337>:	callq  0x7f6b48ff6768
End of assembler dump.
#12 0x00007f6b4901d985 in if_terminate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_terminate:
   0x00007f6b4901d910 <+0>:	push   %rbp
   0x00007f6b4901d911 <+1>:	mov    %rsp,%rbp
   0x00007f6b4901d914 <+4>:	push   %r13
   0x00007f6b4901d916 <+6>:	push   %r12
   0x00007f6b4901d918 <+8>:	push   %rbx
   0x00007f6b4901d919 <+9>:	sub    $0x18,%rsp
   0x00007f6b4901d91d <+13>:	mov    %fs:0x28,%rax
   0x00007f6b4901d926 <+22>:	mov    %rax,-0x28(%rbp)
   0x00007f6b4901d92a <+26>:	xor    %eax,%eax
   0x00007f6b4901d92c <+28>:	cmpq   $0x0,0x70(%rdi)
   0x00007f6b4901d931 <+33>:	je     0x7f6b4901d98c <if_terminate+124>
   0x00007f6b4901d933 <+35>:	lea    0x70(%rdi),%r13
   0x00007f6b4901d937 <+39>:	lea    -0x30(%rbp),%r12
   0x00007f6b4901d93b <+43>:	mov    %rdi,%rbx
   0x00007f6b4901d93e <+46>:	xchg   %ax,%ax
   0x00007f6b4901d940 <+48>:	lea    0x2d1849(%rip),%rdi        # 0x7f6b492ef190
   0x00007f6b4901d947 <+55>:	mov    %r13,%rsi
   0x00007f6b4901d94a <+58>:	callq  0x7f6b4903b0e0 <_rb_root>
   0x00007f6b4901d94f <+63>:	mov    0xe0(%rax),%rdi
   0x00007f6b4901d956 <+70>:	mov    %rax,-0x30(%rbp)
   0x00007f6b4901d95a <+74>:	test   %rdi,%rdi
   0x00007f6b4901d95d <+77>:	je     0x7f6b4901d97d <if_terminate+109>
   0x00007f6b4901d95f <+79>:	mov    0x50(%rdi),%eax
   0x00007f6b4901d962 <+82>:	movq   $0x0,0x68(%rdi)
   0x00007f6b4901d96a <+90>:	test   %eax,%eax
   0x00007f6b4901d96c <+92>:	je     0x7f6b4901d9a6 <if_terminate+150>
   0x00007f6b4901d96e <+94>:	sub    $0x1,%eax
   0x00007f6b4901d971 <+97>:	test   %eax,%eax
   0x00007f6b4901d973 <+99>:	mov    %eax,0x50(%rdi)
   0x00007f6b4901d976 <+102>:	jne    0x7f6b4901d97d <if_terminate+109>
   0x00007f6b4901d978 <+104>:	callq  0x7f6b49059ff0 <route_node_delete>
   0x00007f6b4901d97d <+109>:	mov    %r12,%rdi
   0x00007f6b4901d980 <+112>:	callq  0x7f6b4901d760 <if_delete>
=> 0x00007f6b4901d985 <+117>:	cmpq   $0x0,0x70(%rbx)
   0x00007f6b4901d98a <+122>:	jne    0x7f6b4901d940 <if_terminate+48>
   0x00007f6b4901d98c <+124>:	mov    -0x28(%rbp),%rax
   0x00007f6b4901d990 <+128>:	xor    %fs:0x28,%rax
   0x00007f6b4901d999 <+137>:	jne    0x7f6b4901d9c5 <if_terminate+181>
   0x00007f6b4901d99b <+139>:	add    $0x18,%rsp
   0x00007f6b4901d99f <+143>:	pop    %rbx
   0x00007f6b4901d9a0 <+144>:	pop    %r12
   0x00007f6b4901d9a2 <+146>:	pop    %r13
   0x00007f6b4901d9a4 <+148>:	pop    %rbp
   0x00007f6b4901d9a5 <+149>:	retq   
   0x00007f6b4901d9a6 <+150>:	lea    0x6aa43(%rip),%rcx        # 0x7f6b490883f0
   0x00007f6b4901d9ad <+157>:	lea    0x6a011(%rip),%rsi        # 0x7f6b490879c5
   0x00007f6b4901d9b4 <+164>:	lea    0x6a016(%rip),%rdi        # 0x7f6b490879d1
   0x00007f6b4901d9bb <+171>:	mov    $0x102,%edx
   0x00007f6b4901d9c0 <+176>:	callq  0x7f6b48ff6768
   0x00007f6b4901d9c5 <+181>:	callq  0x7f6b48ff66a0
End of assembler dump.
54	../sysdeps/unix/sysv/linux/raise.c: No such file or directory.
No function contains program counter for selected frame.

r2: nhrpd crashed. Core file found - Backtrace follows:
[New LWP 22613]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/nhrpd --log file:nhrpd.log --log-level debug -d'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f1c6e872438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
  Id   Target Id         Frame 
* 1    Thread 0x7f1c6f93a880 (LWP 22613) 0x00007f1c6e872438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f1c6e872438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
        resultvar = 0
        pid = 22613
        selftid = 22613
#1  0x00007f1c6e87403a in __GI_abort () at abort.c:89
        save_stage = 2
        act = {__sigaction_handler = {sa_handler = 0x3833340035313631, sa_sigaction = 0x3833340035313631}, sa_mask = {__val = {8390891524071635753, 2865525649010281, 10682902079087270912, 0, 94302447520160, 94302447513952, 140721813159872, 140721813159856, 139760103054484, 140721813159920, 6, 140721813160560, 139760090162232, 140721813159904, 139760103054582, 139760093898048}}, sa_flags = 709319680, sa_restorer = 0x7ffc59af7ff0}
        sigs = {__val = {32, 0 <repeats 15 times>}}
#2  0x00007f1c6f4e1655 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#3  <signal handler called>
No locals.
#4  0x00007f1c6e872438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
        resultvar = 0
        pid = 22613
        selftid = 22613
#5  0x00007f1c6e87403a in __GI_abort () at abort.c:89
        save_stage = 2
        act = {__sigaction_handler = {sa_handler = 0x4, sa_sigaction = 0x4}, sa_mask = {__val = {139760108385576, 94302454614272, 140721813161472, 19332532064, 139760108380160, 94302445361186, 211, 94302445362672, 4294967295, 94302452793184, 139760090486156, 139760091583248, 139760091596896, 0, 139760091583248, 94302445361186}}, sa_flags = 1872568320, sa_restorer = 0x55c47fc1d822}
        sigs = {__val = {32, 0 <repeats 15 times>}}
#6  0x00007f1c6e86abe7 in __assert_fail_base (fmt=<optimized out>, assertion=assertion@entry=0x55c47fc1d822 "nifp->peer_hash->count == 0", file=file@entry=0x55c47fc1d810 "nhrpd/nhrp_peer.c", line=line@entry=211, function=function@entry=0x55c47fc1ddf0 "nhrp_peer_interface_del") at assert.c:92
        str = 0x55c4803c8980 "\330\033\300n\034\177"
        total = 4096
#7  0x00007f1c6e86ac92 in __GI___assert_fail (assertion=0x55c47fc1d822 "nifp->peer_hash->count == 0", file=0x55c47fc1d810 "nhrpd/nhrp_peer.c", line=211, function=0x55c47fc1ddf0 "nhrp_peer_interface_del") at assert.c:101
No locals.
#8  0x000055c47fc1134b in nhrp_peer_interface_del ()
No symbol table info available.
#9  0x000055c47fc0cee2 in ?? ()
No symbol table info available.
#10 0x00007f1c6f4ad565 in if_delete_retain () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#11 0x00007f1c6f4af7b5 in if_delete () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#12 0x00007f1c6f4af985 in if_terminate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#13 0x00007f1c6f4f3c75 in vrf_delete () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#14 0x00007f1c6f4f3fbb in vrf_terminate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#15 0x000055c47fc0e2d5 in ?? ()
No symbol table info available.
#16 0x00007f1c6f4e19e3 in quagga_sigevent_process () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#17 0x00007f1c6f4f0e55 in thread_fetch () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#18 0x00007f1c6f4b5de3 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#19 0x000055c47fc0908a in main ()
No symbol table info available.
Dump of assembler code for function __GI___assert_fail:
   0x00007f1c6e86ac50 <+0>:	push   %r13
   0x00007f1c6e86ac52 <+2>:	push   %r12
   0x00007f1c6e86ac54 <+4>:	mov    %rcx,%r13
   0x00007f1c6e86ac57 <+7>:	push   %rbp
   0x00007f1c6e86ac58 <+8>:	push   %rbx
   0x00007f1c6e86ac59 <+9>:	mov    %rsi,%rbp
   0x00007f1c6e86ac5c <+12>:	mov    %rdi,%rbx
   0x00007f1c6e86ac5f <+15>:	lea    0x1626aa(%rip),%rsi        # 0x7f1c6e9cd310
   0x00007f1c6e86ac66 <+22>:	lea    0x15f013(%rip),%rdi        # 0x7f1c6e9c9c80 <_libc_intl_domainname>
   0x00007f1c6e86ac6d <+29>:	mov    %edx,%r12d
   0x00007f1c6e86ac70 <+32>:	sub    $0x8,%rsp
   0x00007f1c6e86ac74 <+36>:	mov    $0x5,%edx
   0x00007f1c6e86ac79 <+41>:	callq  0x7f1c6e86b630 <__GI___dcgettext>
   0x00007f1c6e86ac7e <+46>:	mov    %r13,%r8
   0x00007f1c6e86ac81 <+49>:	mov    %r12d,%ecx
   0x00007f1c6e86ac84 <+52>:	mov    %rbp,%rdx
   0x00007f1c6e86ac87 <+55>:	mov    %rbx,%rsi
   0x00007f1c6e86ac8a <+58>:	mov    %rax,%rdi
   0x00007f1c6e86ac8d <+61>:	callq  0x7f1c6e86aad0 <__assert_fail_base>
End of assembler dump.
#8  0x000055c47fc1134b in nhrp_peer_interface_del ()
Dump of assembler code for function nhrp_peer_interface_del:
   0x000055c47fc112a0 <+0>:	push   %rbp
   0x000055c47fc112a1 <+1>:	mov    %rsp,%rbp
   0x000055c47fc112a4 <+4>:	push   %rbx
   0x000055c47fc112a5 <+5>:	sub    $0x8,%rsp
   0x000055c47fc112a9 <+9>:	testb  $0x1,0x21d210(%rip)        # 0x55c47fe2e4c0 <debug_flags>
   0x000055c47fc112b0 <+16>:	mov    0xd0(%rdi),%rbx
   0x000055c47fc112b7 <+23>:	jne    0x55c47fc11300 <nhrp_peer_interface_del+96>
   0x000055c47fc112b9 <+25>:	mov    0x68(%rbx),%rdi
   0x000055c47fc112bd <+29>:	test   %rdi,%rdi
   0x000055c47fc112c0 <+32>:	je     0x55c47fc112f0 <nhrp_peer_interface_del+80>
   0x000055c47fc112c2 <+34>:	lea    -0xa69(%rip),%rsi        # 0x55c47fc10860
   0x000055c47fc112c9 <+41>:	xor    %edx,%edx
   0x000055c47fc112cb <+43>:	callq  0x55c47fc08a40
   0x000055c47fc112d0 <+48>:	mov    0x68(%rbx),%rdi
   0x000055c47fc112d4 <+52>:	cmpq   $0x0,0x20(%rdi)
   0x000055c47fc112d9 <+57>:	jne    0x55c47fc1132c <nhrp_peer_interface_del+140>
   0x000055c47fc112db <+59>:	add    $0x8,%rsp
   0x000055c47fc112df <+63>:	pop    %rbx
   0x000055c47fc112e0 <+64>:	pop    %rbp
   0x000055c47fc112e1 <+65>:	jmpq   0x55c47fc08b98
   0x000055c47fc112e6 <+70>:	nopw   %cs:0x0(%rax,%rax,1)
   0x000055c47fc112f0 <+80>:	add    $0x8,%rsp
   0x000055c47fc112f4 <+84>:	pop    %rbx
   0x000055c47fc112f5 <+85>:	pop    %rbp
   0x000055c47fc112f6 <+86>:	retq   
   0x000055c47fc112f7 <+87>:	nopw   0x0(%rax,%rax,1)
   0x000055c47fc11300 <+96>:	mov    0x68(%rbx),%rax
   0x000055c47fc11304 <+100>:	test   %rax,%rax
   0x000055c47fc11307 <+103>:	je     0x55c47fc11328 <nhrp_peer_interface_del+136>
   0x000055c47fc11309 <+105>:	mov    0x20(%rax),%rdx
   0x000055c47fc1130d <+109>:	lea    0xbc9c(%rip),%rsi        # 0x55c47fc1cfb0
   0x000055c47fc11314 <+116>:	lea    0x216325(%rip),%rdi        # 0x55c47fe27640
   0x000055c47fc1131b <+123>:	xor    %eax,%eax
   0x000055c47fc1131d <+125>:	callq  0x55c47fc106d0
   0x000055c47fc11322 <+130>:	jmp    0x55c47fc112b9 <nhrp_peer_interface_del+25>
   0x000055c47fc11324 <+132>:	nopl   0x0(%rax)
   0x000055c47fc11328 <+136>:	xor    %edx,%edx
   0x000055c47fc1132a <+138>:	jmp    0x55c47fc1130d <nhrp_peer_interface_del+109>
   0x000055c47fc1132c <+140>:	lea    0xcabd(%rip),%rcx        # 0x55c47fc1ddf0
   0x000055c47fc11333 <+147>:	lea    0xc4d6(%rip),%rsi        # 0x55c47fc1d810
   0x000055c47fc1133a <+154>:	lea    0xc4e1(%rip),%rdi        # 0x55c47fc1d822
   0x000055c47fc11341 <+161>:	mov    $0xd3,%edx
   0x000055c47fc11346 <+166>:	callq  0x55c47fc08830
End of assembler dump.
#9  0x000055c47fc0cee2 in ?? ()
#10 0x00007f1c6f4ad565 in if_delete_retain () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_delete_retain:
   0x00007f1c6f4ad540 <+0>:	mov    0x2e86e1(%rip),%rax        # 0x7f1c6f795c28
   0x00007f1c6f4ad547 <+7>:	push   %rbp
   0x00007f1c6f4ad548 <+8>:	mov    %rsp,%rbp
   0x00007f1c6f4ad54b <+11>:	push   %r12
   0x00007f1c6f4ad54d <+13>:	push   %rbx
   0x00007f1c6f4ad54e <+14>:	mov    0x8(%rax),%rbx
   0x00007f1c6f4ad552 <+18>:	mov    %rdi,%r12
   0x00007f1c6f4ad555 <+21>:	test   %rbx,%rbx
   0x00007f1c6f4ad558 <+24>:	jne    0x7f1c6f4ad56d <if_delete_retain+45>
   0x00007f1c6f4ad55a <+26>:	jmp    0x7f1c6f4ad588 <if_delete_retain+72>
   0x00007f1c6f4ad55c <+28>:	nopl   0x0(%rax)
   0x00007f1c6f4ad560 <+32>:	mov    %r12,%rdi
   0x00007f1c6f4ad563 <+35>:	callq  *%rax
=> 0x00007f1c6f4ad565 <+37>:	mov    (%rbx),%rbx
   0x00007f1c6f4ad568 <+40>:	test   %rbx,%rbx
   0x00007f1c6f4ad56b <+43>:	je     0x7f1c6f4ad588 <if_delete_retain+72>
   0x00007f1c6f4ad56d <+45>:	testb  $0x1,0x18(%rbx)
   0x00007f1c6f4ad571 <+49>:	mov    0x8(%rbx),%rax
   0x00007f1c6f4ad575 <+53>:	je     0x7f1c6f4ad560 <if_delete_retain+32>
   0x00007f1c6f4ad577 <+55>:	mov    0x10(%rbx),%rdi
   0x00007f1c6f4ad57b <+59>:	mov    %r12,%rsi
   0x00007f1c6f4ad57e <+62>:	callq  *%rax
   0x00007f1c6f4ad580 <+64>:	mov    (%rbx),%rbx
   0x00007f1c6f4ad583 <+67>:	test   %rbx,%rbx
   0x00007f1c6f4ad586 <+70>:	jne    0x7f1c6f4ad56d <if_delete_retain+45>
   0x00007f1c6f4ad588 <+72>:	lea    0xf0(%r12),%rdi
   0x00007f1c6f4ad590 <+80>:	callq  0x7f1c6f4d4b50 <qobj_unreg>
   0x00007f1c6f4ad595 <+85>:	mov    0xc0(%r12),%rdi
   0x00007f1c6f4ad59d <+93>:	callq  0x7f1c6f4b68f0 <list_delete_all_node>
   0x00007f1c6f4ad5a2 <+98>:	pop    %rbx
   0x00007f1c6f4ad5a3 <+99>:	mov    0xc8(%r12),%rdi
   0x00007f1c6f4ad5ab <+107>:	pop    %r12
   0x00007f1c6f4ad5ad <+109>:	pop    %rbp
   0x00007f1c6f4ad5ae <+110>:	jmpq   0x7f1c6f4b68f0 <list_delete_all_node>
End of assembler dump.
#11 0x00007f1c6f4af7b5 in if_delete () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_delete:
   0x00007f1c6f4af760 <+0>:	push   %rbp
   0x00007f1c6f4af761 <+1>:	mov    %rsp,%rbp
   0x00007f1c6f4af764 <+4>:	push   %r13
   0x00007f1c6f4af766 <+6>:	push   %r12
   0x00007f1c6f4af768 <+8>:	push   %rbx
   0x00007f1c6f4af769 <+9>:	mov    %rdi,%r13
   0x00007f1c6f4af76c <+12>:	sub    $0x8,%rsp
   0x00007f1c6f4af770 <+16>:	mov    (%rdi),%rbx
   0x00007f1c6f4af773 <+19>:	mov    0xe8(%rbx),%edi
   0x00007f1c6f4af779 <+25>:	callq  0x7f1c6f4f3960 <vrf_lookup_by_id>
   0x00007f1c6f4af77e <+30>:	test   %rax,%rax
   0x00007f1c6f4af781 <+33>:	je     0x7f1c6f4af897 <if_delete+311>
   0x00007f1c6f4af787 <+39>:	lea    0x70(%rax),%rsi
   0x00007f1c6f4af78b <+43>:	lea    0x2d19fe(%rip),%rdi        # 0x7f1c6f781190
   0x00007f1c6f4af792 <+50>:	mov    %rbx,%rdx
   0x00007f1c6f4af795 <+53>:	mov    %rax,%r12
   0x00007f1c6f4af798 <+56>:	callq  0x7f1c6f4cc3b0 <_rb_remove>
   0x00007f1c6f4af79d <+61>:	test   %rax,%rax
   0x00007f1c6f4af7a0 <+64>:	je     0x7f1c6f4af868 <if_delete+264>
   0x00007f1c6f4af7a6 <+70>:	mov    0x54(%rbx),%eax
   0x00007f1c6f4af7a9 <+73>:	test   %eax,%eax
   0x00007f1c6f4af7ab <+75>:	jne    0x7f1c6f4af818 <if_delete+184>
   0x00007f1c6f4af7ad <+77>:	mov    %rbx,%rdi
   0x00007f1c6f4af7b0 <+80>:	callq  0x7f1c6f4ad540 <if_delete_retain>
=> 0x00007f1c6f4af7b5 <+85>:	lea    0xc0(%rbx),%rdi
   0x00007f1c6f4af7bc <+92>:	callq  0x7f1c6f4b6990 <list_delete>
   0x00007f1c6f4af7c1 <+97>:	lea    0xc8(%rbx),%rdi
   0x00007f1c6f4af7c8 <+104>:	callq  0x7f1c6f4b6990 <list_delete>
   0x00007f1c6f4af7cd <+109>:	mov    %rbx,%rdi
   0x00007f1c6f4af7d0 <+112>:	callq  0x7f1c6f4af720 <if_link_params_free>
   0x00007f1c6f4af7d5 <+117>:	mov    0xa8(%rbx),%rsi
   0x00007f1c6f4af7dc <+124>:	mov    0x2e6745(%rip),%rdi        # 0x7f1c6f795f28
   0x00007f1c6f4af7e3 <+131>:	callq  0x7f1c6f4bdbf0 <qfree>
   0x00007f1c6f4af7e8 <+136>:	lea    0x2e8191(%rip),%rdi        # 0x7f1c6f797980
   0x00007f1c6f4af7ef <+143>:	movq   $0x0,0xa8(%rbx)
   0x00007f1c6f4af7fa <+154>:	mov    %rbx,%rsi
   0x00007f1c6f4af7fd <+157>:	callq  0x7f1c6f4bdbf0 <qfree>
   0x00007f1c6f4af802 <+162>:	movq   $0x0,0x0(%r13)
   0x00007f1c6f4af80a <+170>:	add    $0x8,%rsp
   0x00007f1c6f4af80e <+174>:	pop    %rbx
   0x00007f1c6f4af80f <+175>:	pop    %r12
   0x00007f1c6f4af811 <+177>:	pop    %r13
   0x00007f1c6f4af813 <+179>:	pop    %rbp
   0x00007f1c6f4af814 <+180>:	retq   
   0x00007f1c6f4af815 <+181>:	nopl   (%rax)
   0x00007f1c6f4af818 <+184>:	lea    0x78(%r12),%rsi
   0x00007f1c6f4af81d <+189>:	lea    0x2d194c(%rip),%rdi        # 0x7f1c6f781170
   0x00007f1c6f4af824 <+196>:	mov    %rbx,%rdx
   0x00007f1c6f4af827 <+199>:	callq  0x7f1c6f4cc3b0 <_rb_remove>
   0x00007f1c6f4af82c <+204>:	test   %rax,%rax
   0x00007f1c6f4af82f <+207>:	jne    0x7f1c6f4af7ad <if_delete+77>
   0x00007f1c6f4af835 <+213>:	mov    0xe8(%rbx),%r9d
   0x00007f1c6f4af83c <+220>:	mov    0x54(%rbx),%r8d
   0x00007f1c6f4af840 <+224>:	lea    0x6ad31(%rip),%rcx        # 0x7f1c6f51a578
   0x00007f1c6f4af847 <+231>:	lea    0x6a362(%rip),%rsi        # 0x7f1c6f519bb0
   0x00007f1c6f4af84e <+238>:	lea    0x2d108b(%rip),%rdi        # 0x7f1c6f7808e0
   0x00007f1c6f4af855 <+245>:	mov    $0x6000009,%edx
   0x00007f1c6f4af85a <+250>:	callq  0x7f1c6f4ac7e0
   0x00007f1c6f4af85f <+255>:	jmpq   0x7f1c6f4af7ad <if_delete+77>
   0x00007f1c6f4af864 <+260>:	nopl   0x0(%rax)
   0x00007f1c6f4af868 <+264>:	mov    0xe8(%rbx),%r9d
   0x00007f1c6f4af86f <+271>:	lea    0x40(%rbx),%r8
   0x00007f1c6f4af873 <+275>:	lea    0x6acfe(%rip),%rcx        # 0x7f1c6f51a578
   0x00007f1c6f4af87a <+282>:	lea    0x6a2cf(%rip),%rsi        # 0x7f1c6f519b50
   0x00007f1c6f4af881 <+289>:	lea    0x2d1098(%rip),%rdi        # 0x7f1c6f780920
   0x00007f1c6f4af888 <+296>:	mov    $0x6000009,%edx
   0x00007f1c6f4af88d <+301>:	callq  0x7f1c6f4ac7e0
   0x00007f1c6f4af892 <+306>:	jmpq   0x7f1c6f4af7a6 <if_delete+70>
   0x00007f1c6f4af897 <+311>:	lea    0x6acea(%rip),%rcx        # 0x7f1c6f51a588
   0x00007f1c6f4af89e <+318>:	lea    0x69da9(%rip),%rsi        # 0x7f1c6f51964e
   0x00007f1c6f4af8a5 <+325>:	lea    0x82e0b(%rip),%rdi        # 0x7f1c6f5326b7
   0x00007f1c6f4af8ac <+332>:	mov    $0x133,%edx
   0x00007f1c6f4af8b1 <+337>:	callq  0x7f1c6f488768
End of assembler dump.
#12 0x00007f1c6f4af985 in if_terminate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_terminate:
   0x00007f1c6f4af910 <+0>:	push   %rbp
   0x00007f1c6f4af911 <+1>:	mov    %rsp,%rbp
   0x00007f1c6f4af914 <+4>:	push   %r13
   0x00007f1c6f4af916 <+6>:	push   %r12
   0x00007f1c6f4af918 <+8>:	push   %rbx
   0x00007f1c6f4af919 <+9>:	sub    $0x18,%rsp
   0x00007f1c6f4af91d <+13>:	mov    %fs:0x28,%rax
   0x00007f1c6f4af926 <+22>:	mov    %rax,-0x28(%rbp)
   0x00007f1c6f4af92a <+26>:	xor    %eax,%eax
   0x00007f1c6f4af92c <+28>:	cmpq   $0x0,0x70(%rdi)
   0x00007f1c6f4af931 <+33>:	je     0x7f1c6f4af98c <if_terminate+124>
   0x00007f1c6f4af933 <+35>:	lea    0x70(%rdi),%r13
   0x00007f1c6f4af937 <+39>:	lea    -0x30(%rbp),%r12
   0x00007f1c6f4af93b <+43>:	mov    %rdi,%rbx
   0x00007f1c6f4af93e <+46>:	xchg   %ax,%ax
   0x00007f1c6f4af940 <+48>:	lea    0x2d1849(%rip),%rdi        # 0x7f1c6f781190
   0x00007f1c6f4af947 <+55>:	mov    %r13,%rsi
   0x00007f1c6f4af94a <+58>:	callq  0x7f1c6f4cd0e0 <_rb_root>
   0x00007f1c6f4af94f <+63>:	mov    0xe0(%rax),%rdi
   0x00007f1c6f4af956 <+70>:	mov    %rax,-0x30(%rbp)
   0x00007f1c6f4af95a <+74>:	test   %rdi,%rdi
   0x00007f1c6f4af95d <+77>:	je     0x7f1c6f4af97d <if_terminate+109>
   0x00007f1c6f4af95f <+79>:	mov    0x50(%rdi),%eax
   0x00007f1c6f4af962 <+82>:	movq   $0x0,0x68(%rdi)
   0x00007f1c6f4af96a <+90>:	test   %eax,%eax
   0x00007f1c6f4af96c <+92>:	je     0x7f1c6f4af9a6 <if_terminate+150>
   0x00007f1c6f4af96e <+94>:	sub    $0x1,%eax
   0x00007f1c6f4af971 <+97>:	test   %eax,%eax
   0x00007f1c6f4af973 <+99>:	mov    %eax,0x50(%rdi)
   0x00007f1c6f4af976 <+102>:	jne    0x7f1c6f4af97d <if_terminate+109>
   0x00007f1c6f4af978 <+104>:	callq  0x7f1c6f4ebff0 <route_node_delete>
   0x00007f1c6f4af97d <+109>:	mov    %r12,%rdi
   0x00007f1c6f4af980 <+112>:	callq  0x7f1c6f4af760 <if_delete>
=> 0x00007f1c6f4af985 <+117>:	cmpq   $0x0,0x70(%rbx)
   0x00007f1c6f4af98a <+122>:	jne    0x7f1c6f4af940 <if_terminate+48>
   0x00007f1c6f4af98c <+124>:	mov    -0x28(%rbp),%rax
   0x00007f1c6f4af990 <+128>:	xor    %fs:0x28,%rax
   0x00007f1c6f4af999 <+137>:	jne    0x7f1c6f4af9c5 <if_terminate+181>
   0x00007f1c6f4af99b <+139>:	add    $0x18,%rsp
   0x00007f1c6f4af99f <+143>:	pop    %rbx
   0x00007f1c6f4af9a0 <+144>:	pop    %r12
   0x00007f1c6f4af9a2 <+146>:	pop    %r13
   0x00007f1c6f4af9a4 <+148>:	pop    %rbp
   0x00007f1c6f4af9a5 <+149>:	retq   
   0x00007f1c6f4af9a6 <+150>:	lea    0x6aa43(%rip),%rcx        # 0x7f1c6f51a3f0
   0x00007f1c6f4af9ad <+157>:	lea    0x6a011(%rip),%rsi        # 0x7f1c6f5199c5
   0x00007f1c6f4af9b4 <+164>:	lea    0x6a016(%rip),%rdi        # 0x7f1c6f5199d1
   0x00007f1c6f4af9bb <+171>:	mov    $0x102,%edx
   0x00007f1c6f4af9c0 <+176>:	callq  0x7f1c6f488768
   0x00007f1c6f4af9c5 <+181>:	callq  0x7f1c6f4886a0
End of assembler dump.

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17943/artifact/TOPOU1604/ErrorLog/log_topotests.txt

Topotests Ubuntu 16.04 i386 part 0: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOI386-17943/test

Topology Tests failed for Topotests Ubuntu 16.04 i386 part 0:

No function contains program counter for selected frame.
No function contains program counter for selected frame.
No function contains program counter for selected frame.
No function contains program counter for selected frame.

r1: nhrpd crashed. Core file found - Backtrace follows:
[New LWP 3568]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/nhrpd --log file:nhrpd.log --log-level debug -d'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7fcecf5 in ?? ()
  Id   Target Id         Frame 
* 1    Thread 0xb78957c0 (LWP 3568) 0xb7fcecf5 in ?? ()
#0  0xb7fcecf5 in ?? ()
No symbol table info available.
#1  <signal handler called>
No symbol table info available.
#2  0xb7fcecf5 in ?? ()
No symbol table info available.
#3  0x00440ad5 in ?? ()
No symbol table info available.
#4  0xb7ed1536 in if_delete_retain () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#5  0xb7ed3a70 in if_delete () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#6  0xb7ed3c7b in if_terminate () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#7  0xb7f1a5fa in vrf_delete () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#8  0xb7f1a9f6 in vrf_terminate () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#9  0x00441ec3 in ?? ()
No symbol table info available.
#10 0xb7f083a1 in quagga_sigevent_process () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#11 0xb7f1786d in thread_fetch () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#12 0xb7eda2e6 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#13 0x0043cdaa in main ()
No symbol table info available.
#1  <signal handler called>
#2  0xb7fcecf5 in ?? ()
#3  0x00440ad5 in ?? ()
#4  0xb7ed1536 in if_delete_retain () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_delete_retain:
   0xb7ed1500 <+0>:	push   %ebp
   0xb7ed1501 <+1>:	mov    %esp,%ebp
   0xb7ed1503 <+3>:	push   %edi
   0xb7ed1504 <+4>:	push   %esi
   0xb7ed1505 <+5>:	push   %ebx
   0xb7ed1506 <+6>:	call   0xb7eb0640
   0xb7ed150b <+11>:	add    $0xe5505,%ebx
   0xb7ed1511 <+17>:	sub    $0xc,%esp
   0xb7ed1514 <+20>:	mov    0x8(%ebp),%edi
   0xb7ed1517 <+23>:	mov    0x3f4(%ebx),%eax
   0xb7ed151d <+29>:	mov    0x4(%eax),%esi
   0xb7ed1520 <+32>:	test   %esi,%esi
   0xb7ed1522 <+34>:	jne    0xb7ed153f <if_delete_retain+63>
   0xb7ed1524 <+36>:	jmp    0xb7ed155a <if_delete_retain+90>
   0xb7ed1526 <+38>:	lea    0x0(%esi),%esi
   0xb7ed1529 <+41>:	lea    0x0(%edi,%eiz,1),%edi
   0xb7ed1530 <+48>:	sub    $0xc,%esp
   0xb7ed1533 <+51>:	push   %edi
   0xb7ed1534 <+52>:	call   *%eax
=> 0xb7ed1536 <+54>:	mov    (%esi),%esi
   0xb7ed1538 <+56>:	add    $0x10,%esp
   0xb7ed153b <+59>:	test   %esi,%esi
   0xb7ed153d <+61>:	je     0xb7ed155a <if_delete_retain+90>
   0xb7ed153f <+63>:	testb  $0x1,0xc(%esi)
   0xb7ed1543 <+67>:	mov    0x4(%esi),%eax
   0xb7ed1546 <+70>:	je     0xb7ed1530 <if_delete_retain+48>
   0xb7ed1548 <+72>:	sub    $0x8,%esp
   0xb7ed154b <+75>:	push   %edi
   0xb7ed154c <+76>:	pushl  0x8(%esi)
   0xb7ed154f <+79>:	call   *%eax
   0xb7ed1551 <+81>:	mov    (%esi),%esi
   0xb7ed1553 <+83>:	add    $0x10,%esp
   0xb7ed1556 <+86>:	test   %esi,%esi
   0xb7ed1558 <+88>:	jne    0xb7ed153f <if_delete_retain+63>
   0xb7ed155a <+90>:	lea    0xa8(%edi),%eax
   0xb7ed1560 <+96>:	sub    $0xc,%esp
   0xb7ed1563 <+99>:	push   %eax
   0xb7ed1564 <+100>:	call   0xb7efa710 <qobj_unreg>
   0xb7ed1569 <+105>:	pop    %eax
   0xb7ed156a <+106>:	pushl  0x8c(%edi)
   0xb7ed1570 <+112>:	call   0xb7edae00 <list_delete_all_node>
   0xb7ed1575 <+117>:	pop    %edx
   0xb7ed1576 <+118>:	pushl  0x90(%edi)
   0xb7ed157c <+124>:	call   0xb7edae00 <list_delete_all_node>
   0xb7ed1581 <+129>:	lea    -0xc(%ebp),%esp
   0xb7ed1584 <+132>:	pop    %ebx
   0xb7ed1585 <+133>:	pop    %esi
   0xb7ed1586 <+134>:	pop    %edi
   0xb7ed1587 <+135>:	pop    %ebp
   0xb7ed1588 <+136>:	ret    
End of assembler dump.
#5  0xb7ed3a70 in if_delete () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_delete:
   0xb7ed3a10 <+0>:	push   %ebp
   0xb7ed3a11 <+1>:	mov    %esp,%ebp
   0xb7ed3a13 <+3>:	push   %edi
   0xb7ed3a14 <+4>:	push   %esi
   0xb7ed3a15 <+5>:	push   %ebx
   0xb7ed3a16 <+6>:	call   0xb7eb0640
   0xb7ed3a1b <+11>:	add    $0xe2ff5,%ebx
   0xb7ed3a21 <+17>:	sub    $0x18,%esp
   0xb7ed3a24 <+20>:	mov    0x8(%ebp),%eax
   0xb7ed3a27 <+23>:	mov    (%eax),%esi
   0xb7ed3a29 <+25>:	pushl  0xa0(%esi)
   0xb7ed3a2f <+31>:	call   0xb7f1a290 <vrf_lookup_by_id>
   0xb7ed3a34 <+36>:	add    $0x10,%esp
   0xb7ed3a37 <+39>:	test   %eax,%eax
   0xb7ed3a39 <+41>:	je     0xb7ed3b64 <if_delete+340>
   0xb7ed3a3f <+47>:	mov    %eax,%edi
   0xb7ed3a41 <+49>:	lea    0x4c(%eax),%eax
   0xb7ed3a44 <+52>:	sub    $0x4,%esp
   0xb7ed3a47 <+55>:	push   %esi
   0xb7ed3a48 <+56>:	push   %eax
   0xb7ed3a49 <+57>:	lea    -0xf110(%ebx),%eax
   0xb7ed3a4f <+63>:	push   %eax
   0xb7ed3a50 <+64>:	call   0xb7ef1ad0 <_rb_remove>
   0xb7ed3a55 <+69>:	add    $0x10,%esp
   0xb7ed3a58 <+72>:	test   %eax,%eax
   0xb7ed3a5a <+74>:	je     0xb7ed3b30 <if_delete+288>
   0xb7ed3a60 <+80>:	mov    0x34(%esi),%eax
   0xb7ed3a63 <+83>:	test   %eax,%eax
   0xb7ed3a65 <+85>:	jne    0xb7ed3ad8 <if_delete+200>
   0xb7ed3a67 <+87>:	sub    $0xc,%esp
   0xb7ed3a6a <+90>:	push   %esi
   0xb7ed3a6b <+91>:	call   0xb7ed1500 <if_delete_retain>
=> 0xb7ed3a70 <+96>:	lea    0x8c(%esi),%eax
   0xb7ed3a76 <+102>:	mov    %eax,(%esp)
   0xb7ed3a79 <+105>:	call   0xb7edaeb0 <list_delete>
   0xb7ed3a7e <+110>:	lea    0x90(%esi),%eax
   0xb7ed3a84 <+116>:	mov    %eax,(%esp)
   0xb7ed3a87 <+119>:	call   0xb7edaeb0 <list_delete>
   0xb7ed3a8c <+124>:	mov    %esi,(%esp)
   0xb7ed3a8f <+127>:	call   0xb7ed39d0 <if_link_params_free>
   0xb7ed3a94 <+132>:	pop    %eax
   0xb7ed3a95 <+133>:	pop    %edx
   0xb7ed3a96 <+134>:	pushl  0x80(%esi)
   0xb7ed3a9c <+140>:	pushl  0x590(%ebx)
   0xb7ed3aa2 <+146>:	call   0xb7ee26d0 <qfree>
   0xb7ed3aa7 <+151>:	movl   $0x0,0x80(%esi)
   0xb7ed3ab1 <+161>:	lea    0x1450(%ebx),%eax
   0xb7ed3ab7 <+167>:	pop    %ecx
   0xb7ed3ab8 <+168>:	pop    %edi
   0xb7ed3ab9 <+169>:	push   %esi
   0xb7ed3aba <+170>:	push   %eax
   0xb7ed3abb <+171>:	call   0xb7ee26d0 <qfree>
   0xb7ed3ac0 <+176>:	mov    0x8(%ebp),%eax
   0xb7ed3ac3 <+179>:	add    $0x10,%esp
   0xb7ed3ac6 <+182>:	movl   $0x0,(%eax)
   0xb7ed3acc <+188>:	lea    -0xc(%ebp),%esp
   0xb7ed3acf <+191>:	pop    %ebx
   0xb7ed3ad0 <+192>:	pop    %esi
   0xb7ed3ad1 <+193>:	pop    %edi
   0xb7ed3ad2 <+194>:	pop    %ebp
   0xb7ed3ad3 <+195>:	ret    
   0xb7ed3ad4 <+196>:	lea    0x0(%esi,%eiz,1),%esi
   0xb7ed3ad8 <+200>:	lea    0x50(%edi),%edx
   0xb7ed3adb <+203>:	lea    -0xf120(%ebx),%eax
   0xb7ed3ae1 <+209>:	sub    $0x4,%esp
   0xb7ed3ae4 <+212>:	push   %esi
   0xb7ed3ae5 <+213>:	push   %edx
   0xb7ed3ae6 <+214>:	push   %eax
   0xb7ed3ae7 <+215>:	call   0xb7ef1ad0 <_rb_remove>
   0xb7ed3aec <+220>:	add    $0x10,%esp
   0xb7ed3aef <+223>:	test   %eax,%eax
   0xb7ed3af1 <+225>:	jne    0xb7ed3a67 <if_delete+87>
   0xb7ed3af7 <+231>:	lea    -0x76000(%ebx),%eax
   0xb7ed3afd <+237>:	sub    $0x8,%esp
   0xb7ed3b00 <+240>:	pushl  0xa0(%esi)
   0xb7ed3b06 <+246>:	pushl  0x34(%esi)
   0xb7ed3b09 <+249>:	push   %eax
   0xb7ed3b0a <+250>:	lea    -0x76914(%ebx),%eax
   0xb7ed3b10 <+256>:	push   $0x6000009
   0xb7ed3b15 <+261>:	push   %eax
   0xb7ed3b16 <+262>:	lea    -0xf650(%ebx),%eax
   0xb7ed3b1c <+268>:	push   %eax
   0xb7ed3b1d <+269>:	call   0xb7ed0650
   0xb7ed3b22 <+274>:	add    $0x20,%esp
   0xb7ed3b25 <+277>:	jmp    0xb7ed3a67 <if_delete+87>
   0xb7ed3b2a <+282>:	lea    0x0(%esi),%esi
   0xb7ed3b30 <+288>:	lea    0x20(%esi),%eax
   0xb7ed3b33 <+291>:	sub    $0x8,%esp
   0xb7ed3b36 <+294>:	pushl  0xa0(%esi)
   0xb7ed3b3c <+300>:	push   %eax
   0xb7ed3b3d <+301>:	lea    -0x76000(%ebx),%eax
   0xb7ed3b43 <+307>:	push   %eax
   0xb7ed3b44 <+308>:	lea    -0x76970(%ebx),%eax
   0xb7ed3b4a <+314>:	push   $0x6000009
   0xb7ed3b4f <+319>:	push   %eax
   0xb7ed3b50 <+320>:	lea    -0xf610(%ebx),%eax
   0xb7ed3b56 <+326>:	push   %eax
   0xb7ed3b57 <+327>:	call   0xb7ed0650
   0xb7ed3b5c <+332>:	add    $0x20,%esp
   0xb7ed3b5f <+335>:	jmp    0xb7ed3a60 <if_delete+80>
   0xb7ed3b64 <+340>:	lea    -0x75ff4(%ebx),%eax
   0xb7ed3b6a <+346>:	push   %eax
   0xb7ed3b6b <+347>:	lea    -0x76e6a(%ebx),%eax
   0xb7ed3b71 <+353>:	push   $0x133
   0xb7ed3b76 <+358>:	push   %eax
   0xb7ed3b77 <+359>:	lea    -0x5ecfd(%ebx),%eax
   0xb7ed3b7d <+365>:	push   %eax
   0xb7ed3b7e <+366>:	call   0xb7eabe58
End of assembler dump.
No function contains program counter for selected frame.
No function contains program counter for selected frame.
No function contains program counter for selected frame.
No function contains program counter for selected frame.

r2: nhrpd crashed. Core file found - Backtrace follows:
[New LWP 3638]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/nhrpd --log file:nhrpd.log --log-level debug -d'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7edbcf5 in ?? ()
  Id   Target Id         Frame 
* 1    Thread 0xb77a27c0 (LWP 3638) 0xb7edbcf5 in ?? ()
#0  0xb7edbcf5 in ?? ()
No symbol table info available.
#1  <signal handler called>
No symbol table info available.
#2  0xb7edbcf5 in ?? ()
No symbol table info available.
#3  0x0048cad5 in ?? ()
No symbol table info available.
#4  0xb7dde536 in if_delete_retain () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#5  0xb7de0a70 in if_delete () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#6  0xb7de0c7b in if_terminate () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#7  0xb7e275fa in vrf_delete () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#8  0xb7e279f6 in vrf_terminate () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#9  0x0048dec3 in ?? ()
No symbol table info available.
#10 0xb7e153a1 in quagga_sigevent_process () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#11 0xb7e2486d in thread_fetch () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#12 0xb7de72e6 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#13 0x00488daa in main ()
No symbol table info available.
#1  <signal handler called>
#2  0xb7edbcf5 in ?? ()
#3  0x0048cad5 in ?? ()
#4  0xb7dde536 in if_delete_retain () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_delete_retain:
   0xb7dde500 <+0>:	push   %ebp
   0xb7dde501 <+1>:	mov    %esp,%ebp
   0xb7dde503 <+3>:	push   %edi
   0xb7dde504 <+4>:	push   %esi
   0xb7dde505 <+5>:	push   %ebx
   0xb7dde506 <+6>:	call   0xb7dbd640
   0xb7dde50b <+11>:	add    $0xe5505,%ebx
   0xb7dde511 <+17>:	sub    $0xc,%esp
   0xb7dde514 <+20>:	mov    0x8(%ebp),%edi
   0xb7dde517 <+23>:	mov    0x3f4(%ebx),%eax
   0xb7dde51d <+29>:	mov    0x4(%eax),%esi
   0xb7dde520 <+32>:	test   %esi,%esi
   0xb7dde522 <+34>:	jne    0xb7dde53f <if_delete_retain+63>
   0xb7dde524 <+36>:	jmp    0xb7dde55a <if_delete_retain+90>
   0xb7dde526 <+38>:	lea    0x0(%esi),%esi
   0xb7dde529 <+41>:	lea    0x0(%edi,%eiz,1),%edi
   0xb7dde530 <+48>:	sub    $0xc,%esp
   0xb7dde533 <+51>:	push   %edi
   0xb7dde534 <+52>:	call   *%eax
=> 0xb7dde536 <+54>:	mov    (%esi),%esi
   0xb7dde538 <+56>:	add    $0x10,%esp
   0xb7dde53b <+59>:	test   %esi,%esi
   0xb7dde53d <+61>:	je     0xb7dde55a <if_delete_retain+90>
   0xb7dde53f <+63>:	testb  $0x1,0xc(%esi)
   0xb7dde543 <+67>:	mov    0x4(%esi),%eax
   0xb7dde546 <+70>:	je     0xb7dde530 <if_delete_retain+48>
   0xb7dde548 <+72>:	sub    $0x8,%esp
   0xb7dde54b <+75>:	push   %edi
   0xb7dde54c <+76>:	pushl  0x8(%esi)
   0xb7dde54f <+79>:	call   *%eax
   0xb7dde551 <+81>:	mov    (%esi),%esi
   0xb7dde553 <+83>:	add    $0x10,%esp
   0xb7dde556 <+86>:	test   %esi,%esi
   0xb7dde558 <+88>:	jne    0xb7dde53f <if_delete_retain+63>
   0xb7dde55a <+90>:	lea    0xa8(%edi),%eax
   0xb7dde560 <+96>:	sub    $0xc,%esp
   0xb7dde563 <+99>:	push   %eax
   0xb7dde564 <+100>:	call   0xb7e07710 <qobj_unreg>
   0xb7dde569 <+105>:	pop    %eax
   0xb7dde56a <+106>:	pushl  0x8c(%edi)
   0xb7dde570 <+112>:	call   0xb7de7e00 <list_delete_all_node>
   0xb7dde575 <+117>:	pop    %edx
   0xb7dde576 <+118>:	pushl  0x90(%edi)
   0xb7dde57c <+124>:	call   0xb7de7e00 <list_delete_all_node>
   0xb7dde581 <+129>:	lea    -0xc(%ebp),%esp
   0xb7dde584 <+132>:	pop    %ebx
   0xb7dde585 <+133>:	pop    %esi
   0xb7dde586 <+134>:	pop    %edi
   0xb7dde587 <+135>:	pop    %ebp
   0xb7dde588 <+136>:	ret    
End of assembler dump.
#5  0xb7de0a70 in if_delete () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_delete:
   0xb7de0a10 <+0>:	push   %ebp
   0xb7de0a11 <+1>:	mov    %esp,%ebp
   0xb7de0a13 <+3>:	push   %edi
   0xb7de0a14 <+4>:	push   %esi
   0xb7de0a15 <+5>:	push   %ebx
   0xb7de0a16 <+6>:	call   0xb7dbd640
   0xb7de0a1b <+11>:	add    $0xe2ff5,%ebx
   0xb7de0a21 <+17>:	sub    $0x18,%esp
   0xb7de0a24 <+20>:	mov    0x8(%ebp),%eax
   0xb7de0a27 <+23>:	mov    (%eax),%esi
   0xb7de0a29 <+25>:	pushl  0xa0(%esi)
   0xb7de0a2f <+31>:	call   0xb7e27290 <vrf_lookup_by_id>
   0xb7de0a34 <+36>:	add    $0x10,%esp
   0xb7de0a37 <+39>:	test   %eax,%eax
   0xb7de0a39 <+41>:	je     0xb7de0b64 <if_delete+340>
   0xb7de0a3f <+47>:	mov    %eax,%edi
   0xb7de0a41 <+49>:	lea    0x4c(%eax),%eax
   0xb7de0a44 <+52>:	sub    $0x4,%esp
   0xb7de0a47 <+55>:	push   %esi
   0xb7de0a48 <+56>:	push   %eax
   0xb7de0a49 <+57>:	lea    -0xf110(%ebx),%eax
   0xb7de0a4f <+63>:	push   %eax
   0xb7de0a50 <+64>:	call   0xb7dfead0 <_rb_remove>
   0xb7de0a55 <+69>:	add    $0x10,%esp
   0xb7de0a58 <+72>:	test   %eax,%eax
   0xb7de0a5a <+74>:	je     0xb7de0b30 <if_delete+288>
   0xb7de0a60 <+80>:	mov    0x34(%esi),%eax
   0xb7de0a63 <+83>:	test   %eax,%eax
   0xb7de0a65 <+85>:	jne    0xb7de0ad8 <if_delete+200>
   0xb7de0a67 <+87>:	sub    $0xc,%esp
   0xb7de0a6a <+90>:	push   %esi
   0xb7de0a6b <+91>:	call   0xb7dde500 <if_delete_retain>
=> 0xb7de0a70 <+96>:	lea    0x8c(%esi),%eax
   0xb7de0a76 <+102>:	mov    %eax,(%esp)
   0xb7de0a79 <+105>:	call   0xb7de7eb0 <list_delete>
   0xb7de0a7e <+110>:	lea    0x90(%esi),%eax
   0xb7de0a84 <+116>:	mov    %eax,(%esp)
   0xb7de0a87 <+119>:	call   0xb7de7eb0 <list_delete>
   0xb7de0a8c <+124>:	mov    %esi,(%esp)
   0xb7de0a8f <+127>:	call   0xb7de09d0 <if_link_params_free>
   0xb7de0a94 <+132>:	pop    %eax
   0xb7de0a95 <+133>:	pop    %edx
   0xb7de0a96 <+134>:	pushl  0x80(%esi)
   0xb7de0a9c <+140>:	pushl  0x590(%ebx)
   0xb7de0aa2 <+146>:	call   0xb7def6d0 <qfree>
   0xb7de0aa7 <+151>:	movl   $0x0,0x80(%esi)
   0xb7de0ab1 <+161>:	lea    0x1450(%ebx),%eax
   0xb7de0ab7 <+167>:	pop    %ecx
   0xb7de0ab8 <+168>:	pop    %edi
   0xb7de0ab9 <+169>:	push   %esi
   0xb7de0aba <+170>:	push   %eax
   0xb7de0abb <+171>:	call   0xb7def6d0 <qfree>
   0xb7de0ac0 <+176>:	mov    0x8(%ebp),%eax
   0xb7de0ac3 <+179>:	add    $0x10,%esp
   0xb7de0ac6 <+182>:	movl   $0x0,(%eax)
   0xb7de0acc <+188>:	lea    -0xc(%ebp),%esp
   0xb7de0acf <+191>:	pop    %ebx
   0xb7de0ad0 <+192>:	pop    %esi
   0xb7de0ad1 <+193>:	pop    %edi
   0xb7de0ad2 <+194>:	pop    %ebp
   0xb7de0ad3 <+195>:	ret    
   0xb7de0ad4 <+196>:	lea    0x0(%esi,%eiz,1),%esi
   0xb7de0ad8 <+200>:	lea    0x50(%edi),%edx
   0xb7de0adb <+203>:	lea    -0xf120(%ebx),%eax
   0xb7de0ae1 <+209>:	sub    $0x4,%esp
   0xb7de0ae4 <+212>:	push   %esi
   0xb7de0ae5 <+213>:	push   %edx
   0xb7de0ae6 <+214>:	push   %eax
   0xb7de0ae7 <+215>:	call   0xb7dfead0 <_rb_remove>
   0xb7de0aec <+220>:	add    $0x10,%esp
   0xb7de0aef <+223>:	test   %eax,%eax
   0xb7de0af1 <+225>:	jne    0xb7de0a67 <if_delete+87>
   0xb7de0af7 <+231>:	lea    -0x76000(%ebx),%eax
   0xb7de0afd <+237>:	sub    $0x8,%esp
   0xb7de0b00 <+240>:	pushl  0xa0(%esi)
   0xb7de0b06 <+246>:	pushl  0x34(%esi)
   0xb7de0b09 <+249>:	push   %eax
   0xb7de0b0a <+250>:	lea    -0x76914(%ebx),%eax
   0xb7de0b10 <+256>:	push   $0x6000009
   0xb7de0b15 <+261>:	push   %eax
   0xb7de0b16 <+262>:	lea    -0xf650(%ebx),%eax
   0xb7de0b1c <+268>:	push   %eax
   0xb7de0b1d <+269>:	call   0xb7ddd650
   0xb7de0b22 <+274>:	add    $0x20,%esp
   0xb7de0b25 <+277>:	jmp    0xb7de0a67 <if_delete+87>
   0xb7de0b2a <+282>:	lea    0x0(%esi),%esi
   0xb7de0b30 <+288>:	lea    0x20(%esi),%eax
   0xb7de0b33 <+291>:	sub    $0x8,%esp
   0xb7de0b36 <+294>:	pushl  0xa0(%esi)
   0xb7de0b3c <+300>:	push   %eax
   0xb7de0b3d <+301>:	lea    -0x76000(%ebx),%eax
   0xb7de0b43 <+307>:	push   %eax
   0xb7de0b44 <+308>:	lea    -0x76970(%ebx),%eax
   0xb7de0b4a <+314>:	push   $0x6000009
   0xb7de0b4f <+319>:	push   %eax
   0xb7de0b50 <+320>:	lea    -0xf610(%ebx),%eax
   0xb7de0b56 <+326>:	push   %eax
   0xb7de0b57 <+327>:	call   0xb7ddd650
   0xb7de0b5c <+332>:	add    $0x20,%esp
   0xb7de0b5f <+335>:	jmp    0xb7de0a60 <if_delete+80>
   0xb7de0b64 <+340>:	lea    -0x75ff4(%ebx),%eax
   0xb7de0b6a <+346>:	push   %eax
   0xb7de0b6b <+347>:	lea    -0x76e6a(%ebx),%eax
   0xb7de0b71 <+353>:	push   $0x133
   0xb7de0b76 <+358>:	push   %eax
   0xb7de0b77 <+359>:	lea    -0x5ecfd(%ebx),%eax
   0xb7de0b7d <+365>:	push   %eax
   0xb7de0b7e <+366>:	call   0xb7db8e58
End of assembler dump.

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17943/artifact/TOPOI386/ErrorLog/log_topotests.txt

Successful on other platforms/tests

Topotests Ubuntu 16.04 i386 part 2
Topotests Ubuntu 18.04 amd64 part 7
Addresssanitizer topotests part 5
Topotests Ubuntu 16.04 amd64 part 5
Topotests Ubuntu 16.04 i386 part 4
Topotests Ubuntu 16.04 i386 part 6
Topotests Ubuntu 18.04 arm8 part 5
IPv4 ldp protocol on Ubuntu 18.04
Topotests Ubuntu 16.04 i386 part 7
Addresssanitizer topotests part 0
Topotests Ubuntu 18.04 arm8 part 9
Static analyzer (clang)
Topotests Ubuntu 18.04 arm8 part 4
Topotests Ubuntu 16.04 amd64 part 7
Addresssanitizer topotests part 1
CentOS 7 rpm pkg check
Topotests Ubuntu 18.04 amd64 part 9
IPv6 protocols on Ubuntu 18.04
Topotests Ubuntu 16.04 amd64 part 4
Topotests Ubuntu 18.04 arm8 part 3
Topotests Ubuntu 16.04 amd64 part 1
Topotests Ubuntu 18.04 amd64 part 3
Fedora 29 rpm pkg check
Topotests Ubuntu 18.04 amd64 part 5
Topotests Ubuntu 18.04 amd64 part 4
IPv4 protocols on Ubuntu 18.04
Addresssanitizer topotests part 4
Topotests Ubuntu 18.04 arm8 part 6
Topotests Ubuntu 16.04 amd64 part 3
Topotests Ubuntu 16.04 i386 part 5
Topotests Ubuntu 18.04 arm8 part 1
Addresssanitizer topotests part 8
Topotests Ubuntu 18.04 arm8 part 2
Topotests Ubuntu 18.04 amd64 part 2
Debian 10 deb pkg check
Topotests Ubuntu 16.04 i386 part 9
Topotests Ubuntu 18.04 arm8 part 7
Topotests Ubuntu 16.04 amd64 part 2
Ubuntu 16.04 deb pkg check
Addresssanitizer topotests part 6
Topotests Ubuntu 18.04 amd64 part 6
Topotests Ubuntu 16.04 i386 part 1
Ubuntu 18.04 deb pkg check
Ubuntu 20.04 deb pkg check
Debian 9 deb pkg check
Topotests Ubuntu 16.04 i386 part 8
Topotests Ubuntu 16.04 amd64 part 9
Topotests Ubuntu 18.04 amd64 part 1
Topotests Ubuntu 16.04 i386 part 3
Topotests Ubuntu 18.04 amd64 part 8
Addresssanitizer topotests part 2
Topotests Ubuntu 16.04 amd64 part 8
Topotests Ubuntu 16.04 amd64 part 6
Topotests Ubuntu 18.04 arm8 part 8
Debian 8 deb pkg check
Addresssanitizer topotests part 7
Addresssanitizer topotests part 9
Addresssanitizer topotests part 3

Warnings Generated during build:

Checkout code: Successful with additional warnings

Topotests Ubuntu 18.04 amd64 part 0: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1804-17943/test

Topology Tests failed for Topotests Ubuntu 18.04 amd64 part 0
see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17943/artifact/TOPOU1804/ErrorLog/log_topotests.txt

Topotests Ubuntu 18.04 arm8 part 0: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPO0U18ARM8-17943/test

Topology Tests failed for Topotests Ubuntu 18.04 arm8 part 0
see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17943/artifact/TOPO0U18ARM8/ErrorLog/log_topotests.txt

Topotests Ubuntu 16.04 amd64 part 0: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOU1604-17943/test

Topology Tests failed for Topotests Ubuntu 16.04 amd64 part 0:

54	../sysdeps/unix/sysv/linux/raise.c: No such file or directory.
No function contains program counter for selected frame.

r1: nhrpd crashed. Core file found - Backtrace follows:
[New LWP 22543]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/nhrpd --log file:nhrpd.log --log-level debug -d'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f6b483e0438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
  Id   Target Id         Frame 
* 1    Thread 0x7f6b494a8880 (LWP 22543) 0x00007f6b483e0438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f6b483e0438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
        resultvar = 0
        pid = 22543
        selftid = 22543
#1  0x00007f6b483e203a in __GI_abort () at abort.c:89
        save_stage = 2
        act = {__sigaction_handler = {sa_handler = 0x3833340035313631, sa_sigaction = 0x3833340035313631}, sa_mask = {__val = {8390891524071635753, 2865525649010281, 16348078259409462528, 0, 94106500929952, 94106500923744, 140722824141440, 140722824141424, 140098763144340, 140722824141488, 6, 140722824142128, 140098750252088, 140722824141472, 140098763144438, 140098753987904}}, sa_flags = -1537006336, sa_restorer = 0x7ffc95f1dab0}
        sigs = {__val = {32, 0 <repeats 15 times>}}
#2  0x00007f6b4904f655 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#3  <signal handler called>
No locals.
#4  0x00007f6b483e0438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
        resultvar = 0
        pid = 22543
        selftid = 22543
#5  0x00007f6b483e203a in __GI_abort () at abort.c:89
        save_stage = 2
        act = {__sigaction_handler = {sa_handler = 0x4, sa_sigaction = 0x4}, sa_mask = {__val = {140098768475432, 94106525575328, 140722824143024, 20971988736, 140098768470016, 94106498770978, 211, 94106498772464, 4294967295, 94106523754336, 140098750576012, 140098751673104, 140098751686752, 0, 140098751673104, 94106498770978}}, sa_flags = 1230241792, sa_restorer = 0x5596e06e2822}
        sigs = {__val = {32, 0 <repeats 15 times>}}
#6  0x00007f6b483d8be7 in __assert_fail_base (fmt=<optimized out>, assertion=assertion@entry=0x5596e06e2822 "nifp->peer_hash->count == 0", file=file@entry=0x5596e06e2810 "nhrpd/nhrp_peer.c", line=line@entry=211, function=function@entry=0x5596e06e2df0 "nhrp_peer_interface_del") at assert.c:92
        str = 0x5596e1f4a980 "\330\373vHk\177"
        total = 4096
#7  0x00007f6b483d8c92 in __GI___assert_fail (assertion=0x5596e06e2822 "nifp->peer_hash->count == 0", file=0x5596e06e2810 "nhrpd/nhrp_peer.c", line=211, function=0x5596e06e2df0 "nhrp_peer_interface_del") at assert.c:101
No locals.
#8  0x00005596e06d634b in nhrp_peer_interface_del ()
No symbol table info available.
#9  0x00005596e06d1ee2 in ?? ()
No symbol table info available.
#10 0x00007f6b4901b565 in if_delete_retain () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#11 0x00007f6b4901d7b5 in if_delete () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#12 0x00007f6b4901d985 in if_terminate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#13 0x00007f6b49061c75 in vrf_delete () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#14 0x00007f6b49061fbb in vrf_terminate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#15 0x00005596e06d32d5 in ?? ()
No symbol table info available.
#16 0x00007f6b4904f9e3 in quagga_sigevent_process () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#17 0x00007f6b4905ee55 in thread_fetch () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#18 0x00007f6b49023de3 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#19 0x00005596e06ce08a in main ()
No symbol table info available.
Dump of assembler code for function __GI___assert_fail:
   0x00007f6b483d8c50 <+0>:	push   %r13
   0x00007f6b483d8c52 <+2>:	push   %r12
   0x00007f6b483d8c54 <+4>:	mov    %rcx,%r13
   0x00007f6b483d8c57 <+7>:	push   %rbp
   0x00007f6b483d8c58 <+8>:	push   %rbx
   0x00007f6b483d8c59 <+9>:	mov    %rsi,%rbp
   0x00007f6b483d8c5c <+12>:	mov    %rdi,%rbx
   0x00007f6b483d8c5f <+15>:	lea    0x1626aa(%rip),%rsi        # 0x7f6b4853b310
   0x00007f6b483d8c66 <+22>:	lea    0x15f013(%rip),%rdi        # 0x7f6b48537c80 <_libc_intl_domainname>
   0x00007f6b483d8c6d <+29>:	mov    %edx,%r12d
   0x00007f6b483d8c70 <+32>:	sub    $0x8,%rsp
   0x00007f6b483d8c74 <+36>:	mov    $0x5,%edx
   0x00007f6b483d8c79 <+41>:	callq  0x7f6b483d9630 <__GI___dcgettext>
   0x00007f6b483d8c7e <+46>:	mov    %r13,%r8
   0x00007f6b483d8c81 <+49>:	mov    %r12d,%ecx
   0x00007f6b483d8c84 <+52>:	mov    %rbp,%rdx
   0x00007f6b483d8c87 <+55>:	mov    %rbx,%rsi
   0x00007f6b483d8c8a <+58>:	mov    %rax,%rdi
   0x00007f6b483d8c8d <+61>:	callq  0x7f6b483d8ad0 <__assert_fail_base>
End of assembler dump.
#8  0x00005596e06d634b in nhrp_peer_interface_del ()
Dump of assembler code for function nhrp_peer_interface_del:
   0x00005596e06d62a0 <+0>:	push   %rbp
   0x00005596e06d62a1 <+1>:	mov    %rsp,%rbp
   0x00005596e06d62a4 <+4>:	push   %rbx
   0x00005596e06d62a5 <+5>:	sub    $0x8,%rsp
   0x00005596e06d62a9 <+9>:	testb  $0x1,0x21d210(%rip)        # 0x5596e08f34c0 <debug_flags>
   0x00005596e06d62b0 <+16>:	mov    0xd0(%rdi),%rbx
   0x00005596e06d62b7 <+23>:	jne    0x5596e06d6300 <nhrp_peer_interface_del+96>
   0x00005596e06d62b9 <+25>:	mov    0x68(%rbx),%rdi
   0x00005596e06d62bd <+29>:	test   %rdi,%rdi
   0x00005596e06d62c0 <+32>:	je     0x5596e06d62f0 <nhrp_peer_interface_del+80>
   0x00005596e06d62c2 <+34>:	lea    -0xa69(%rip),%rsi        # 0x5596e06d5860
   0x00005596e06d62c9 <+41>:	xor    %edx,%edx
   0x00005596e06d62cb <+43>:	callq  0x5596e06cda40
   0x00005596e06d62d0 <+48>:	mov    0x68(%rbx),%rdi
   0x00005596e06d62d4 <+52>:	cmpq   $0x0,0x20(%rdi)
   0x00005596e06d62d9 <+57>:	jne    0x5596e06d632c <nhrp_peer_interface_del+140>
   0x00005596e06d62db <+59>:	add    $0x8,%rsp
   0x00005596e06d62df <+63>:	pop    %rbx
   0x00005596e06d62e0 <+64>:	pop    %rbp
   0x00005596e06d62e1 <+65>:	jmpq   0x5596e06cdb98
   0x00005596e06d62e6 <+70>:	nopw   %cs:0x0(%rax,%rax,1)
   0x00005596e06d62f0 <+80>:	add    $0x8,%rsp
   0x00005596e06d62f4 <+84>:	pop    %rbx
   0x00005596e06d62f5 <+85>:	pop    %rbp
   0x00005596e06d62f6 <+86>:	retq   
   0x00005596e06d62f7 <+87>:	nopw   0x0(%rax,%rax,1)
   0x00005596e06d6300 <+96>:	mov    0x68(%rbx),%rax
   0x00005596e06d6304 <+100>:	test   %rax,%rax
   0x00005596e06d6307 <+103>:	je     0x5596e06d6328 <nhrp_peer_interface_del+136>
   0x00005596e06d6309 <+105>:	mov    0x20(%rax),%rdx
   0x00005596e06d630d <+109>:	lea    0xbc9c(%rip),%rsi        # 0x5596e06e1fb0
   0x00005596e06d6314 <+116>:	lea    0x216325(%rip),%rdi        # 0x5596e08ec640
   0x00005596e06d631b <+123>:	xor    %eax,%eax
   0x00005596e06d631d <+125>:	callq  0x5596e06d56d0
   0x00005596e06d6322 <+130>:	jmp    0x5596e06d62b9 <nhrp_peer_interface_del+25>
   0x00005596e06d6324 <+132>:	nopl   0x0(%rax)
   0x00005596e06d6328 <+136>:	xor    %edx,%edx
   0x00005596e06d632a <+138>:	jmp    0x5596e06d630d <nhrp_peer_interface_del+109>
   0x00005596e06d632c <+140>:	lea    0xcabd(%rip),%rcx        # 0x5596e06e2df0
   0x00005596e06d6333 <+147>:	lea    0xc4d6(%rip),%rsi        # 0x5596e06e2810
   0x00005596e06d633a <+154>:	lea    0xc4e1(%rip),%rdi        # 0x5596e06e2822
   0x00005596e06d6341 <+161>:	mov    $0xd3,%edx
   0x00005596e06d6346 <+166>:	callq  0x5596e06cd830
End of assembler dump.
#9  0x00005596e06d1ee2 in ?? ()
#10 0x00007f6b4901b565 in if_delete_retain () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_delete_retain:
   0x00007f6b4901b540 <+0>:	mov    0x2e86e1(%rip),%rax        # 0x7f6b49303c28
   0x00007f6b4901b547 <+7>:	push   %rbp
   0x00007f6b4901b548 <+8>:	mov    %rsp,%rbp
   0x00007f6b4901b54b <+11>:	push   %r12
   0x00007f6b4901b54d <+13>:	push   %rbx
   0x00007f6b4901b54e <+14>:	mov    0x8(%rax),%rbx
   0x00007f6b4901b552 <+18>:	mov    %rdi,%r12
   0x00007f6b4901b555 <+21>:	test   %rbx,%rbx
   0x00007f6b4901b558 <+24>:	jne    0x7f6b4901b56d <if_delete_retain+45>
   0x00007f6b4901b55a <+26>:	jmp    0x7f6b4901b588 <if_delete_retain+72>
   0x00007f6b4901b55c <+28>:	nopl   0x0(%rax)
   0x00007f6b4901b560 <+32>:	mov    %r12,%rdi
   0x00007f6b4901b563 <+35>:	callq  *%rax
=> 0x00007f6b4901b565 <+37>:	mov    (%rbx),%rbx
   0x00007f6b4901b568 <+40>:	test   %rbx,%rbx
   0x00007f6b4901b56b <+43>:	je     0x7f6b4901b588 <if_delete_retain+72>
   0x00007f6b4901b56d <+45>:	testb  $0x1,0x18(%rbx)
   0x00007f6b4901b571 <+49>:	mov    0x8(%rbx),%rax
   0x00007f6b4901b575 <+53>:	je     0x7f6b4901b560 <if_delete_retain+32>
   0x00007f6b4901b577 <+55>:	mov    0x10(%rbx),%rdi
   0x00007f6b4901b57b <+59>:	mov    %r12,%rsi
   0x00007f6b4901b57e <+62>:	callq  *%rax
   0x00007f6b4901b580 <+64>:	mov    (%rbx),%rbx
   0x00007f6b4901b583 <+67>:	test   %rbx,%rbx
   0x00007f6b4901b586 <+70>:	jne    0x7f6b4901b56d <if_delete_retain+45>
   0x00007f6b4901b588 <+72>:	lea    0xf0(%r12),%rdi
   0x00007f6b4901b590 <+80>:	callq  0x7f6b49042b50 <qobj_unreg>
   0x00007f6b4901b595 <+85>:	mov    0xc0(%r12),%rdi
   0x00007f6b4901b59d <+93>:	callq  0x7f6b490248f0 <list_delete_all_node>
   0x00007f6b4901b5a2 <+98>:	pop    %rbx
   0x00007f6b4901b5a3 <+99>:	mov    0xc8(%r12),%rdi
   0x00007f6b4901b5ab <+107>:	pop    %r12
   0x00007f6b4901b5ad <+109>:	pop    %rbp
   0x00007f6b4901b5ae <+110>:	jmpq   0x7f6b490248f0 <list_delete_all_node>
End of assembler dump.
#11 0x00007f6b4901d7b5 in if_delete () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_delete:
   0x00007f6b4901d760 <+0>:	push   %rbp
   0x00007f6b4901d761 <+1>:	mov    %rsp,%rbp
   0x00007f6b4901d764 <+4>:	push   %r13
   0x00007f6b4901d766 <+6>:	push   %r12
   0x00007f6b4901d768 <+8>:	push   %rbx
   0x00007f6b4901d769 <+9>:	mov    %rdi,%r13
   0x00007f6b4901d76c <+12>:	sub    $0x8,%rsp
   0x00007f6b4901d770 <+16>:	mov    (%rdi),%rbx
   0x00007f6b4901d773 <+19>:	mov    0xe8(%rbx),%edi
   0x00007f6b4901d779 <+25>:	callq  0x7f6b49061960 <vrf_lookup_by_id>
   0x00007f6b4901d77e <+30>:	test   %rax,%rax
   0x00007f6b4901d781 <+33>:	je     0x7f6b4901d897 <if_delete+311>
   0x00007f6b4901d787 <+39>:	lea    0x70(%rax),%rsi
   0x00007f6b4901d78b <+43>:	lea    0x2d19fe(%rip),%rdi        # 0x7f6b492ef190
   0x00007f6b4901d792 <+50>:	mov    %rbx,%rdx
   0x00007f6b4901d795 <+53>:	mov    %rax,%r12
   0x00007f6b4901d798 <+56>:	callq  0x7f6b4903a3b0 <_rb_remove>
   0x00007f6b4901d79d <+61>:	test   %rax,%rax
   0x00007f6b4901d7a0 <+64>:	je     0x7f6b4901d868 <if_delete+264>
   0x00007f6b4901d7a6 <+70>:	mov    0x54(%rbx),%eax
   0x00007f6b4901d7a9 <+73>:	test   %eax,%eax
   0x00007f6b4901d7ab <+75>:	jne    0x7f6b4901d818 <if_delete+184>
   0x00007f6b4901d7ad <+77>:	mov    %rbx,%rdi
   0x00007f6b4901d7b0 <+80>:	callq  0x7f6b4901b540 <if_delete_retain>
=> 0x00007f6b4901d7b5 <+85>:	lea    0xc0(%rbx),%rdi
   0x00007f6b4901d7bc <+92>:	callq  0x7f6b49024990 <list_delete>
   0x00007f6b4901d7c1 <+97>:	lea    0xc8(%rbx),%rdi
   0x00007f6b4901d7c8 <+104>:	callq  0x7f6b49024990 <list_delete>
   0x00007f6b4901d7cd <+109>:	mov    %rbx,%rdi
   0x00007f6b4901d7d0 <+112>:	callq  0x7f6b4901d720 <if_link_params_free>
   0x00007f6b4901d7d5 <+117>:	mov    0xa8(%rbx),%rsi
   0x00007f6b4901d7dc <+124>:	mov    0x2e6745(%rip),%rdi        # 0x7f6b49303f28
   0x00007f6b4901d7e3 <+131>:	callq  0x7f6b4902bbf0 <qfree>
   0x00007f6b4901d7e8 <+136>:	lea    0x2e8191(%rip),%rdi        # 0x7f6b49305980
   0x00007f6b4901d7ef <+143>:	movq   $0x0,0xa8(%rbx)
   0x00007f6b4901d7fa <+154>:	mov    %rbx,%rsi
   0x00007f6b4901d7fd <+157>:	callq  0x7f6b4902bbf0 <qfree>
   0x00007f6b4901d802 <+162>:	movq   $0x0,0x0(%r13)
   0x00007f6b4901d80a <+170>:	add    $0x8,%rsp
   0x00007f6b4901d80e <+174>:	pop    %rbx
   0x00007f6b4901d80f <+175>:	pop    %r12
   0x00007f6b4901d811 <+177>:	pop    %r13
   0x00007f6b4901d813 <+179>:	pop    %rbp
   0x00007f6b4901d814 <+180>:	retq   
   0x00007f6b4901d815 <+181>:	nopl   (%rax)
   0x00007f6b4901d818 <+184>:	lea    0x78(%r12),%rsi
   0x00007f6b4901d81d <+189>:	lea    0x2d194c(%rip),%rdi        # 0x7f6b492ef170
   0x00007f6b4901d824 <+196>:	mov    %rbx,%rdx
   0x00007f6b4901d827 <+199>:	callq  0x7f6b4903a3b0 <_rb_remove>
   0x00007f6b4901d82c <+204>:	test   %rax,%rax
   0x00007f6b4901d82f <+207>:	jne    0x7f6b4901d7ad <if_delete+77>
   0x00007f6b4901d835 <+213>:	mov    0xe8(%rbx),%r9d
   0x00007f6b4901d83c <+220>:	mov    0x54(%rbx),%r8d
   0x00007f6b4901d840 <+224>:	lea    0x6ad31(%rip),%rcx        # 0x7f6b49088578
   0x00007f6b4901d847 <+231>:	lea    0x6a362(%rip),%rsi        # 0x7f6b49087bb0
   0x00007f6b4901d84e <+238>:	lea    0x2d108b(%rip),%rdi        # 0x7f6b492ee8e0
   0x00007f6b4901d855 <+245>:	mov    $0x6000009,%edx
   0x00007f6b4901d85a <+250>:	callq  0x7f6b4901a7e0
   0x00007f6b4901d85f <+255>:	jmpq   0x7f6b4901d7ad <if_delete+77>
   0x00007f6b4901d864 <+260>:	nopl   0x0(%rax)
   0x00007f6b4901d868 <+264>:	mov    0xe8(%rbx),%r9d
   0x00007f6b4901d86f <+271>:	lea    0x40(%rbx),%r8
   0x00007f6b4901d873 <+275>:	lea    0x6acfe(%rip),%rcx        # 0x7f6b49088578
   0x00007f6b4901d87a <+282>:	lea    0x6a2cf(%rip),%rsi        # 0x7f6b49087b50
   0x00007f6b4901d881 <+289>:	lea    0x2d1098(%rip),%rdi        # 0x7f6b492ee920
   0x00007f6b4901d888 <+296>:	mov    $0x6000009,%edx
   0x00007f6b4901d88d <+301>:	callq  0x7f6b4901a7e0
   0x00007f6b4901d892 <+306>:	jmpq   0x7f6b4901d7a6 <if_delete+70>
   0x00007f6b4901d897 <+311>:	lea    0x6acea(%rip),%rcx        # 0x7f6b49088588
   0x00007f6b4901d89e <+318>:	lea    0x69da9(%rip),%rsi        # 0x7f6b4908764e
   0x00007f6b4901d8a5 <+325>:	lea    0x82e0b(%rip),%rdi        # 0x7f6b490a06b7
   0x00007f6b4901d8ac <+332>:	mov    $0x133,%edx
   0x00007f6b4901d8b1 <+337>:	callq  0x7f6b48ff6768
End of assembler dump.
#12 0x00007f6b4901d985 in if_terminate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_terminate:
   0x00007f6b4901d910 <+0>:	push   %rbp
   0x00007f6b4901d911 <+1>:	mov    %rsp,%rbp
   0x00007f6b4901d914 <+4>:	push   %r13
   0x00007f6b4901d916 <+6>:	push   %r12
   0x00007f6b4901d918 <+8>:	push   %rbx
   0x00007f6b4901d919 <+9>:	sub    $0x18,%rsp
   0x00007f6b4901d91d <+13>:	mov    %fs:0x28,%rax
   0x00007f6b4901d926 <+22>:	mov    %rax,-0x28(%rbp)
   0x00007f6b4901d92a <+26>:	xor    %eax,%eax
   0x00007f6b4901d92c <+28>:	cmpq   $0x0,0x70(%rdi)
   0x00007f6b4901d931 <+33>:	je     0x7f6b4901d98c <if_terminate+124>
   0x00007f6b4901d933 <+35>:	lea    0x70(%rdi),%r13
   0x00007f6b4901d937 <+39>:	lea    -0x30(%rbp),%r12
   0x00007f6b4901d93b <+43>:	mov    %rdi,%rbx
   0x00007f6b4901d93e <+46>:	xchg   %ax,%ax
   0x00007f6b4901d940 <+48>:	lea    0x2d1849(%rip),%rdi        # 0x7f6b492ef190
   0x00007f6b4901d947 <+55>:	mov    %r13,%rsi
   0x00007f6b4901d94a <+58>:	callq  0x7f6b4903b0e0 <_rb_root>
   0x00007f6b4901d94f <+63>:	mov    0xe0(%rax),%rdi
   0x00007f6b4901d956 <+70>:	mov    %rax,-0x30(%rbp)
   0x00007f6b4901d95a <+74>:	test   %rdi,%rdi
   0x00007f6b4901d95d <+77>:	je     0x7f6b4901d97d <if_terminate+109>
   0x00007f6b4901d95f <+79>:	mov    0x50(%rdi),%eax
   0x00007f6b4901d962 <+82>:	movq   $0x0,0x68(%rdi)
   0x00007f6b4901d96a <+90>:	test   %eax,%eax
   0x00007f6b4901d96c <+92>:	je     0x7f6b4901d9a6 <if_terminate+150>
   0x00007f6b4901d96e <+94>:	sub    $0x1,%eax
   0x00007f6b4901d971 <+97>:	test   %eax,%eax
   0x00007f6b4901d973 <+99>:	mov    %eax,0x50(%rdi)
   0x00007f6b4901d976 <+102>:	jne    0x7f6b4901d97d <if_terminate+109>
   0x00007f6b4901d978 <+104>:	callq  0x7f6b49059ff0 <route_node_delete>
   0x00007f6b4901d97d <+109>:	mov    %r12,%rdi
   0x00007f6b4901d980 <+112>:	callq  0x7f6b4901d760 <if_delete>
=> 0x00007f6b4901d985 <+117>:	cmpq   $0x0,0x70(%rbx)
   0x00007f6b4901d98a <+122>:	jne    0x7f6b4901d940 <if_terminate+48>
   0x00007f6b4901d98c <+124>:	mov    -0x28(%rbp),%rax
   0x00007f6b4901d990 <+128>:	xor    %fs:0x28,%rax
   0x00007f6b4901d999 <+137>:	jne    0x7f6b4901d9c5 <if_terminate+181>
   0x00007f6b4901d99b <+139>:	add    $0x18,%rsp
   0x00007f6b4901d99f <+143>:	pop    %rbx
   0x00007f6b4901d9a0 <+144>:	pop    %r12
   0x00007f6b4901d9a2 <+146>:	pop    %r13
   0x00007f6b4901d9a4 <+148>:	pop    %rbp
   0x00007f6b4901d9a5 <+149>:	retq   
   0x00007f6b4901d9a6 <+150>:	lea    0x6aa43(%rip),%rcx        # 0x7f6b490883f0
   0x00007f6b4901d9ad <+157>:	lea    0x6a011(%rip),%rsi        # 0x7f6b490879c5
   0x00007f6b4901d9b4 <+164>:	lea    0x6a016(%rip),%rdi        # 0x7f6b490879d1
   0x00007f6b4901d9bb <+171>:	mov    $0x102,%edx
   0x00007f6b4901d9c0 <+176>:	callq  0x7f6b48ff6768
   0x00007f6b4901d9c5 <+181>:	callq  0x7f6b48ff66a0
End of assembler dump.
54	../sysdeps/unix/sysv/linux/raise.c: No such file or directory.
No function contains program counter for selected frame.

r2: nhrpd crashed. Core file found - Backtrace follows:
[New LWP 22613]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/nhrpd --log file:nhrpd.log --log-level debug -d'.
Program terminated with signal SIGABRT, Aborted.
#0  0x00007f1c6e872438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
  Id   Target Id         Frame 
* 1    Thread 0x7f1c6f93a880 (LWP 22613) 0x00007f1c6e872438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#0  0x00007f1c6e872438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
        resultvar = 0
        pid = 22613
        selftid = 22613
#1  0x00007f1c6e87403a in __GI_abort () at abort.c:89
        save_stage = 2
        act = {__sigaction_handler = {sa_handler = 0x3833340035313631, sa_sigaction = 0x3833340035313631}, sa_mask = {__val = {8390891524071635753, 2865525649010281, 10682902079087270912, 0, 94302447520160, 94302447513952, 140721813159872, 140721813159856, 139760103054484, 140721813159920, 6, 140721813160560, 139760090162232, 140721813159904, 139760103054582, 139760093898048}}, sa_flags = 709319680, sa_restorer = 0x7ffc59af7ff0}
        sigs = {__val = {32, 0 <repeats 15 times>}}
#2  0x00007f1c6f4e1655 in ?? () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#3  <signal handler called>
No locals.
#4  0x00007f1c6e872438 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
        resultvar = 0
        pid = 22613
        selftid = 22613
#5  0x00007f1c6e87403a in __GI_abort () at abort.c:89
        save_stage = 2
        act = {__sigaction_handler = {sa_handler = 0x4, sa_sigaction = 0x4}, sa_mask = {__val = {139760108385576, 94302454614272, 140721813161472, 19332532064, 139760108380160, 94302445361186, 211, 94302445362672, 4294967295, 94302452793184, 139760090486156, 139760091583248, 139760091596896, 0, 139760091583248, 94302445361186}}, sa_flags = 1872568320, sa_restorer = 0x55c47fc1d822}
        sigs = {__val = {32, 0 <repeats 15 times>}}
#6  0x00007f1c6e86abe7 in __assert_fail_base (fmt=<optimized out>, assertion=assertion@entry=0x55c47fc1d822 "nifp->peer_hash->count == 0", file=file@entry=0x55c47fc1d810 "nhrpd/nhrp_peer.c", line=line@entry=211, function=function@entry=0x55c47fc1ddf0 "nhrp_peer_interface_del") at assert.c:92
        str = 0x55c4803c8980 "\330\033\300n\034\177"
        total = 4096
#7  0x00007f1c6e86ac92 in __GI___assert_fail (assertion=0x55c47fc1d822 "nifp->peer_hash->count == 0", file=0x55c47fc1d810 "nhrpd/nhrp_peer.c", line=211, function=0x55c47fc1ddf0 "nhrp_peer_interface_del") at assert.c:101
No locals.
#8  0x000055c47fc1134b in nhrp_peer_interface_del ()
No symbol table info available.
#9  0x000055c47fc0cee2 in ?? ()
No symbol table info available.
#10 0x00007f1c6f4ad565 in if_delete_retain () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#11 0x00007f1c6f4af7b5 in if_delete () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#12 0x00007f1c6f4af985 in if_terminate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#13 0x00007f1c6f4f3c75 in vrf_delete () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#14 0x00007f1c6f4f3fbb in vrf_terminate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#15 0x000055c47fc0e2d5 in ?? ()
No symbol table info available.
#16 0x00007f1c6f4e19e3 in quagga_sigevent_process () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#17 0x00007f1c6f4f0e55 in thread_fetch () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#18 0x00007f1c6f4b5de3 in frr_run () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#19 0x000055c47fc0908a in main ()
No symbol table info available.
Dump of assembler code for function __GI___assert_fail:
   0x00007f1c6e86ac50 <+0>:	push   %r13
   0x00007f1c6e86ac52 <+2>:	push   %r12
   0x00007f1c6e86ac54 <+4>:	mov    %rcx,%r13
   0x00007f1c6e86ac57 <+7>:	push   %rbp
   0x00007f1c6e86ac58 <+8>:	push   %rbx
   0x00007f1c6e86ac59 <+9>:	mov    %rsi,%rbp
   0x00007f1c6e86ac5c <+12>:	mov    %rdi,%rbx
   0x00007f1c6e86ac5f <+15>:	lea    0x1626aa(%rip),%rsi        # 0x7f1c6e9cd310
   0x00007f1c6e86ac66 <+22>:	lea    0x15f013(%rip),%rdi        # 0x7f1c6e9c9c80 <_libc_intl_domainname>
   0x00007f1c6e86ac6d <+29>:	mov    %edx,%r12d
   0x00007f1c6e86ac70 <+32>:	sub    $0x8,%rsp
   0x00007f1c6e86ac74 <+36>:	mov    $0x5,%edx
   0x00007f1c6e86ac79 <+41>:	callq  0x7f1c6e86b630 <__GI___dcgettext>
   0x00007f1c6e86ac7e <+46>:	mov    %r13,%r8
   0x00007f1c6e86ac81 <+49>:	mov    %r12d,%ecx
   0x00007f1c6e86ac84 <+52>:	mov    %rbp,%rdx
   0x00007f1c6e86ac87 <+55>:	mov    %rbx,%rsi
   0x00007f1c6e86ac8a <+58>:	mov    %rax,%rdi
   0x00007f1c6e86ac8d <+61>:	callq  0x7f1c6e86aad0 <__assert_fail_base>
End of assembler dump.
#8  0x000055c47fc1134b in nhrp_peer_interface_del ()
Dump of assembler code for function nhrp_peer_interface_del:
   0x000055c47fc112a0 <+0>:	push   %rbp
   0x000055c47fc112a1 <+1>:	mov    %rsp,%rbp
   0x000055c47fc112a4 <+4>:	push   %rbx
   0x000055c47fc112a5 <+5>:	sub    $0x8,%rsp
   0x000055c47fc112a9 <+9>:	testb  $0x1,0x21d210(%rip)        # 0x55c47fe2e4c0 <debug_flags>
   0x000055c47fc112b0 <+16>:	mov    0xd0(%rdi),%rbx
   0x000055c47fc112b7 <+23>:	jne    0x55c47fc11300 <nhrp_peer_interface_del+96>
   0x000055c47fc112b9 <+25>:	mov    0x68(%rbx),%rdi
   0x000055c47fc112bd <+29>:	test   %rdi,%rdi
   0x000055c47fc112c0 <+32>:	je     0x55c47fc112f0 <nhrp_peer_interface_del+80>
   0x000055c47fc112c2 <+34>:	lea    -0xa69(%rip),%rsi        # 0x55c47fc10860
   0x000055c47fc112c9 <+41>:	xor    %edx,%edx
   0x000055c47fc112cb <+43>:	callq  0x55c47fc08a40
   0x000055c47fc112d0 <+48>:	mov    0x68(%rbx),%rdi
   0x000055c47fc112d4 <+52>:	cmpq   $0x0,0x20(%rdi)
   0x000055c47fc112d9 <+57>:	jne    0x55c47fc1132c <nhrp_peer_interface_del+140>
   0x000055c47fc112db <+59>:	add    $0x8,%rsp
   0x000055c47fc112df <+63>:	pop    %rbx
   0x000055c47fc112e0 <+64>:	pop    %rbp
   0x000055c47fc112e1 <+65>:	jmpq   0x55c47fc08b98
   0x000055c47fc112e6 <+70>:	nopw   %cs:0x0(%rax,%rax,1)
   0x000055c47fc112f0 <+80>:	add    $0x8,%rsp
   0x000055c47fc112f4 <+84>:	pop    %rbx
   0x000055c47fc112f5 <+85>:	pop    %rbp
   0x000055c47fc112f6 <+86>:	retq   
   0x000055c47fc112f7 <+87>:	nopw   0x0(%rax,%rax,1)
   0x000055c47fc11300 <+96>:	mov    0x68(%rbx),%rax
   0x000055c47fc11304 <+100>:	test   %rax,%rax
   0x000055c47fc11307 <+103>:	je     0x55c47fc11328 <nhrp_peer_interface_del+136>
   0x000055c47fc11309 <+105>:	mov    0x20(%rax),%rdx
   0x000055c47fc1130d <+109>:	lea    0xbc9c(%rip),%rsi        # 0x55c47fc1cfb0
   0x000055c47fc11314 <+116>:	lea    0x216325(%rip),%rdi        # 0x55c47fe27640
   0x000055c47fc1131b <+123>:	xor    %eax,%eax
   0x000055c47fc1131d <+125>:	callq  0x55c47fc106d0
   0x000055c47fc11322 <+130>:	jmp    0x55c47fc112b9 <nhrp_peer_interface_del+25>
   0x000055c47fc11324 <+132>:	nopl   0x0(%rax)
   0x000055c47fc11328 <+136>:	xor    %edx,%edx
   0x000055c47fc1132a <+138>:	jmp    0x55c47fc1130d <nhrp_peer_interface_del+109>
   0x000055c47fc1132c <+140>:	lea    0xcabd(%rip),%rcx        # 0x55c47fc1ddf0
   0x000055c47fc11333 <+147>:	lea    0xc4d6(%rip),%rsi        # 0x55c47fc1d810
   0x000055c47fc1133a <+154>:	lea    0xc4e1(%rip),%rdi        # 0x55c47fc1d822
   0x000055c47fc11341 <+161>:	mov    $0xd3,%edx
   0x000055c47fc11346 <+166>:	callq  0x55c47fc08830
End of assembler dump.
#9  0x000055c47fc0cee2 in ?? ()
#10 0x00007f1c6f4ad565 in if_delete_retain () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_delete_retain:
   0x00007f1c6f4ad540 <+0>:	mov    0x2e86e1(%rip),%rax        # 0x7f1c6f795c28
   0x00007f1c6f4ad547 <+7>:	push   %rbp
   0x00007f1c6f4ad548 <+8>:	mov    %rsp,%rbp
   0x00007f1c6f4ad54b <+11>:	push   %r12
   0x00007f1c6f4ad54d <+13>:	push   %rbx
   0x00007f1c6f4ad54e <+14>:	mov    0x8(%rax),%rbx
   0x00007f1c6f4ad552 <+18>:	mov    %rdi,%r12
   0x00007f1c6f4ad555 <+21>:	test   %rbx,%rbx
   0x00007f1c6f4ad558 <+24>:	jne    0x7f1c6f4ad56d <if_delete_retain+45>
   0x00007f1c6f4ad55a <+26>:	jmp    0x7f1c6f4ad588 <if_delete_retain+72>
   0x00007f1c6f4ad55c <+28>:	nopl   0x0(%rax)
   0x00007f1c6f4ad560 <+32>:	mov    %r12,%rdi
   0x00007f1c6f4ad563 <+35>:	callq  *%rax
=> 0x00007f1c6f4ad565 <+37>:	mov    (%rbx),%rbx
   0x00007f1c6f4ad568 <+40>:	test   %rbx,%rbx
   0x00007f1c6f4ad56b <+43>:	je     0x7f1c6f4ad588 <if_delete_retain+72>
   0x00007f1c6f4ad56d <+45>:	testb  $0x1,0x18(%rbx)
   0x00007f1c6f4ad571 <+49>:	mov    0x8(%rbx),%rax
   0x00007f1c6f4ad575 <+53>:	je     0x7f1c6f4ad560 <if_delete_retain+32>
   0x00007f1c6f4ad577 <+55>:	mov    0x10(%rbx),%rdi
   0x00007f1c6f4ad57b <+59>:	mov    %r12,%rsi
   0x00007f1c6f4ad57e <+62>:	callq  *%rax
   0x00007f1c6f4ad580 <+64>:	mov    (%rbx),%rbx
   0x00007f1c6f4ad583 <+67>:	test   %rbx,%rbx
   0x00007f1c6f4ad586 <+70>:	jne    0x7f1c6f4ad56d <if_delete_retain+45>
   0x00007f1c6f4ad588 <+72>:	lea    0xf0(%r12),%rdi
   0x00007f1c6f4ad590 <+80>:	callq  0x7f1c6f4d4b50 <qobj_unreg>
   0x00007f1c6f4ad595 <+85>:	mov    0xc0(%r12),%rdi
   0x00007f1c6f4ad59d <+93>:	callq  0x7f1c6f4b68f0 <list_delete_all_node>
   0x00007f1c6f4ad5a2 <+98>:	pop    %rbx
   0x00007f1c6f4ad5a3 <+99>:	mov    0xc8(%r12),%rdi
   0x00007f1c6f4ad5ab <+107>:	pop    %r12
   0x00007f1c6f4ad5ad <+109>:	pop    %rbp
   0x00007f1c6f4ad5ae <+110>:	jmpq   0x7f1c6f4b68f0 <list_delete_all_node>
End of assembler dump.
#11 0x00007f1c6f4af7b5 in if_delete () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_delete:
   0x00007f1c6f4af760 <+0>:	push   %rbp
   0x00007f1c6f4af761 <+1>:	mov    %rsp,%rbp
   0x00007f1c6f4af764 <+4>:	push   %r13
   0x00007f1c6f4af766 <+6>:	push   %r12
   0x00007f1c6f4af768 <+8>:	push   %rbx
   0x00007f1c6f4af769 <+9>:	mov    %rdi,%r13
   0x00007f1c6f4af76c <+12>:	sub    $0x8,%rsp
   0x00007f1c6f4af770 <+16>:	mov    (%rdi),%rbx
   0x00007f1c6f4af773 <+19>:	mov    0xe8(%rbx),%edi
   0x00007f1c6f4af779 <+25>:	callq  0x7f1c6f4f3960 <vrf_lookup_by_id>
   0x00007f1c6f4af77e <+30>:	test   %rax,%rax
   0x00007f1c6f4af781 <+33>:	je     0x7f1c6f4af897 <if_delete+311>
   0x00007f1c6f4af787 <+39>:	lea    0x70(%rax),%rsi
   0x00007f1c6f4af78b <+43>:	lea    0x2d19fe(%rip),%rdi        # 0x7f1c6f781190
   0x00007f1c6f4af792 <+50>:	mov    %rbx,%rdx
   0x00007f1c6f4af795 <+53>:	mov    %rax,%r12
   0x00007f1c6f4af798 <+56>:	callq  0x7f1c6f4cc3b0 <_rb_remove>
   0x00007f1c6f4af79d <+61>:	test   %rax,%rax
   0x00007f1c6f4af7a0 <+64>:	je     0x7f1c6f4af868 <if_delete+264>
   0x00007f1c6f4af7a6 <+70>:	mov    0x54(%rbx),%eax
   0x00007f1c6f4af7a9 <+73>:	test   %eax,%eax
   0x00007f1c6f4af7ab <+75>:	jne    0x7f1c6f4af818 <if_delete+184>
   0x00007f1c6f4af7ad <+77>:	mov    %rbx,%rdi
   0x00007f1c6f4af7b0 <+80>:	callq  0x7f1c6f4ad540 <if_delete_retain>
=> 0x00007f1c6f4af7b5 <+85>:	lea    0xc0(%rbx),%rdi
   0x00007f1c6f4af7bc <+92>:	callq  0x7f1c6f4b6990 <list_delete>
   0x00007f1c6f4af7c1 <+97>:	lea    0xc8(%rbx),%rdi
   0x00007f1c6f4af7c8 <+104>:	callq  0x7f1c6f4b6990 <list_delete>
   0x00007f1c6f4af7cd <+109>:	mov    %rbx,%rdi
   0x00007f1c6f4af7d0 <+112>:	callq  0x7f1c6f4af720 <if_link_params_free>
   0x00007f1c6f4af7d5 <+117>:	mov    0xa8(%rbx),%rsi
   0x00007f1c6f4af7dc <+124>:	mov    0x2e6745(%rip),%rdi        # 0x7f1c6f795f28
   0x00007f1c6f4af7e3 <+131>:	callq  0x7f1c6f4bdbf0 <qfree>
   0x00007f1c6f4af7e8 <+136>:	lea    0x2e8191(%rip),%rdi        # 0x7f1c6f797980
   0x00007f1c6f4af7ef <+143>:	movq   $0x0,0xa8(%rbx)
   0x00007f1c6f4af7fa <+154>:	mov    %rbx,%rsi
   0x00007f1c6f4af7fd <+157>:	callq  0x7f1c6f4bdbf0 <qfree>
   0x00007f1c6f4af802 <+162>:	movq   $0x0,0x0(%r13)
   0x00007f1c6f4af80a <+170>:	add    $0x8,%rsp
   0x00007f1c6f4af80e <+174>:	pop    %rbx
   0x00007f1c6f4af80f <+175>:	pop    %r12
   0x00007f1c6f4af811 <+177>:	pop    %r13
   0x00007f1c6f4af813 <+179>:	pop    %rbp
   0x00007f1c6f4af814 <+180>:	retq   
   0x00007f1c6f4af815 <+181>:	nopl   (%rax)
   0x00007f1c6f4af818 <+184>:	lea    0x78(%r12),%rsi
   0x00007f1c6f4af81d <+189>:	lea    0x2d194c(%rip),%rdi        # 0x7f1c6f781170
   0x00007f1c6f4af824 <+196>:	mov    %rbx,%rdx
   0x00007f1c6f4af827 <+199>:	callq  0x7f1c6f4cc3b0 <_rb_remove>
   0x00007f1c6f4af82c <+204>:	test   %rax,%rax
   0x00007f1c6f4af82f <+207>:	jne    0x7f1c6f4af7ad <if_delete+77>
   0x00007f1c6f4af835 <+213>:	mov    0xe8(%rbx),%r9d
   0x00007f1c6f4af83c <+220>:	mov    0x54(%rbx),%r8d
   0x00007f1c6f4af840 <+224>:	lea    0x6ad31(%rip),%rcx        # 0x7f1c6f51a578
   0x00007f1c6f4af847 <+231>:	lea    0x6a362(%rip),%rsi        # 0x7f1c6f519bb0
   0x00007f1c6f4af84e <+238>:	lea    0x2d108b(%rip),%rdi        # 0x7f1c6f7808e0
   0x00007f1c6f4af855 <+245>:	mov    $0x6000009,%edx
   0x00007f1c6f4af85a <+250>:	callq  0x7f1c6f4ac7e0
   0x00007f1c6f4af85f <+255>:	jmpq   0x7f1c6f4af7ad <if_delete+77>
   0x00007f1c6f4af864 <+260>:	nopl   0x0(%rax)
   0x00007f1c6f4af868 <+264>:	mov    0xe8(%rbx),%r9d
   0x00007f1c6f4af86f <+271>:	lea    0x40(%rbx),%r8
   0x00007f1c6f4af873 <+275>:	lea    0x6acfe(%rip),%rcx        # 0x7f1c6f51a578
   0x00007f1c6f4af87a <+282>:	lea    0x6a2cf(%rip),%rsi        # 0x7f1c6f519b50
   0x00007f1c6f4af881 <+289>:	lea    0x2d1098(%rip),%rdi        # 0x7f1c6f780920
   0x00007f1c6f4af888 <+296>:	mov    $0x6000009,%edx
   0x00007f1c6f4af88d <+301>:	callq  0x7f1c6f4ac7e0
   0x00007f1c6f4af892 <+306>:	jmpq   0x7f1c6f4af7a6 <if_delete+70>
   0x00007f1c6f4af897 <+311>:	lea    0x6acea(%rip),%rcx        # 0x7f1c6f51a588
   0x00007f1c6f4af89e <+318>:	lea    0x69da9(%rip),%rsi        # 0x7f1c6f51964e
   0x00007f1c6f4af8a5 <+325>:	lea    0x82e0b(%rip),%rdi        # 0x7f1c6f5326b7
   0x00007f1c6f4af8ac <+332>:	mov    $0x133,%edx
   0x00007f1c6f4af8b1 <+337>:	callq  0x7f1c6f488768
End of assembler dump.
#12 0x00007f1c6f4af985 in if_terminate () from /usr/lib/x86_64-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_terminate:
   0x00007f1c6f4af910 <+0>:	push   %rbp
   0x00007f1c6f4af911 <+1>:	mov    %rsp,%rbp
   0x00007f1c6f4af914 <+4>:	push   %r13
   0x00007f1c6f4af916 <+6>:	push   %r12
   0x00007f1c6f4af918 <+8>:	push   %rbx
   0x00007f1c6f4af919 <+9>:	sub    $0x18,%rsp
   0x00007f1c6f4af91d <+13>:	mov    %fs:0x28,%rax
   0x00007f1c6f4af926 <+22>:	mov    %rax,-0x28(%rbp)
   0x00007f1c6f4af92a <+26>:	xor    %eax,%eax
   0x00007f1c6f4af92c <+28>:	cmpq   $0x0,0x70(%rdi)
   0x00007f1c6f4af931 <+33>:	je     0x7f1c6f4af98c <if_terminate+124>
   0x00007f1c6f4af933 <+35>:	lea    0x70(%rdi),%r13
   0x00007f1c6f4af937 <+39>:	lea    -0x30(%rbp),%r12
   0x00007f1c6f4af93b <+43>:	mov    %rdi,%rbx
   0x00007f1c6f4af93e <+46>:	xchg   %ax,%ax
   0x00007f1c6f4af940 <+48>:	lea    0x2d1849(%rip),%rdi        # 0x7f1c6f781190
   0x00007f1c6f4af947 <+55>:	mov    %r13,%rsi
   0x00007f1c6f4af94a <+58>:	callq  0x7f1c6f4cd0e0 <_rb_root>
   0x00007f1c6f4af94f <+63>:	mov    0xe0(%rax),%rdi
   0x00007f1c6f4af956 <+70>:	mov    %rax,-0x30(%rbp)
   0x00007f1c6f4af95a <+74>:	test   %rdi,%rdi
   0x00007f1c6f4af95d <+77>:	je     0x7f1c6f4af97d <if_terminate+109>
   0x00007f1c6f4af95f <+79>:	mov    0x50(%rdi),%eax
   0x00007f1c6f4af962 <+82>:	movq   $0x0,0x68(%rdi)
   0x00007f1c6f4af96a <+90>:	test   %eax,%eax
   0x00007f1c6f4af96c <+92>:	je     0x7f1c6f4af9a6 <if_terminate+150>
   0x00007f1c6f4af96e <+94>:	sub    $0x1,%eax
   0x00007f1c6f4af971 <+97>:	test   %eax,%eax
   0x00007f1c6f4af973 <+99>:	mov    %eax,0x50(%rdi)
   0x00007f1c6f4af976 <+102>:	jne    0x7f1c6f4af97d <if_terminate+109>
   0x00007f1c6f4af978 <+104>:	callq  0x7f1c6f4ebff0 <route_node_delete>
   0x00007f1c6f4af97d <+109>:	mov    %r12,%rdi
   0x00007f1c6f4af980 <+112>:	callq  0x7f1c6f4af760 <if_delete>
=> 0x00007f1c6f4af985 <+117>:	cmpq   $0x0,0x70(%rbx)
   0x00007f1c6f4af98a <+122>:	jne    0x7f1c6f4af940 <if_terminate+48>
   0x00007f1c6f4af98c <+124>:	mov    -0x28(%rbp),%rax
   0x00007f1c6f4af990 <+128>:	xor    %fs:0x28,%rax
   0x00007f1c6f4af999 <+137>:	jne    0x7f1c6f4af9c5 <if_terminate+181>
   0x00007f1c6f4af99b <+139>:	add    $0x18,%rsp
   0x00007f1c6f4af99f <+143>:	pop    %rbx
   0x00007f1c6f4af9a0 <+144>:	pop    %r12
   0x00007f1c6f4af9a2 <+146>:	pop    %r13
   0x00007f1c6f4af9a4 <+148>:	pop    %rbp
   0x00007f1c6f4af9a5 <+149>:	retq   
   0x00007f1c6f4af9a6 <+150>:	lea    0x6aa43(%rip),%rcx        # 0x7f1c6f51a3f0
   0x00007f1c6f4af9ad <+157>:	lea    0x6a011(%rip),%rsi        # 0x7f1c6f5199c5
   0x00007f1c6f4af9b4 <+164>:	lea    0x6a016(%rip),%rdi        # 0x7f1c6f5199d1
   0x00007f1c6f4af9bb <+171>:	mov    $0x102,%edx
   0x00007f1c6f4af9c0 <+176>:	callq  0x7f1c6f488768
   0x00007f1c6f4af9c5 <+181>:	callq  0x7f1c6f4886a0
End of assembler dump.

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17943/artifact/TOPOU1604/ErrorLog/log_topotests.txt

Topotests Ubuntu 16.04 i386 part 0: Failed (click for details)

Topology Test Results are at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-TOPOI386-17943/test

Topology Tests failed for Topotests Ubuntu 16.04 i386 part 0:

No function contains program counter for selected frame.
No function contains program counter for selected frame.
No function contains program counter for selected frame.
No function contains program counter for selected frame.

r1: nhrpd crashed. Core file found - Backtrace follows:
[New LWP 3568]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/nhrpd --log file:nhrpd.log --log-level debug -d'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7fcecf5 in ?? ()
  Id   Target Id         Frame 
* 1    Thread 0xb78957c0 (LWP 3568) 0xb7fcecf5 in ?? ()
#0  0xb7fcecf5 in ?? ()
No symbol table info available.
#1  <signal handler called>
No symbol table info available.
#2  0xb7fcecf5 in ?? ()
No symbol table info available.
#3  0x00440ad5 in ?? ()
No symbol table info available.
#4  0xb7ed1536 in if_delete_retain () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#5  0xb7ed3a70 in if_delete () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#6  0xb7ed3c7b in if_terminate () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#7  0xb7f1a5fa in vrf_delete () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#8  0xb7f1a9f6 in vrf_terminate () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#9  0x00441ec3 in ?? ()
No symbol table info available.
#10 0xb7f083a1 in quagga_sigevent_process () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#11 0xb7f1786d in thread_fetch () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#12 0xb7eda2e6 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#13 0x0043cdaa in main ()
No symbol table info available.
#1  <signal handler called>
#2  0xb7fcecf5 in ?? ()
#3  0x00440ad5 in ?? ()
#4  0xb7ed1536 in if_delete_retain () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_delete_retain:
   0xb7ed1500 <+0>:	push   %ebp
   0xb7ed1501 <+1>:	mov    %esp,%ebp
   0xb7ed1503 <+3>:	push   %edi
   0xb7ed1504 <+4>:	push   %esi
   0xb7ed1505 <+5>:	push   %ebx
   0xb7ed1506 <+6>:	call   0xb7eb0640
   0xb7ed150b <+11>:	add    $0xe5505,%ebx
   0xb7ed1511 <+17>:	sub    $0xc,%esp
   0xb7ed1514 <+20>:	mov    0x8(%ebp),%edi
   0xb7ed1517 <+23>:	mov    0x3f4(%ebx),%eax
   0xb7ed151d <+29>:	mov    0x4(%eax),%esi
   0xb7ed1520 <+32>:	test   %esi,%esi
   0xb7ed1522 <+34>:	jne    0xb7ed153f <if_delete_retain+63>
   0xb7ed1524 <+36>:	jmp    0xb7ed155a <if_delete_retain+90>
   0xb7ed1526 <+38>:	lea    0x0(%esi),%esi
   0xb7ed1529 <+41>:	lea    0x0(%edi,%eiz,1),%edi
   0xb7ed1530 <+48>:	sub    $0xc,%esp
   0xb7ed1533 <+51>:	push   %edi
   0xb7ed1534 <+52>:	call   *%eax
=> 0xb7ed1536 <+54>:	mov    (%esi),%esi
   0xb7ed1538 <+56>:	add    $0x10,%esp
   0xb7ed153b <+59>:	test   %esi,%esi
   0xb7ed153d <+61>:	je     0xb7ed155a <if_delete_retain+90>
   0xb7ed153f <+63>:	testb  $0x1,0xc(%esi)
   0xb7ed1543 <+67>:	mov    0x4(%esi),%eax
   0xb7ed1546 <+70>:	je     0xb7ed1530 <if_delete_retain+48>
   0xb7ed1548 <+72>:	sub    $0x8,%esp
   0xb7ed154b <+75>:	push   %edi
   0xb7ed154c <+76>:	pushl  0x8(%esi)
   0xb7ed154f <+79>:	call   *%eax
   0xb7ed1551 <+81>:	mov    (%esi),%esi
   0xb7ed1553 <+83>:	add    $0x10,%esp
   0xb7ed1556 <+86>:	test   %esi,%esi
   0xb7ed1558 <+88>:	jne    0xb7ed153f <if_delete_retain+63>
   0xb7ed155a <+90>:	lea    0xa8(%edi),%eax
   0xb7ed1560 <+96>:	sub    $0xc,%esp
   0xb7ed1563 <+99>:	push   %eax
   0xb7ed1564 <+100>:	call   0xb7efa710 <qobj_unreg>
   0xb7ed1569 <+105>:	pop    %eax
   0xb7ed156a <+106>:	pushl  0x8c(%edi)
   0xb7ed1570 <+112>:	call   0xb7edae00 <list_delete_all_node>
   0xb7ed1575 <+117>:	pop    %edx
   0xb7ed1576 <+118>:	pushl  0x90(%edi)
   0xb7ed157c <+124>:	call   0xb7edae00 <list_delete_all_node>
   0xb7ed1581 <+129>:	lea    -0xc(%ebp),%esp
   0xb7ed1584 <+132>:	pop    %ebx
   0xb7ed1585 <+133>:	pop    %esi
   0xb7ed1586 <+134>:	pop    %edi
   0xb7ed1587 <+135>:	pop    %ebp
   0xb7ed1588 <+136>:	ret    
End of assembler dump.
#5  0xb7ed3a70 in if_delete () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_delete:
   0xb7ed3a10 <+0>:	push   %ebp
   0xb7ed3a11 <+1>:	mov    %esp,%ebp
   0xb7ed3a13 <+3>:	push   %edi
   0xb7ed3a14 <+4>:	push   %esi
   0xb7ed3a15 <+5>:	push   %ebx
   0xb7ed3a16 <+6>:	call   0xb7eb0640
   0xb7ed3a1b <+11>:	add    $0xe2ff5,%ebx
   0xb7ed3a21 <+17>:	sub    $0x18,%esp
   0xb7ed3a24 <+20>:	mov    0x8(%ebp),%eax
   0xb7ed3a27 <+23>:	mov    (%eax),%esi
   0xb7ed3a29 <+25>:	pushl  0xa0(%esi)
   0xb7ed3a2f <+31>:	call   0xb7f1a290 <vrf_lookup_by_id>
   0xb7ed3a34 <+36>:	add    $0x10,%esp
   0xb7ed3a37 <+39>:	test   %eax,%eax
   0xb7ed3a39 <+41>:	je     0xb7ed3b64 <if_delete+340>
   0xb7ed3a3f <+47>:	mov    %eax,%edi
   0xb7ed3a41 <+49>:	lea    0x4c(%eax),%eax
   0xb7ed3a44 <+52>:	sub    $0x4,%esp
   0xb7ed3a47 <+55>:	push   %esi
   0xb7ed3a48 <+56>:	push   %eax
   0xb7ed3a49 <+57>:	lea    -0xf110(%ebx),%eax
   0xb7ed3a4f <+63>:	push   %eax
   0xb7ed3a50 <+64>:	call   0xb7ef1ad0 <_rb_remove>
   0xb7ed3a55 <+69>:	add    $0x10,%esp
   0xb7ed3a58 <+72>:	test   %eax,%eax
   0xb7ed3a5a <+74>:	je     0xb7ed3b30 <if_delete+288>
   0xb7ed3a60 <+80>:	mov    0x34(%esi),%eax
   0xb7ed3a63 <+83>:	test   %eax,%eax
   0xb7ed3a65 <+85>:	jne    0xb7ed3ad8 <if_delete+200>
   0xb7ed3a67 <+87>:	sub    $0xc,%esp
   0xb7ed3a6a <+90>:	push   %esi
   0xb7ed3a6b <+91>:	call   0xb7ed1500 <if_delete_retain>
=> 0xb7ed3a70 <+96>:	lea    0x8c(%esi),%eax
   0xb7ed3a76 <+102>:	mov    %eax,(%esp)
   0xb7ed3a79 <+105>:	call   0xb7edaeb0 <list_delete>
   0xb7ed3a7e <+110>:	lea    0x90(%esi),%eax
   0xb7ed3a84 <+116>:	mov    %eax,(%esp)
   0xb7ed3a87 <+119>:	call   0xb7edaeb0 <list_delete>
   0xb7ed3a8c <+124>:	mov    %esi,(%esp)
   0xb7ed3a8f <+127>:	call   0xb7ed39d0 <if_link_params_free>
   0xb7ed3a94 <+132>:	pop    %eax
   0xb7ed3a95 <+133>:	pop    %edx
   0xb7ed3a96 <+134>:	pushl  0x80(%esi)
   0xb7ed3a9c <+140>:	pushl  0x590(%ebx)
   0xb7ed3aa2 <+146>:	call   0xb7ee26d0 <qfree>
   0xb7ed3aa7 <+151>:	movl   $0x0,0x80(%esi)
   0xb7ed3ab1 <+161>:	lea    0x1450(%ebx),%eax
   0xb7ed3ab7 <+167>:	pop    %ecx
   0xb7ed3ab8 <+168>:	pop    %edi
   0xb7ed3ab9 <+169>:	push   %esi
   0xb7ed3aba <+170>:	push   %eax
   0xb7ed3abb <+171>:	call   0xb7ee26d0 <qfree>
   0xb7ed3ac0 <+176>:	mov    0x8(%ebp),%eax
   0xb7ed3ac3 <+179>:	add    $0x10,%esp
   0xb7ed3ac6 <+182>:	movl   $0x0,(%eax)
   0xb7ed3acc <+188>:	lea    -0xc(%ebp),%esp
   0xb7ed3acf <+191>:	pop    %ebx
   0xb7ed3ad0 <+192>:	pop    %esi
   0xb7ed3ad1 <+193>:	pop    %edi
   0xb7ed3ad2 <+194>:	pop    %ebp
   0xb7ed3ad3 <+195>:	ret    
   0xb7ed3ad4 <+196>:	lea    0x0(%esi,%eiz,1),%esi
   0xb7ed3ad8 <+200>:	lea    0x50(%edi),%edx
   0xb7ed3adb <+203>:	lea    -0xf120(%ebx),%eax
   0xb7ed3ae1 <+209>:	sub    $0x4,%esp
   0xb7ed3ae4 <+212>:	push   %esi
   0xb7ed3ae5 <+213>:	push   %edx
   0xb7ed3ae6 <+214>:	push   %eax
   0xb7ed3ae7 <+215>:	call   0xb7ef1ad0 <_rb_remove>
   0xb7ed3aec <+220>:	add    $0x10,%esp
   0xb7ed3aef <+223>:	test   %eax,%eax
   0xb7ed3af1 <+225>:	jne    0xb7ed3a67 <if_delete+87>
   0xb7ed3af7 <+231>:	lea    -0x76000(%ebx),%eax
   0xb7ed3afd <+237>:	sub    $0x8,%esp
   0xb7ed3b00 <+240>:	pushl  0xa0(%esi)
   0xb7ed3b06 <+246>:	pushl  0x34(%esi)
   0xb7ed3b09 <+249>:	push   %eax
   0xb7ed3b0a <+250>:	lea    -0x76914(%ebx),%eax
   0xb7ed3b10 <+256>:	push   $0x6000009
   0xb7ed3b15 <+261>:	push   %eax
   0xb7ed3b16 <+262>:	lea    -0xf650(%ebx),%eax
   0xb7ed3b1c <+268>:	push   %eax
   0xb7ed3b1d <+269>:	call   0xb7ed0650
   0xb7ed3b22 <+274>:	add    $0x20,%esp
   0xb7ed3b25 <+277>:	jmp    0xb7ed3a67 <if_delete+87>
   0xb7ed3b2a <+282>:	lea    0x0(%esi),%esi
   0xb7ed3b30 <+288>:	lea    0x20(%esi),%eax
   0xb7ed3b33 <+291>:	sub    $0x8,%esp
   0xb7ed3b36 <+294>:	pushl  0xa0(%esi)
   0xb7ed3b3c <+300>:	push   %eax
   0xb7ed3b3d <+301>:	lea    -0x76000(%ebx),%eax
   0xb7ed3b43 <+307>:	push   %eax
   0xb7ed3b44 <+308>:	lea    -0x76970(%ebx),%eax
   0xb7ed3b4a <+314>:	push   $0x6000009
   0xb7ed3b4f <+319>:	push   %eax
   0xb7ed3b50 <+320>:	lea    -0xf610(%ebx),%eax
   0xb7ed3b56 <+326>:	push   %eax
   0xb7ed3b57 <+327>:	call   0xb7ed0650
   0xb7ed3b5c <+332>:	add    $0x20,%esp
   0xb7ed3b5f <+335>:	jmp    0xb7ed3a60 <if_delete+80>
   0xb7ed3b64 <+340>:	lea    -0x75ff4(%ebx),%eax
   0xb7ed3b6a <+346>:	push   %eax
   0xb7ed3b6b <+347>:	lea    -0x76e6a(%ebx),%eax
   0xb7ed3b71 <+353>:	push   $0x133
   0xb7ed3b76 <+358>:	push   %eax
   0xb7ed3b77 <+359>:	lea    -0x5ecfd(%ebx),%eax
   0xb7ed3b7d <+365>:	push   %eax
   0xb7ed3b7e <+366>:	call   0xb7eabe58
End of assembler dump.
No function contains program counter for selected frame.
No function contains program counter for selected frame.
No function contains program counter for selected frame.
No function contains program counter for selected frame.

r2: nhrpd crashed. Core file found - Backtrace follows:
[New LWP 3638]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/i386-linux-gnu/libthread_db.so.1".
Core was generated by `/usr/lib/frr/nhrpd --log file:nhrpd.log --log-level debug -d'.
Program terminated with signal SIGABRT, Aborted.
#0  0xb7edbcf5 in ?? ()
  Id   Target Id         Frame 
* 1    Thread 0xb77a27c0 (LWP 3638) 0xb7edbcf5 in ?? ()
#0  0xb7edbcf5 in ?? ()
No symbol table info available.
#1  <signal handler called>
No symbol table info available.
#2  0xb7edbcf5 in ?? ()
No symbol table info available.
#3  0x0048cad5 in ?? ()
No symbol table info available.
#4  0xb7dde536 in if_delete_retain () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#5  0xb7de0a70 in if_delete () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#6  0xb7de0c7b in if_terminate () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#7  0xb7e275fa in vrf_delete () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#8  0xb7e279f6 in vrf_terminate () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#9  0x0048dec3 in ?? ()
No symbol table info available.
#10 0xb7e153a1 in quagga_sigevent_process () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#11 0xb7e2486d in thread_fetch () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#12 0xb7de72e6 in frr_run () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
No symbol table info available.
#13 0x00488daa in main ()
No symbol table info available.
#1  <signal handler called>
#2  0xb7edbcf5 in ?? ()
#3  0x0048cad5 in ?? ()
#4  0xb7dde536 in if_delete_retain () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_delete_retain:
   0xb7dde500 <+0>:	push   %ebp
   0xb7dde501 <+1>:	mov    %esp,%ebp
   0xb7dde503 <+3>:	push   %edi
   0xb7dde504 <+4>:	push   %esi
   0xb7dde505 <+5>:	push   %ebx
   0xb7dde506 <+6>:	call   0xb7dbd640
   0xb7dde50b <+11>:	add    $0xe5505,%ebx
   0xb7dde511 <+17>:	sub    $0xc,%esp
   0xb7dde514 <+20>:	mov    0x8(%ebp),%edi
   0xb7dde517 <+23>:	mov    0x3f4(%ebx),%eax
   0xb7dde51d <+29>:	mov    0x4(%eax),%esi
   0xb7dde520 <+32>:	test   %esi,%esi
   0xb7dde522 <+34>:	jne    0xb7dde53f <if_delete_retain+63>
   0xb7dde524 <+36>:	jmp    0xb7dde55a <if_delete_retain+90>
   0xb7dde526 <+38>:	lea    0x0(%esi),%esi
   0xb7dde529 <+41>:	lea    0x0(%edi,%eiz,1),%edi
   0xb7dde530 <+48>:	sub    $0xc,%esp
   0xb7dde533 <+51>:	push   %edi
   0xb7dde534 <+52>:	call   *%eax
=> 0xb7dde536 <+54>:	mov    (%esi),%esi
   0xb7dde538 <+56>:	add    $0x10,%esp
   0xb7dde53b <+59>:	test   %esi,%esi
   0xb7dde53d <+61>:	je     0xb7dde55a <if_delete_retain+90>
   0xb7dde53f <+63>:	testb  $0x1,0xc(%esi)
   0xb7dde543 <+67>:	mov    0x4(%esi),%eax
   0xb7dde546 <+70>:	je     0xb7dde530 <if_delete_retain+48>
   0xb7dde548 <+72>:	sub    $0x8,%esp
   0xb7dde54b <+75>:	push   %edi
   0xb7dde54c <+76>:	pushl  0x8(%esi)
   0xb7dde54f <+79>:	call   *%eax
   0xb7dde551 <+81>:	mov    (%esi),%esi
   0xb7dde553 <+83>:	add    $0x10,%esp
   0xb7dde556 <+86>:	test   %esi,%esi
   0xb7dde558 <+88>:	jne    0xb7dde53f <if_delete_retain+63>
   0xb7dde55a <+90>:	lea    0xa8(%edi),%eax
   0xb7dde560 <+96>:	sub    $0xc,%esp
   0xb7dde563 <+99>:	push   %eax
   0xb7dde564 <+100>:	call   0xb7e07710 <qobj_unreg>
   0xb7dde569 <+105>:	pop    %eax
   0xb7dde56a <+106>:	pushl  0x8c(%edi)
   0xb7dde570 <+112>:	call   0xb7de7e00 <list_delete_all_node>
   0xb7dde575 <+117>:	pop    %edx
   0xb7dde576 <+118>:	pushl  0x90(%edi)
   0xb7dde57c <+124>:	call   0xb7de7e00 <list_delete_all_node>
   0xb7dde581 <+129>:	lea    -0xc(%ebp),%esp
   0xb7dde584 <+132>:	pop    %ebx
   0xb7dde585 <+133>:	pop    %esi
   0xb7dde586 <+134>:	pop    %edi
   0xb7dde587 <+135>:	pop    %ebp
   0xb7dde588 <+136>:	ret    
End of assembler dump.
#5  0xb7de0a70 in if_delete () from /usr/lib/i386-linux-gnu/frr/libfrr.so.0
Dump of assembler code for function if_delete:
   0xb7de0a10 <+0>:	push   %ebp
   0xb7de0a11 <+1>:	mov    %esp,%ebp
   0xb7de0a13 <+3>:	push   %edi
   0xb7de0a14 <+4>:	push   %esi
   0xb7de0a15 <+5>:	push   %ebx
   0xb7de0a16 <+6>:	call   0xb7dbd640
   0xb7de0a1b <+11>:	add    $0xe2ff5,%ebx
   0xb7de0a21 <+17>:	sub    $0x18,%esp
   0xb7de0a24 <+20>:	mov    0x8(%ebp),%eax
   0xb7de0a27 <+23>:	mov    (%eax),%esi
   0xb7de0a29 <+25>:	pushl  0xa0(%esi)
   0xb7de0a2f <+31>:	call   0xb7e27290 <vrf_lookup_by_id>
   0xb7de0a34 <+36>:	add    $0x10,%esp
   0xb7de0a37 <+39>:	test   %eax,%eax
   0xb7de0a39 <+41>:	je     0xb7de0b64 <if_delete+340>
   0xb7de0a3f <+47>:	mov    %eax,%edi
   0xb7de0a41 <+49>:	lea    0x4c(%eax),%eax
   0xb7de0a44 <+52>:	sub    $0x4,%esp
   0xb7de0a47 <+55>:	push   %esi
   0xb7de0a48 <+56>:	push   %eax
   0xb7de0a49 <+57>:	lea    -0xf110(%ebx),%eax
   0xb7de0a4f <+63>:	push   %eax
   0xb7de0a50 <+64>:	call   0xb7dfead0 <_rb_remove>
   0xb7de0a55 <+69>:	add    $0x10,%esp
   0xb7de0a58 <+72>:	test   %eax,%eax
   0xb7de0a5a <+74>:	je     0xb7de0b30 <if_delete+288>
   0xb7de0a60 <+80>:	mov    0x34(%esi),%eax
   0xb7de0a63 <+83>:	test   %eax,%eax
   0xb7de0a65 <+85>:	jne    0xb7de0ad8 <if_delete+200>
   0xb7de0a67 <+87>:	sub    $0xc,%esp
   0xb7de0a6a <+90>:	push   %esi
   0xb7de0a6b <+91>:	call   0xb7dde500 <if_delete_retain>
=> 0xb7de0a70 <+96>:	lea    0x8c(%esi),%eax
   0xb7de0a76 <+102>:	mov    %eax,(%esp)
   0xb7de0a79 <+105>:	call   0xb7de7eb0 <list_delete>
   0xb7de0a7e <+110>:	lea    0x90(%esi),%eax
   0xb7de0a84 <+116>:	mov    %eax,(%esp)
   0xb7de0a87 <+119>:	call   0xb7de7eb0 <list_delete>
   0xb7de0a8c <+124>:	mov    %esi,(%esp)
   0xb7de0a8f <+127>:	call   0xb7de09d0 <if_link_params_free>
   0xb7de0a94 <+132>:	pop    %eax
   0xb7de0a95 <+133>:	pop    %edx
   0xb7de0a96 <+134>:	pushl  0x80(%esi)
   0xb7de0a9c <+140>:	pushl  0x590(%ebx)
   0xb7de0aa2 <+146>:	call   0xb7def6d0 <qfree>
   0xb7de0aa7 <+151>:	movl   $0x0,0x80(%esi)
   0xb7de0ab1 <+161>:	lea    0x1450(%ebx),%eax
   0xb7de0ab7 <+167>:	pop    %ecx
   0xb7de0ab8 <+168>:	pop    %edi
   0xb7de0ab9 <+169>:	push   %esi
   0xb7de0aba <+170>:	push   %eax
   0xb7de0abb <+171>:	call   0xb7def6d0 <qfree>
   0xb7de0ac0 <+176>:	mov    0x8(%ebp),%eax
   0xb7de0ac3 <+179>:	add    $0x10,%esp
   0xb7de0ac6 <+182>:	movl   $0x0,(%eax)
   0xb7de0acc <+188>:	lea    -0xc(%ebp),%esp
   0xb7de0acf <+191>:	pop    %ebx
   0xb7de0ad0 <+192>:	pop    %esi
   0xb7de0ad1 <+193>:	pop    %edi
   0xb7de0ad2 <+194>:	pop    %ebp
   0xb7de0ad3 <+195>:	ret    
   0xb7de0ad4 <+196>:	lea    0x0(%esi,%eiz,1),%esi
   0xb7de0ad8 <+200>:	lea    0x50(%edi),%edx
   0xb7de0adb <+203>:	lea    -0xf120(%ebx),%eax
   0xb7de0ae1 <+209>:	sub    $0x4,%esp
   0xb7de0ae4 <+212>:	push   %esi
   0xb7de0ae5 <+213>:	push   %edx
   0xb7de0ae6 <+214>:	push   %eax
   0xb7de0ae7 <+215>:	call   0xb7dfead0 <_rb_remove>
   0xb7de0aec <+220>:	add    $0x10,%esp
   0xb7de0aef <+223>:	test   %eax,%eax
   0xb7de0af1 <+225>:	jne    0xb7de0a67 <if_delete+87>
   0xb7de0af7 <+231>:	lea    -0x76000(%ebx),%eax
   0xb7de0afd <+237>:	sub    $0x8,%esp
   0xb7de0b00 <+240>:	pushl  0xa0(%esi)
   0xb7de0b06 <+246>:	pushl  0x34(%esi)
   0xb7de0b09 <+249>:	push   %eax
   0xb7de0b0a <+250>:	lea    -0x76914(%ebx),%eax
   0xb7de0b10 <+256>:	push   $0x6000009
   0xb7de0b15 <+261>:	push   %eax
   0xb7de0b16 <+262>:	lea    -0xf650(%ebx),%eax
   0xb7de0b1c <+268>:	push   %eax
   0xb7de0b1d <+269>:	call   0xb7ddd650
   0xb7de0b22 <+274>:	add    $0x20,%esp
   0xb7de0b25 <+277>:	jmp    0xb7de0a67 <if_delete+87>
   0xb7de0b2a <+282>:	lea    0x0(%esi),%esi
   0xb7de0b30 <+288>:	lea    0x20(%esi),%eax
   0xb7de0b33 <+291>:	sub    $0x8,%esp
   0xb7de0b36 <+294>:	pushl  0xa0(%esi)
   0xb7de0b3c <+300>:	push   %eax
   0xb7de0b3d <+301>:	lea    -0x76000(%ebx),%eax
   0xb7de0b43 <+307>:	push   %eax
   0xb7de0b44 <+308>:	lea    -0x76970(%ebx),%eax
   0xb7de0b4a <+314>:	push   $0x6000009
   0xb7de0b4f <+319>:	push   %eax
   0xb7de0b50 <+320>:	lea    -0xf610(%ebx),%eax
   0xb7de0b56 <+326>:	push   %eax
   0xb7de0b57 <+327>:	call   0xb7ddd650
   0xb7de0b5c <+332>:	add    $0x20,%esp
   0xb7de0b5f <+335>:	jmp    0xb7de0a60 <if_delete+80>
   0xb7de0b64 <+340>:	lea    -0x75ff4(%ebx),%eax
   0xb7de0b6a <+346>:	push   %eax
   0xb7de0b6b <+347>:	lea    -0x76e6a(%ebx),%eax
   0xb7de0b71 <+353>:	push   $0x133
   0xb7de0b76 <+358>:	push   %eax
   0xb7de0b77 <+359>:	lea    -0x5ecfd(%ebx),%eax
   0xb7de0b7d <+365>:	push   %eax
   0xb7de0b7e <+366>:	call   0xb7db8e58
End of assembler dump.

see full log at https://ci1.netdef.org/browse/FRR-FRRPULLREQ-17943/artifact/TOPOI386/ErrorLog/log_topotests.txt

<stdin>:958: space before tab in indent.
		    	       != AF_UNSPEC)
<stdin>:1527: trailing whitespace.
        
warning: 2 lines add whitespace errors.
Report for nhrp_peer.c | 6 issues
===============================================
< WARNING: line over 80 characters
< #1028: FILE: /tmp/f1-26990/nhrp_peer.c:1028:
< WARNING: line over 80 characters
< #1043: FILE: /tmp/f1-26990/nhrp_peer.c:1043:
< WARNING: Too many leading tabs - consider code refactoring
< #1045: FILE: /tmp/f1-26990/nhrp_peer.c:1045:
Report for nhrp_vty.c | 6 issues
===============================================
< ERROR: else should follow close brace '}'
< #655: FILE: /tmp/f1-26990/nhrp_vty.c:655:
< ERROR: code indent should use tabs where possible
< #672: FILE: /tmp/f1-26990/nhrp_vty.c:672:
< WARNING: please, no space before tabs
< #672: FILE: /tmp/f1-26990/nhrp_vty.c:672:

pguibert6WIND · 2021-03-26T08:29:11Z

I have an other remark on some more changes about debug display message and formatting.
Do you mind if you can apply below changes to your branch, please?

From 1334477ce2bc4cfa4689585cea24ab32ed94845b Mon Sep 17 00:00:00 2001
From: Philippe Guibert <philippe.guibert@6wind.com>
Date: Fri, 26 Mar 2021 09:14:25 +0100
Subject: [PATCH] bulk

---
 nhrpd/nhrp_peer.c     | 10 ++++------
 nhrpd/nhrp_shortcut.c |  4 ++--
 nhrpd/nhrp_vty.c      |  2 +-
 3 files changed, 7 insertions(+), 9 deletions(-)

diff --git a/nhrpd/nhrp_peer.c b/nhrpd/nhrp_peer.c
index 50de251b55a3..2819a6632fcb 100644
--- a/nhrpd/nhrp_peer.c
+++ b/nhrpd/nhrp_peer.c
@@ -412,7 +412,7 @@ static void nhrp_process_nat_extension(struct nhrp_packet_parser *pp,
 				 * since it is behind a NAT device
 				 */
 				debugf(NHRP_DEBUG_COMMON,
-				       "Processing NAT Extension for %pSU",
+				       "shortcut res_resp: Processing NAT Extension for %pSU",
 				       proto);
 				while (nhrp_cie_pull(&payload, pp->hdr,
 						     cie_nbma, &cie_proto)) {
@@ -422,7 +422,7 @@ static void nhrp_process_nat_extension(struct nhrp_packet_parser *pp,
 
 					if (!sockunion_cmp(proto, &cie_proto)) {
 						debugf(NHRP_DEBUG_COMMON,
-						       "cie_nbma for proto %pSU is %pSU",
+						       "\tcie_nbma for proto %pSU is %pSU",
 						       proto, cie_nbma);
 						break;
 					}
@@ -507,18 +507,16 @@ static void nhrp_handle_resolution_req(struct nhrp_packet_parser *pp)
 			 * coming directly from NATTED Spoke and there is not
 			 * NAT Extension present
 			 */
-			debugf(NHRP_DEBUG_COMMON, "No NAT Extension for %pSU",
+			debugf(NHRP_DEBUG_COMMON, "shortcut res_rep: No NAT Extension for %pSU",
 			       proto_addr);
 
 			if (!sockunion_same(&pp->src_nbma,
 					    &pp->peer->vc->remote.nbma)
 			    && !nhrp_nhs_match_ip(&pp->peer->vc->remote.nbma,
 						  nifp)) {
-				debugf(NHRP_DEBUG_COMMON,
-				       "Remote Device is NATTED");
 				cie_nbma_nat = pp->peer->vc->remote.nbma;
 				debugf(NHRP_DEBUG_COMMON,
-				       "Device is natted using %pSU as cie_nbma",
+				       "shortcut res_rep: NAT detected using %pSU as cie_nbma",
 				       &cie_nbma_nat);
 			}
 		}
diff --git a/nhrpd/nhrp_shortcut.c b/nhrpd/nhrp_shortcut.c
index dfa2fe633352..8ca217e5ffba 100644
--- a/nhrpd/nhrp_shortcut.c
+++ b/nhrpd/nhrp_shortcut.c
@@ -301,7 +301,7 @@ static void nhrp_shortcut_recv_resolution_rep(struct nhrp_reqid *reqid,
 	/* Update cache entry for the protocol to nbma binding */
 	if (sockunion_family(&nat_nbma) != AF_UNSPEC) {
 		debugf(NHRP_DEBUG_COMMON,
-		       "Remote Device is NATed (NAT extension) proto %pSU NBMA %pSU claimed-NBMA %pSU",
+		       "Shortcut: NAT detected (NAT extension) proto %pSU NBMA %pSU claimed-NBMA %pSU",
 		       proto, &nat_nbma, &cie_nbma);
 		nbma = &nat_nbma;
 	}
@@ -311,7 +311,7 @@ static void nhrp_shortcut_recv_resolution_rep(struct nhrp_reqid *reqid,
 	else if (!sockunion_same(&cie_nbma, &pp->peer->vc->remote.nbma)
 		 && !nhrp_nhs_match_ip(&pp->peer->vc->remote.nbma, nifp)) {
 		debugf(NHRP_DEBUG_COMMON,
-		       "Remote Device is NATed (no NAT Extension) proto %pSU NBMA %pSU claimed-NBMA %pSU",
+		       "Shortcut: NAT detected (no NAT Extension) proto %pSU NBMA %pSU claimed-NBMA %pSU",
 		       proto, &pp->peer->vc->remote.nbma, &cie_nbma);
 		nbma = &pp->peer->vc->remote.nbma;
 		nat_nbma = *nbma;
diff --git a/nhrpd/nhrp_vty.c b/nhrpd/nhrp_vty.c
index a634d2df156d..b91c97f3b6b2 100644
--- a/nhrpd/nhrp_vty.c
+++ b/nhrpd/nhrp_vty.c
@@ -669,7 +669,7 @@ static void show_ip_nhrp_cache(struct nhrp_cache *c, void *pctx)
 
 		if (c->cur.peer
 		    && sockunion_family(&c->cur.remote_nbma_claimed)
-		    	       != AF_UNSPEC)
+		    != AF_UNSPEC)
 			sockunion2str(&c->cur.remote_nbma_claimed,
 				      buf[2], sizeof(buf[2]));
 		else
-- 
2.29.2

amollad · 2021-03-26T08:45:10Z

I have an other remark on some more changes about debug display message and formatting.
Do you mind if you can apply below changes to your branch, please?

this should be ok, I believe. @reubendowle will push the changes

reubendowle · 2021-03-26T21:01:00Z

I have an other remark on some more changes about debug display message and formatting.
Do you mind if you can apply below changes to your branch, please?

@pguibert6WIND Please go ahead and push that change

reubendowle · 2021-03-26T22:00:48Z

@pguibert6WIND the topotest that I pulled in is causing issues. Firstly it seems to be failing with "EnvironmentError: you must run pytest with '-s' in order to use mininet CLI".

Secondly it is triggering a crash. There is a bug where nhrpd crashes when an interface is deleted. This is a long standing issue, and I fixed a lot of the issues with ee72f0a but it looks like there are still some issues remaining. I don't have the time right now to chase this down, and I don't feel it is related to this pull request as such. I think the topotest could be made to work by deleting the nhrp configuration elements before the interface is removed. But again I don't have the time to look into it. So if you are ok, I will remove the topotest from this pull request.

pguibert6WIND · 2021-03-27T09:02:58Z

From my perspective, I agree to postpone the following changes:

ability to send resolution reply directly to remote spoke instead of using the hub

For the topotest crash, a similar topotest ran ok in #8145. I did not test it on upstream master. I will create a separate pr for the topotest test to see if it fails. If it fails, the problem is unrelated to nat changes.

For the formatting changes proposed, the code is straighforward and should not need additional testing.
So please take into account the changes.

pguibert6WIND · 2021-03-28T20:15:18Z

From my perspective, I agree to postpone the following changes:

ability to send resolution reply directly to remote spoke instead of using the hub

For the topotest crash, a similar topotest ran ok in #8145. I did not test it on upstream master. I will create a separate pr for the topotest test to see if it fails. If it fails, the problem is unrelated to nat changes.

#8354 fails with current code, but not with 8145
OK to remove test from this pull request.

For the formatting changes proposed, the code is straighforward and should not need additional testing.
So please take into account the change
just handle this point, please

Signed-off-by: Reuben Dowle <reuben.dowle@4rf.com>

LabN-CI · 2021-03-28T22:10:26Z

💚 Basic BGPD CI results: SUCCESS, 0 tests failed

Results table

_	_
Result	SUCCESS git merge/8240 `0551aea`
Date	03/28/2021
Start	17:30:44
Finish	18:10:23
Run-Time	39:39
Total	1815
Pass	1815
Fail	0
Valgrind-Errors	0
Valgrind-Loss	0
Details	vncregress-2021-03-28-17:30:44.txt
Log	autoscript-2021-03-28-17:31:53.log.bz2
Memory	476 500 431

For details, please contact louberger

NetDEF-CI · 2021-03-29T00:32:06Z

Continuous Integration Result: SUCCESSFUL

Congratulations, this patch passed basic tests

Tested-by: NetDEF / OpenSourceRouting.org CI System

CI System Testrun URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-18041/

This is a comment from an automated CI system.
For questions and feedback in regards to this CI system, please feel free to email
Martin Winter - mwinter (at) opensourcerouting.org.

Warnings Generated during build:

Checkout code: Successful with additional warnings

Report for nhrp_peer.c | 8 issues
===============================================
< WARNING: line over 80 characters
< #510: FILE: /tmp/f1-1864/nhrp_peer.c:510:
< WARNING: line over 80 characters
< #1026: FILE: /tmp/f1-1864/nhrp_peer.c:1026:
< WARNING: line over 80 characters
< #1041: FILE: /tmp/f1-1864/nhrp_peer.c:1041:
< WARNING: Too many leading tabs - consider code refactoring
< #1043: FILE: /tmp/f1-1864/nhrp_peer.c:1043:
Report for nhrp_vty.c | 2 issues
===============================================
< ERROR: else should follow close brace '}'
< #655: FILE: /tmp/f1-1864/nhrp_vty.c:655:

pguibert6WIND

LGTM

Jafaral · 2021-03-30T19:58:58Z

@reubendowle , can you take care of the remaining style warnings please ? I see a few long lines and an if missing mandatory braces still. Other than that this should be good to go.

Also cleanup some minor style issues Signed-off-by: Reuben Dowle <reuben.dowle@4rf.com>

polychaeta

Thanks for your contribution to FRR!

One of your commits has a missing or badly formatted Signed-off-by line; we can't accept your contribution until all of your commits have one
One of your commits does not have a blank line between the summary and body; this will break git log --oneline

If you are a new contributor to FRR, please see our contributing guidelines.

After making changes, you do not need to create a new PR. You should perform an amend or interactive rebase followed by a force push.

Signed-off-by: Reuben Dowle <reuben.dowle@4rf.com>

LabN-CI · 2021-04-01T01:52:23Z

💚 Basic BGPD CI results: SUCCESS, 0 tests failed

Results table

_	_
Result	SUCCESS git merge/8240 `73c7bf9`
Date	03/31/2021
Start	21:10:44
Finish	21:52:19
Run-Time	41:35
Total	1815
Pass	1815
Fail	0
Valgrind-Errors	0
Valgrind-Loss	0
Details	vncregress-2021-03-31-21:10:44.txt
Log	autoscript-2021-03-31-21:11:50.log.bz2
Memory	477 501 408

For details, please contact louberger

blocking comments addressed

LabN-CI · 2021-04-01T03:19:46Z

💚 Basic BGPD CI results: SUCCESS, 0 tests failed

Results table

_	_
Result	0
Date	0
Start	0
Finish	vncregress-2021-03-31-22:37:55.txt
Run-Time	autoscript-2021-03-31-22:39:03.log.bz2
Total	488 487 429
Pass	Complete
Fail	01/08/2021
Valgrind-Errors	22:37:55
Valgrind-Loss	23:11:35
Details	33:40
Log	1815
Memory	1815
SUCCESS git merge/8240 `ba113ac`	0
03/31/2021	0
22:37:55	0
23:19:42	autoscript-2021-01-08-22:37:55.txt
41:47	autoscript-2021-01-08-22:37:55.log.bz2
1815	502 505 425
1815

For details, please contact louberger

NetDEF-CI · 2021-04-01T06:05:48Z

Continuous Integration Result: SUCCESSFUL

Congratulations, this patch passed basic tests

Tested-by: NetDEF / OpenSourceRouting.org CI System

CI System Testrun URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-18128/

This is a comment from an automated CI system.
For questions and feedback in regards to this CI system, please feel free to email
Martin Winter - mwinter (at) opensourcerouting.org.

NetDEF-CI · 2021-04-01T07:15:47Z

Continuous Integration Result: SUCCESSFUL

Congratulations, this patch passed basic tests

Tested-by: NetDEF / OpenSourceRouting.org CI System

CI System Testrun URL: https://ci1.netdef.org/browse/FRR-FRRPULLREQ-18132/

This is a comment from an automated CI system.
For questions and feedback in regards to this CI system, please feel free to email
Martin Winter - mwinter (at) opensourcerouting.org.

polychaeta added the nhrp label Mar 12, 2021

Jafaral reviewed Mar 12, 2021

View reviewed changes

nhrpd/zbuf.c Outdated Show resolved Hide resolved

Jafaral reviewed Mar 12, 2021

View reviewed changes

nhrpd/nhrp_peer.c Outdated Show resolved Hide resolved

Jafaral reviewed Mar 12, 2021

View reviewed changes

nhrpd/nhrp_peer.c Outdated Show resolved Hide resolved

Jafaral reviewed Mar 12, 2021

View reviewed changes

nhrpd/nhrp_peer.c Outdated Show resolved Hide resolved

Jafaral reviewed Mar 12, 2021

View reviewed changes

nhrpd/nhrp_shortcut.c Outdated Show resolved Hide resolved

Jafaral reviewed Mar 12, 2021

View reviewed changes

nhrpd/nhrp_peer.c Outdated Show resolved Hide resolved

Jafaral reviewed Mar 12, 2021

View reviewed changes

nhrpd/nhrp_peer.c Outdated Show resolved Hide resolved

pguibert6WIND reviewed Mar 12, 2021

View reviewed changes

nhrpd/nhrp_peer.c Show resolved Hide resolved

nhrpd/zbuf.c Outdated Show resolved Hide resolved

pguibert6WIND requested changes Mar 12, 2021

View reviewed changes

reubendowle force-pushed the fixes/nhrp-nat branch from 9e3a806 to f0475ee Compare March 14, 2021 22:07

reubendowle force-pushed the fixes/nhrp-nat branch from f0475ee to acff149 Compare March 14, 2021 22:40

reubendowle force-pushed the fixes/nhrp-nat branch 2 times, most recently from 224b9e5 to 7a4fbcb Compare March 15, 2021 04:25

reubendowle force-pushed the fixes/nhrp-nat branch from 7a4fbcb to 4195ee7 Compare March 15, 2021 23:45

Jafaral mentioned this pull request Mar 16, 2021

Spoke and HUB couldn't communicate if Spoke behind NAT even that IPSEC established #8236

Closed

reubendowle force-pushed the fixes/nhrp-nat branch from 4195ee7 to b9c1deb Compare March 17, 2021 03:53

donaldsharp mentioned this pull request Mar 23, 2021

NHRP not stable if multiple spoke behind same NAT #8308

Closed

reubendowle force-pushed the fixes/nhrp-nat branch from 40ea16d to 925794e Compare March 24, 2021 03:27

reubendowle and others added 3 commits March 29, 2021 10:17

nhrpd: Remove unecessary new line from debug messages

6baf035

Signed-off-by: Reuben Dowle <reuben.dowle@4rf.com>

nhrpd: Display post-nat NBMA for local addresses

bcf5673

Signed-off-by: Reuben Dowle <reuben.dowle@4rf.com>

nhrpd: Make some debug prints more informative

0551aea

Signed-off-by: Reuben Dowle <reuben.dowle@4rf.com>

reubendowle force-pushed the fixes/nhrp-nat branch from 925794e to 0551aea Compare March 28, 2021 21:26

pguibert6WIND approved these changes Mar 29, 2021

View reviewed changes

nhrpd: Ensure invalid pointer is not used if two NAT extensions received

d0c9d09

Also cleanup some minor style issues Signed-off-by: Reuben Dowle <reuben.dowle@4rf.com>

polychaeta previously requested changes Apr 1, 2021

View reviewed changes

nhrpd: Fix memory leak in error path when forwarding packets

ba113ac

Signed-off-by: Reuben Dowle <reuben.dowle@4rf.com>

reubendowle force-pushed the fixes/nhrp-nat branch from 73c7bf9 to ba113ac Compare April 1, 2021 01:52

Jafaral merged commit 283981e into FRRouting:master Apr 4, 2021

nhrp: NAT fixes #8240

nhrp: NAT fixes #8240

Conversation

reubendowle commented Mar 12, 2021

LabN-CI commented Mar 12, 2021 • edited Loading

Basic BGPD CI results: SUCCESS, 0 tests failed

Jafaral commented Mar 12, 2021

NetDEF-CI commented Mar 12, 2021 • edited Loading

Continuous Integration Result: FAILED

Get source / Pull Request: Successful

Building Stage: Successful

Basic Tests: Failed

Warnings Generated during build:

CLANG Static Analyzer Summary

1 Static Analyzer issues remaining.

pguibert6WIND left a comment

Choose a reason for hiding this comment

pguibert6WIND Mar 12, 2021

Choose a reason for hiding this comment

amollad Mar 13, 2021

Choose a reason for hiding this comment

reubendowle Mar 14, 2021

Choose a reason for hiding this comment

reubendowle Mar 15, 2021 • edited Loading

Choose a reason for hiding this comment

pguibert6WIND Mar 18, 2021 • edited Loading

Choose a reason for hiding this comment

amollad Mar 24, 2021

Choose a reason for hiding this comment

pguibert6WIND Mar 26, 2021

Choose a reason for hiding this comment

amollad Mar 26, 2021

Choose a reason for hiding this comment

reubendowle Mar 26, 2021

Choose a reason for hiding this comment

NetDEF-CI commented Mar 14, 2021 • edited Loading

Continuous Integration Result: FAILED

Get source / Pull Request: Successful

Building Stage: Failed

Warnings Generated during build:

LabN-CI commented Mar 15, 2021 • edited Loading

Basic BGPD CI results: SUCCESS, 0 tests failed

NetDEF-CI commented Mar 15, 2021 • edited Loading

Continuous Integration Result: SUCCESSFUL

Warnings Generated during build:

CLANG Static Analyzer Summary

1 Static Analyzer issues remaining.

LabN-CI commented Mar 15, 2021 • edited Loading

Basic BGPD CI results: SUCCESS, 0 tests failed

LabN-CI commented Mar 15, 2021 • edited Loading

Basic BGPD CI results: SUCCESS, 0 tests failed

NetDEF-CI commented Mar 15, 2021 • edited Loading

Continuous Integration Result: SUCCESSFUL

Warnings Generated during build:

NetDEF-CI commented Mar 15, 2021 • edited Loading

Continuous Integration Result: SUCCESSFUL

Warnings Generated during build:

LabN-CI commented Mar 16, 2021 • edited Loading

Basic BGPD CI results: SUCCESS, 0 tests failed

NetDEF-CI commented Mar 16, 2021 • edited Loading

Continuous Integration Result: FAILED

Get source / Pull Request: Successful

Building Stage: Successful

Basic Tests: Failed

Warnings Generated during build:

reubendowle commented Mar 17, 2021

NetDEF-CI commented Mar 23, 2021

Continuous Integration Result: FAILED

Get source / Pull Request: Successful

Building Stage: Successful

Basic Tests: Failed

Warnings Generated during build:

NetDEF-CI commented Mar 23, 2021

Continuous Integration Result: FAILED

Get source / Pull Request: Successful

Building Stage: Successful

Basic Tests: Failed

Warnings Generated during build:

LabN-CI commented Mar 24, 2021

💚 Basic BGPD CI results: SUCCESS, 0 tests failed

LabN-CI commented Mar 12, 2021 •

edited

Loading

NetDEF-CI commented Mar 12, 2021 •

edited

Loading

reubendowle Mar 15, 2021 •

edited

Loading

pguibert6WIND Mar 18, 2021 •

edited

Loading

NetDEF-CI commented Mar 14, 2021 •

edited

Loading

LabN-CI commented Mar 15, 2021 •

edited

Loading

NetDEF-CI commented Mar 15, 2021 •

edited

Loading

LabN-CI commented Mar 15, 2021 •

edited

Loading

LabN-CI commented Mar 15, 2021 •

edited

Loading

NetDEF-CI commented Mar 15, 2021 •

edited

Loading

NetDEF-CI commented Mar 15, 2021 •

edited

Loading

LabN-CI commented Mar 16, 2021 •

edited

Loading

NetDEF-CI commented Mar 16, 2021 •

edited

Loading

amollad commented Mar 26, 2021 •

edited

Loading