Results SRE

Results: SRE

This page preserves the WAN/SRE benchmark summary tracked in results/SRE-results.md. Timeout per variant: 14400s.

These results come from the network-verification research workflow, not from the default Maven build path. Keep that in mind when comparing them with the easy-to-rerun NQueens results.

What To Look For

• how ndd-array compares with the original ndd baseline at increasing fattree sizes
• whether memory reduction tracks runtime reduction
• how much BDD-node growth is cut by the field-aware reuse strategy
• where the plain BDD baseline times out but NDD variants still finish

Selected Highlights

Dataset	Metric	NDD	NDD-Array	Improvement
bgp_fattree08, MF=3	total time (s)	60.828954399	25.602449596	2.38x faster
bgp_fattree08, MF=3	peak RSS (MB)	4220.4	2046.0	51.5% lower
bgp_fattree08, MF=3	BDD nodes	38199434	3208829	91.6% fewer
bgp_fattree12, MF=3	total time (s)	636.086437962	230.905827854	2.75x faster
bgp_fattree12, MF=3	peak RSS (MB)	26274.3	18113.7	31.1% lower
bgp_fattree16, MF=2	total time (s)	1178.287171806	472.056353484	2.50x faster

Reading The Table

• dataset identifies the network family and size
• MF is the harness parameter preserved from the original evaluation
• src(s) is a source or preprocessing stage reported by the experiment
• total(s) is the end-to-end runtime
• peak rss is peak resident memory
• bgp routes gives a rough sense of scale
• bdd nodes reflects the size of the BDD label layer used during the run

Full Table

dataset=bgp_fattree04, MF=1

Variant	src(s)	total(s)	peak rss	bgp routes	bdd nodes
bdd	0.199032349	0.697075224	169.6MB	440	79270
ndd	0.21296372	0.697194453	217.7MB	440	51649
ndd-reuse	0.197991385	0.713181288	224.9MB	440	44314
ndd-array	0.171329424	0.63580931	199.1MB	440	40247

dataset=bgp_fattree04, MF=2

Variant	src(s)	total(s)	peak rss	bgp routes	bdd nodes
bdd	0.065175369	0.507610428	102.0MB	0	24968
ndd	0.064452769	0.49972476	101.9MB	0	27377
ndd-reuse	0.068398852	0.502337077	105.4MB	0	27303
ndd-array	0.057704146	0.513184718	100.6MB	0	27390

dataset=bgp_fattree04, MF=3

Variant	src(s)	total(s)	peak rss	bgp routes	bdd nodes
bdd	0.055806707	0.454624987	101.5MB	0	25848
ndd	0.068548047	0.48734762	100.7MB	0	27959
ndd-reuse	0.091853088	0.538464628	104.8MB	0	27878
ndd-array	0.055611648	0.48926326	100.9MB	0	28030

dataset=bgp_fattree08, MF=1

Variant	src(s)	total(s)	peak rss	bgp routes	bdd nodes
bdd	3.536388235	6.964977256	2250.7MB	7392	3263633
ndd	2.906284374	5.032310009	1905.2MB	7392	1762586
ndd-reuse	2.507999037	4.298852012	1346.0MB	7392	367425
ndd-array	1.343077991	2.69453103	772.5MB	7392	278912

dataset=bgp_fattree08, MF=2

Variant	src(s)	total(s)	peak rss	bgp routes	bdd nodes
bdd	13.817159752	22.919905736	2841.0MB	16517	19077038
ndd	12.874106714	17.149181016	2925.5MB	16517	9250004
ndd-reuse	11.126410978	14.873414161	2353.5MB	16517	860612
ndd-array	4.682225155	6.785026264	1361.5MB	16517	731104

dataset=bgp_fattree08, MF=3

Variant	src(s)	total(s)	peak rss	bgp routes	bdd nodes
bdd	68.323042703	103.809460087	3749.2MB	31436	85595315
ndd	51.713371101	60.828954399	4220.4MB	31436	38199434
ndd-reuse	46.234172397	55.413865268	3441.0MB	31436	3546018
ndd-array	21.05702101	25.602449596	2046.0MB	31436	3208829

dataset=bgp_fattree12, MF=1

Variant	src(s)	total(s)	peak rss	bgp routes	bdd nodes
bdd	99.783163339	141.636128202	22220.5MB	37944	57000492
ndd	27.687420029	45.079233791	13093.6MB	37944	25421970
ndd-reuse	15.892849041	32.499337508	13185.6MB	37944	3284649
ndd-array	8.801349052	22.166407239	13016.2MB	37944	2065690

dataset=bgp_fattree12, MF=2

Variant	src(s)	total(s)	peak rss	bgp routes	bdd nodes
bdd	385.496728907	507.192693855	27242.9MB	85192	404400659
ndd	135.42850768	166.342765035	19750.4MB	85192	156330370
ndd-reuse	82.505692639	113.480130675	18459.1MB	85192	14912726
ndd-array	39.67628597	58.258226109	14241.1MB	85192	13756762

dataset=bgp_fattree12, MF=3

Variant	src(s)	total(s)	peak rss	bgp routes	bdd nodes
bdd	1373.223894428	2350.774409071	29826.8MB	163130	1539299055
ndd	544.870183665	636.086437962	26274.3MB	163130	645702063
ndd-reuse	340.786929547	406.649415653	30967.7MB	163130	81710193
ndd-array	196.264904096	230.905827854	18113.7MB	163130	61386922

dataset=bgp_fattree16, MF=1

Variant	src(s)	total(s)	peak rss	bgp routes	bdd nodes
bdd	950.022085188	1126.586307379	30921.9MB	115904	558517731
ndd	140.662066441	186.545315128	20992.3MB	115904	192411499
ndd-reuse	91.122479242	135.368235883	21377.9MB	115904	20316876
ndd-array	48.776411429	76.189433182	17331.0MB	115904	15689306

dataset=bgp_fattree16, MF=2

Variant	src(s)	total(s)	peak rss	bgp routes	bdd nodes
bdd	>14400s	>14400s	N/A	N/A	N/A
ndd	1066.502401085	1178.287171806	34679.7MB	256246	1437319312
ndd-reuse	605.394118373	721.51310894	32638.6MB	256246	179729273
ndd-array	402.775790136	472.056353484	22359.3MB	256246	164723549

dataset=bgp_fattree16, MF=3

Variant	src(s)	total(s)	peak rss	bgp routes	bdd nodes
bdd	>14400s	>14400s	N/A	N/A	N/A
ndd	7012.950610834	7345.012811346	69471.1MB	484951	3401452892
ndd-reuse	3388.764826264	3722.195997192	64700.5MB	484951	1982221370
ndd-array	2159.542173304	2367.636974608	41078.4MB	484951	1572775889

dataset=bgp_fattree20, MF=1

Variant	src(s)	total(s)	peak rss	bgp routes	bdd nodes
bdd	>14400s	>14400s	N/A	N/A	N/A
ndd	769.798916337	898.226961354	34475.4MB	289400	1003083901
ndd-reuse	404.179502731	517.479194306	34536.3MB	289400	105961803
ndd-array	279.78942101	386.704613504	33879.4MB	289400	94553481

dataset=bgp_fattree20, MF=2

Variant	src(s)	total(s)	peak rss	bgp routes	bdd nodes
bdd	>14400s	>14400s	N/A	N/A	N/A
ndd	6926.554867672	7356.703514343	69615.5MB	644962	4356705616
ndd-reuse	3480.311607732	3836.447385128	65522.6MB	644962	1583507510
ndd-array	2462.811439699	2697.611333916	53784.7MB	644962	1531851671

dataset=bgp_fattree20, MF=3

Variant	src(s)	total(s)	peak rss	bgp routes	bdd nodes
bdd	>14400s	>14400s	N/A	N/A	N/A
ndd	>14400s	>14400s	N/A	N/A	N/A
ndd-reuse	>14400s	>14400s	N/A	N/A	N/A
ndd-array	>14400s	>14400s	N/A	N/A	N/A