Results SRE

Results: SRE

This page preserves the WAN/SRE benchmark summary tracked in results/SRE-results.md. Timeout per variant: 14400s.

These results come from the network-verification research workflow, not from the default Maven build path. Keep that in mind when comparing them with the easy-to-rerun NQueens results.

What To Look For

• how NDD compares with the original NDD-Origin baseline at increasing fattree sizes
• whether memory reduction tracks runtime reduction
• how much BDD-node growth is cut by the field-aware reuse strategy
• where the plain BDD baseline times out but NDD variants still finish

Selected Highlights

Dataset	Metric	NDD-Origin	NDD	Improvement
bgp_fattree08, MF=3	total time (s)	60.828954399	25.602449596	2.38x faster
bgp_fattree08, MF=3	peak RSS (MB)	4220.4	2046.0	51.5% lower
bgp_fattree08, MF=3	BDD nodes	38199434	3208829	91.6% fewer
bgp_fattree12, MF=3	total time (s)	636.086437962	230.905827854	2.75x faster
bgp_fattree12, MF=3	peak RSS (MB)	26274.3	18113.7	31.1% lower
bgp_fattree16, MF=2	total time (s)	1178.287171806	472.056353484	2.50x faster

Reading The Table

• dataset identifies the network family and size
• MF is the harness parameter preserved from the original evaluation
• src(s) is a source or preprocessing stage reported by the experiment
• total(s) is the end-to-end runtime
• peak rss is peak resident memory
• bgp routes gives a rough sense of scale
• bdd nodes reflects the size of the BDD label layer used during the run

Full Table

dataset=bgp_fattree04, MF=1

Variant	src(s)	total(s)	peak rss	bgp routes	bdd nodes
bdd	0.199032349	0.697075224	169.6MB	440	79270
NDD-Origin	0.21296372	0.697194453	217.7MB	440	51649
NDD-Reuse	0.197991385	0.713181288	224.9MB	440	44314
NDD	0.171329424	0.63580931	199.1MB	440	40247

dataset=bgp_fattree04, MF=2

Variant	src(s)	total(s)	peak rss	bgp routes	bdd nodes
bdd	0.065175369	0.507610428	102.0MB	0	24968
NDD-Origin	0.064452769	0.49972476	101.9MB	0	27377
NDD-Reuse	0.068398852	0.502337077	105.4MB	0	27303
NDD	0.057704146	0.513184718	100.6MB	0	27390

dataset=bgp_fattree04, MF=3

Variant	src(s)	total(s)	peak rss	bgp routes	bdd nodes
bdd	0.055806707	0.454624987	101.5MB	0	25848
NDD-Origin	0.068548047	0.48734762	100.7MB	0	27959
NDD-Reuse	0.091853088	0.538464628	104.8MB	0	27878
NDD	0.055611648	0.48926326	100.9MB	0	28030

dataset=bgp_fattree08, MF=1

Variant	src(s)	total(s)	peak rss	bgp routes	bdd nodes
bdd	3.536388235	6.964977256	2250.7MB	7392	3263633
NDD-Origin	2.906284374	5.032310009	1905.2MB	7392	1762586
NDD-Reuse	2.507999037	4.298852012	1346.0MB	7392	367425
NDD	1.343077991	2.69453103	772.5MB	7392	278912

dataset=bgp_fattree08, MF=2

Variant	src(s)	total(s)	peak rss	bgp routes	bdd nodes
bdd	13.817159752	22.919905736	2841.0MB	16517	19077038
NDD-Origin	12.874106714	17.149181016	2925.5MB	16517	9250004
NDD-Reuse	11.126410978	14.873414161	2353.5MB	16517	860612
NDD	4.682225155	6.785026264	1361.5MB	16517	731104

dataset=bgp_fattree08, MF=3

Variant	src(s)	total(s)	peak rss	bgp routes	bdd nodes
bdd	68.323042703	103.809460087	3749.2MB	31436	85595315
NDD-Origin	51.713371101	60.828954399	4220.4MB	31436	38199434
NDD-Reuse	46.234172397	55.413865268	3441.0MB	31436	3546018
NDD	21.05702101	25.602449596	2046.0MB	31436	3208829

dataset=bgp_fattree12, MF=1

Variant	src(s)	total(s)	peak rss	bgp routes	bdd nodes
bdd	99.783163339	141.636128202	22220.5MB	37944	57000492
NDD-Origin	27.687420029	45.079233791	13093.6MB	37944	25421970
NDD-Reuse	15.892849041	32.499337508	13185.6MB	37944	3284649
NDD	8.801349052	22.166407239	13016.2MB	37944	2065690

dataset=bgp_fattree12, MF=2

Variant	src(s)	total(s)	peak rss	bgp routes	bdd nodes
bdd	385.496728907	507.192693855	27242.9MB	85192	404400659
NDD-Origin	135.42850768	166.342765035	19750.4MB	85192	156330370
NDD-Reuse	82.505692639	113.480130675	18459.1MB	85192	14912726
NDD	39.67628597	58.258226109	14241.1MB	85192	13756762

dataset=bgp_fattree12, MF=3

Variant	src(s)	total(s)	peak rss	bgp routes	bdd nodes
bdd	1373.223894428	2350.774409071	29826.8MB	163130	1539299055
NDD-Origin	544.870183665	636.086437962	26274.3MB	163130	645702063
NDD-Reuse	340.786929547	406.649415653	30967.7MB	163130	81710193
NDD	196.264904096	230.905827854	18113.7MB	163130	61386922

dataset=bgp_fattree16, MF=1

Variant	src(s)	total(s)	peak rss	bgp routes	bdd nodes
bdd	950.022085188	1126.586307379	30921.9MB	115904	558517731
NDD-Origin	140.662066441	186.545315128	20992.3MB	115904	192411499
NDD-Reuse	91.122479242	135.368235883	21377.9MB	115904	20316876
NDD	48.776411429	76.189433182	17331.0MB	115904	15689306

dataset=bgp_fattree16, MF=2

Variant	src(s)	total(s)	peak rss	bgp routes	bdd nodes
bdd	>14400s	>14400s	N/A	N/A	N/A
NDD-Origin	1066.502401085	1178.287171806	34679.7MB	256246	1437319312
NDD-Reuse	605.394118373	721.51310894	32638.6MB	256246	179729273
NDD	402.775790136	472.056353484	22359.3MB	256246	164723549

dataset=bgp_fattree16, MF=3

Variant	src(s)	total(s)	peak rss	bgp routes	bdd nodes
bdd	>14400s	>14400s	N/A	N/A	N/A
NDD-Origin	7012.950610834	7345.012811346	69471.1MB	484951	3401452892
NDD-Reuse	3388.764826264	3722.195997192	64700.5MB	484951	1982221370
NDD	2159.542173304	2367.636974608	41078.4MB	484951	1572775889

dataset=bgp_fattree20, MF=1

Variant	src(s)	total(s)	peak rss	bgp routes	bdd nodes
bdd	>14400s	>14400s	N/A	N/A	N/A
NDD-Origin	769.798916337	898.226961354	34475.4MB	289400	1003083901
NDD-Reuse	404.179502731	517.479194306	34536.3MB	289400	105961803
NDD	279.78942101	386.704613504	33879.4MB	289400	94553481

dataset=bgp_fattree20, MF=2

Variant	src(s)	total(s)	peak rss	bgp routes	bdd nodes
bdd	>14400s	>14400s	N/A	N/A	N/A
NDD-Origin	6926.554867672	7356.703514343	69615.5MB	644962	4356705616
NDD-Reuse	3480.311607732	3836.447385128	65522.6MB	644962	1583507510
NDD	2462.811439699	2697.611333916	53784.7MB	644962	1531851671

dataset=bgp_fattree20, MF=3

Variant	src(s)	total(s)	peak rss	bgp routes	bdd nodes
bdd	>14400s	>14400s	N/A	N/A	N/A
NDD-Origin	>14400s	>14400s	N/A	N/A	N/A
NDD-Reuse	>14400s	>14400s	N/A	N/A	N/A
NDD	>14400s	>14400s	N/A	N/A	N/A