Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[catnip] Enhancement: Add prepend function #1179

Closed
wants to merge 3 commits into from
Closed

[catnip] Enhancement: Add prepend function #1179

wants to merge 3 commits into from

Conversation

carvalhof
Copy link
Collaborator

This PR closes #321, enabling the prepend function on DPDK-based DemiBuffer.

ppenna
ppenna requested changes Mar 13, 2024
View reviewed changes
Copy link
Contributor

@ppenna ppenna left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Blocking merge to be able to run benchmarks.

@ppenna ppenna self-assigned this Mar 13, 2024
@iyzhang iyzhang force-pushed the enhancement-catnip-prepend branch 2 times, most recently from d2c6d08 to 1fa63c9 Compare July 12, 2024 00:37
@github-actions GitHub Actions
Copy link

libos = catnip
commit id = 1fa63c9

collapsed_stack percent_time cycles_per_call nanoseconds_per_call
main 100.00 5101821758.72 2212392433.28
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::receive 89.25 17920.03 7808.17
demikernel::new 60.92 1818504806.23 793788478.83
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::receive 44.90 205.16 89.59
bgc::inetstack::poll_recv 35.60 473.24 206.78
bgc::inetstack::tcp::established::background;tcp::established::background::receiver 27.59 850.80 368.49
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter 26.22 1106.34 481.00
bgc::inetstack::tcp::established::background;tcp::established::background::sender 19.67 756.82 330.23
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for;udp::receive 12.74 444.97 198.20
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for 10.05 49.41 21.67
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger 8.45 331.27 144.41
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::for 5.86 1167.72 510.00
bgc::inetstack::tcp::established::background 2.67 3336.48 1450.51
ioc::network::libos::pop 0.53 910.87 395.39
ioc::network::libos::push 0.47 1972.35 863.49
bgc::inetstack::poll_recv;inetstack::poll 0.28 40129.27 17488.38
demikernel::push 0.15 668.94 292.48
demikernel::sgaalloc 0.12 349.76 154.15
demikernel::pop 0.07 472.65 204.85
ioc::network::libos::pushto 0.06 1230.42 532.80
ioc::network::libos::close 0.02 7450.79 3245.49
demikernel::pushto 0.02 430.76 186.51
ioc::network::libos::connect 0.01 16136.32 7296.95
demikernel::sgafree 0.01 70.04 30.59
demikernel::bind 0.00 22265.19 9554.82
bgc::inetstack::tcp::passiveopen::background 0.00 15336.40 6635.98
bgc::passive_listening::poll 0.00 5783.40 2495.24
demikernel::listen 0.00 5499.57 2365.01
demikernel::connect 0.00 4971.34 2236.78
bgc::inetstack::icmp::background 0.00 3133.95 1367.18
bgc::inetstack::arp::background 0.00 2909.44 1268.14
ioc::network::libos::accept 0.00 2482.79 1072.17
demikernel::socket 0.00 1736.02 747.62
demikernel::accept 0.00 1448.81 627.15
demikernel::async_close 0.00 673.06 287.05
demikernel::close 0.00 nan nan

@github-actions GitHub Actions
Copy link

libos = catnap
commit id = 1fa63c9

collapsed_stack percent_time cycles_per_call nanoseconds_per_call
main 100.00 3393721586.89 1512294424.41
demikernel::socket;catnap::linux::transport::socket 97.50 52930.22 23196.29
ioc::network::libos::close;catnap::linux::transport::close 95.90 21558.20 9432.90
demikernel::listen;catnap::linux::transport::listen 90.37 12996.74 5716.45
demikernel::bind;catnap::linux::transport::bind 80.72 23343.00 10266.86
ioc::network::libos::accept 43.19 894049225.03 388873722.89
bgc::catnap::transport::epoll 33.77 2258.84 990.03
ioc::network::libos::pop 25.60 3781496.56 1641387.20
ioc::network::libos::connect 23.12 3942988.90 1721720.28
ioc::network::libos::pushto 22.96 8096.84 3544.42
ioc::network::libos::push 7.26 17958.24 7888.96
ioc::network::libos::pushto;catnap::linux::transport::push 6.78 547.30 239.81
ioc::network::libos::push;catnap::linux::transport::push 4.62 804.34 352.80
ioc::network::libos::pop;catnap::linux::transport::pop 2.42 524.10 229.33
ioc::network::libos::connect;catnap::linux::transport::connect 2.23 53813.62 23398.26
demikernel::pushto 1.22 424.66 185.97
demikernel::new 0.59 1583869.85 693474.44
demikernel::push 0.26 614.67 269.45
demikernel::sgaalloc 0.23 209.77 91.16
demikernel::pop 0.16 752.81 329.34
demikernel::socket 0.10 54344.23 23812.88
ioc::network::libos::close 0.07 22570.71 9874.63
demikernel::sgafree 0.04 82.30 35.86
demikernel::async_close 0.02 852.67 379.18
demikernel::bind 0.01 28903.35 12713.39
demikernel::connect 0.01 2232.30 969.73
demikernel::listen 0.00 14432.05 6343.89
ioc::network::libos::accept;catnap::linux::transport::accept 0.00 2855.48 1260.63
demikernel::accept 0.00 1580.15 694.68
demikernel::close 0.00 nan nan

@github-actions GitHub Actions
Copy link

libos = catpowder
commit id = 5a22f11

collapsed_stack percent_time cycles_per_call nanoseconds_per_call
main 100.00 3511663679.38 1518680014.35
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::receive 76.56 910.81 402.54
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::receive 75.21 6951.77 3051.93
bgc::inetstack::poll_recv 61.24 1249.15 552.81
bgc::inetstack::tcp::established::background;tcp::established::background::receiver 31.35 1463.42 646.50
demikernel::new 28.19 92610069.17 40775291.82
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter 25.83 1211.43 535.80
bgc::inetstack::tcp::established::background;tcp::established::background::sender 19.97 867.58 382.01
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for;udp::receive 13.68 441.22 193.27
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger 7.77 349.69 154.85
bgc::inetstack::tcp::established::background 6.71 4211.22 1860.06
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::for 5.34 473.87 208.31
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for 4.40 60.02 26.76
ioc::network::libos::push 3.59 6123.04 2717.35
ioc::network::libos::pushto 3.14 5059.67 2202.18
ioc::network::libos::pop 1.08 1028.43 455.43
demikernel::push 0.46 795.68 351.44
ioc::network::libos::connect 0.28 23376.68 10487.85
demikernel::pushto 0.28 471.08 205.06
demikernel::sgaalloc 0.26 380.03 170.93
ioc::network::libos::close 0.22 10413.36 4617.72
demikernel::pop 0.18 492.28 217.72
bgc::inetstack::poll_recv;inetstack::poll 0.04 9159.47 4023.07
demikernel::sgafree 0.04 85.76 38.08
bgc::inetstack::tcp::passiveopen::background 0.01 12464.04 5402.32
demikernel::connect 0.01 3881.50 1736.37
demikernel::async_close 0.01 660.53 288.68
demikernel::bind 0.00 11197.19 4869.98
bgc::passive_listening::poll 0.00 5087.32 2218.13
demikernel::listen 0.00 4609.07 1996.75
bgc::inetstack::icmp::background 0.00 3080.78 1355.19
bgc::inetstack::arp::background 0.00 2643.84 1152.90
ioc::network::libos::accept 0.00 2392.14 1040.00
demikernel::socket 0.00 1305.17 570.40
demikernel::accept 0.00 1199.38 521.98
demikernel::close 0.00 nan nan

@github-actions GitHub Actions
Copy link

libos = catnip
commit id = 5a22f11

collapsed_stack percent_time cycles_per_call nanoseconds_per_call
main 100.00 5074158265.16 2237598014.50
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::receive 88.49 18002.55 8004.91
demikernel::new 60.97 1821750658.22 809188874.72
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::receive 44.60 202.96 90.14
bgc::inetstack::poll_recv 35.53 470.70 208.83
bgc::inetstack::tcp::established::background;tcp::established::background::receiver 27.26 833.20 371.11
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter 26.25 1112.64 492.16
bgc::inetstack::tcp::established::background;tcp::established::background::sender 19.88 767.06 339.04
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for;udp::receive 11.53 427.58 189.49
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for 10.16 49.40 21.80
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger 8.46 331.92 147.00
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::for 6.29 1273.17 568.00
bgc::inetstack::tcp::established::background 2.69 3340.43 1482.97
ioc::network::libos::pop 0.53 900.97 402.30
ioc::network::libos::push 0.47 1960.46 879.17
bgc::inetstack::poll_recv;inetstack::poll 0.23 40660.30 18081.52
demikernel::push 0.15 659.02 294.34
demikernel::sgaalloc 0.12 354.54 153.70
ioc::network::libos::pushto 0.07 1241.75 554.27
demikernel::pop 0.07 472.36 210.84
demikernel::pushto 0.03 442.81 197.26
ioc::network::libos::connect 0.01 14775.37 6686.13
ioc::network::libos::close 0.01 7346.66 3259.14
demikernel::sgafree 0.01 70.73 31.64
demikernel::bind 0.00 22261.19 10406.44
bgc::inetstack::tcp::passiveopen::background 0.00 14691.39 6607.29
bgc::passive_listening::poll 0.00 5762.07 2603.01
demikernel::listen 0.00 4407.14 1976.69
demikernel::connect 0.00 3535.85 1583.69
bgc::inetstack::arp::background 0.00 2921.06 1302.93
bgc::inetstack::icmp::background 0.00 2707.18 1208.66
ioc::network::libos::accept 0.00 2445.34 1103.85
demikernel::socket 0.00 1706.16 774.28
demikernel::accept 0.00 1410.97 634.68
demikernel::async_close 0.00 588.60 259.64
demikernel::close 0.00 nan nan

@github-actions GitHub Actions
Copy link

libos = catnap
commit id = 5a22f11

collapsed_stack percent_time cycles_per_call nanoseconds_per_call
main 100.00 3387625916.84 1480494038.49
demikernel::socket;catnap::linux::transport::socket 97.38 54502.76 24676.84
ioc::network::libos::close;catnap::linux::transport::close 95.87 21397.96 9633.12
demikernel::listen;catnap::linux::transport::listen 90.39 13096.58 5948.01
demikernel::bind;catnap::linux::transport::bind 80.69 24686.90 11163.59
ioc::network::libos::accept 42.90 903528317.87 413762650.29
bgc::catnap::transport::epoll 33.69 2401.19 1082.15
ioc::network::libos::pop 26.04 3609869.20 1564375.85
ioc::network::libos::pushto 23.11 8059.12 3490.67
ioc::network::libos::connect 22.60 3504410.27 1568485.88
ioc::network::libos::push 7.36 17805.75 8075.11
ioc::network::libos::pushto;catnap::linux::transport::push 6.65 533.75 231.38
ioc::network::libos::push;catnap::linux::transport::push 4.52 761.81 344.29
ioc::network::libos::pop;catnap::linux::transport::pop 2.29 512.81 230.53
ioc::network::libos::connect;catnap::linux::transport::connect 2.09 53963.37 24250.18
demikernel::pushto 1.30 471.27 203.95
demikernel::new 0.56 1606870.32 723682.09
demikernel::push 0.25 592.92 267.78
demikernel::sgaalloc 0.24 261.99 118.53
demikernel::pop 0.15 674.21 302.86
demikernel::socket 0.10 56141.86 25420.07
ioc::network::libos::close 0.07 22408.32 10087.18
demikernel::sgafree 0.04 81.04 36.31
demikernel::bind 0.01 30568.32 13830.84
demikernel::connect 0.01 2022.84 909.78
demikernel::async_close 0.01 870.88 387.64
demikernel::listen 0.00 14561.50 6611.53
ioc::network::libos::accept;catnap::linux::transport::accept 0.00 2954.99 1349.42
demikernel::accept 0.00 1606.29 724.67
demikernel::close 0.00 nan nan

@github-actions GitHub Actions
Copy link

libos = catpowder
commit id = 8d48211

collapsed_stack percent_time cycles_per_call nanoseconds_per_call
main 100.00 3470142988.31 1526818154.60
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::receive 77.06 6910.27 3096.27
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::receive 76.44 917.85 410.20
bgc::inetstack::poll_recv 61.90 1270.27 567.80
bgc::inetstack::tcp::established::background;tcp::established::background::receiver 31.61 1497.83 674.71
demikernel::new 27.68 92214642.42 40983120.74
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter 24.70 1181.77 529.23
bgc::inetstack::tcp::established::background;tcp::established::background::sender 20.60 912.63 410.02
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for;udp::receive 13.43 345.26 150.58
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger 7.65 349.10 156.49
bgc::inetstack::tcp::established::background 6.67 4304.90 1938.27
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::for 5.01 431.70 193.01
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for 4.54 63.70 28.47
ioc::network::libos::push 3.45 6164.04 2776.25
ioc::network::libos::pushto 3.45 4936.77 2124.32
ioc::network::libos::pop 1.04 963.01 439.31
demikernel::push 0.42 744.85 333.83
demikernel::pushto 0.32 470.74 202.57
ioc::network::libos::connect 0.29 22267.10 9925.87
demikernel::sgaalloc 0.26 297.66 133.12
ioc::network::libos::close 0.21 10550.51 4728.61
demikernel::pop 0.19 568.11 259.13
demikernel::sgafree 0.04 99.32 43.99
bgc::inetstack::poll_recv;inetstack::poll 0.03 8865.57 3969.34
demikernel::async_close 0.02 678.39 309.23
bgc::inetstack::tcp::passiveopen::background 0.01 13382.70 6169.47
demikernel::connect 0.01 4484.85 1992.89
demikernel::bind 0.00 8681.31 3869.15
bgc::passive_listening::poll 0.00 5416.16 2478.63
demikernel::listen 0.00 5295.93 2376.78
bgc::inetstack::icmp::background 0.00 2913.55 1302.85
ioc::network::libos::accept 0.00 2452.26 1125.31
bgc::inetstack::arp::background 0.00 2443.97 1089.89
demikernel::socket 0.00 1616.26 723.35
demikernel::accept 0.00 1219.73 559.40
demikernel::close 0.00 nan nan

@github-actions GitHub Actions
Copy link

libos = catnap
commit id = 8d48211

collapsed_stack percent_time cycles_per_call nanoseconds_per_call
main 100.00 3444967381.25 1502137053.94
demikernel::socket;catnap::linux::transport::socket 97.36 55048.03 24397.57
ioc::network::libos::close;catnap::linux::transport::close 95.75 22236.59 9820.91
demikernel::listen;catnap::linux::transport::listen 90.84 12774.68 5685.54
demikernel::bind;catnap::linux::transport::bind 80.44 24147.45 10733.78
ioc::network::libos::accept 43.25 921924427.89 408876062.68
bgc::catnap::transport::epoll 34.00 2399.99 1065.31
ioc::network::libos::pop 25.35 3505897.68 1531047.75
ioc::network::libos::pushto 23.85 9343.72 3979.44
ioc::network::libos::connect 23.34 3755361.64 1647664.22
ioc::network::libos::push 7.22 17580.70 7830.57
ioc::network::libos::pushto;catnap::linux::transport::push 6.18 561.63 238.42
ioc::network::libos::push;catnap::linux::transport::push 4.51 741.11 329.19
ioc::network::libos::pop;catnap::linux::transport::pop 2.44 526.18 232.16
ioc::network::libos::connect;catnap::linux::transport::connect 1.96 53048.22 23350.88
demikernel::pushto 1.32 461.29 196.09
demikernel::new 0.50 1569425.85 693930.42
demikernel::push 0.25 607.43 268.77
demikernel::sgaalloc 0.24 224.90 99.62
demikernel::pop 0.15 664.23 292.92
demikernel::socket 0.10 56587.82 25075.23
ioc::network::libos::close 0.08 23305.92 10291.98
demikernel::sgafree 0.04 94.07 41.35
demikernel::async_close 0.02 985.51 438.19
demikernel::connect 0.01 2034.83 894.08
demikernel::bind 0.00 30178.20 13410.59
demikernel::listen 0.00 14062.47 6259.25
ioc::network::libos::accept;catnap::linux::transport::accept 0.00 2892.90 1294.30
demikernel::accept 0.00 1657.77 736.18
demikernel::close 0.00 nan nan

@iyzhang iyzhang force-pushed the enhancement-catnip-prepend branch from 8d48211 to 4391571 Compare July 12, 2024 23:03
@github-actions GitHub Actions
Copy link

libos = catpowder
commit id = 4391571

collapsed_stack percent_time cycles_per_call nanoseconds_per_call
main 100.00 3437292068.56 1504571222.85
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::receive 76.84 7119.67 3097.83
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::receive 76.45 923.69 401.20
bgc::inetstack::poll_recv 61.70 1276.75 554.68
bgc::inetstack::tcp::established::background;tcp::established::background::receiver 31.28 1501.90 646.04
demikernel::new 27.80 86674394.78 37607118.96
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter 26.22 1272.81 547.99
bgc::inetstack::tcp::established::background;tcp::established::background::sender 18.98 845.88 364.38
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for;udp::receive 17.07 429.20 191.80
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger 7.97 371.33 159.91
bgc::inetstack::tcp::established::background 6.66 4351.39 1873.58
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::for 5.13 462.13 201.28
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for 4.57 65.85 28.65
ioc::network::libos::push 3.66 5943.08 2589.35
ioc::network::libos::pushto 2.38 5392.60 2415.73
ioc::network::libos::pop 1.01 1005.33 433.20
demikernel::push 0.47 771.60 335.28
ioc::network::libos::connect 0.31 22897.49 9960.95
ioc::network::libos::close 0.23 10497.93 4559.05
demikernel::pushto 0.23 522.54 234.10
demikernel::sgaalloc 0.23 274.76 118.09
demikernel::pop 0.19 510.09 221.34
bgc::inetstack::poll_recv;inetstack::poll 0.05 9219.93 4011.37
demikernel::sgafree 0.05 86.92 37.85
bgc::inetstack::tcp::passiveopen::background 0.01 11330.99 4960.28
demikernel::connect 0.01 3873.64 1682.27
demikernel::async_close 0.01 667.19 285.58
demikernel::bind 0.00 11235.38 4875.79
bgc::passive_listening::poll 0.00 4768.51 2081.71
demikernel::listen 0.00 4532.36 1965.06
ioc::network::libos::accept 0.00 3539.73 1526.83
bgc::inetstack::icmp::background 0.00 3073.76 1334.16
bgc::inetstack::arp::background 0.00 3023.02 1312.69
demikernel::socket 0.00 1812.93 792.69
demikernel::accept 0.00 1471.88 639.82
demikernel::close 0.00 nan nan

@github-actions GitHub Actions
Copy link

libos = catnap
commit id = 4391571

collapsed_stack percent_time cycles_per_call nanoseconds_per_call
main 100.00 3370520103.64 1455429780.19
demikernel::socket;catnap::linux::transport::socket 97.81 56622.82 24770.53
ioc::network::libos::close;catnap::linux::transport::close 95.82 21532.48 9425.51
demikernel::listen;catnap::linux::transport::listen 91.25 12702.16 5577.89
demikernel::bind;catnap::linux::transport::bind 81.20 24092.70 10572.90
ioc::network::libos::accept 43.47 929826160.54 407931771.05
bgc::catnap::transport::epoll 33.89 2215.17 975.57
ioc::network::libos::pop 25.19 3773935.47 1657080.20
ioc::network::libos::connect 24.60 4656469.45 2042701.35
ioc::network::libos::pushto 22.80 8916.31 3908.07
ioc::network::libos::push 6.90 17718.86 7813.75
ioc::network::libos::pushto;catnap::linux::transport::push 6.29 547.39 239.65
ioc::network::libos::push;catnap::linux::transport::push 4.61 777.23 341.20
ioc::network::libos::pop;catnap::linux::transport::pop 2.24 522.73 229.78
ioc::network::libos::connect;catnap::linux::transport::connect 1.70 51188.75 22362.03
demikernel::pushto 1.26 436.63 191.16
demikernel::new 0.55 1592609.97 699296.29
demikernel::push 0.23 605.21 266.41
demikernel::sgaalloc 0.19 213.69 93.39
demikernel::pop 0.15 694.08 304.27
demikernel::socket 0.08 57861.33 25312.99
ioc::network::libos::close 0.05 22555.82 9874.56
demikernel::sgafree 0.04 79.57 35.04
demikernel::bind 0.01 29746.82 13054.14
demikernel::connect 0.01 2021.34 883.67
demikernel::async_close 0.01 829.82 353.00
demikernel::listen 0.00 13903.13 6104.23
ioc::network::libos::accept;catnap::linux::transport::accept 0.00 2641.44 1166.93
demikernel::accept 0.00 1655.74 727.73
demikernel::close 0.00 nan nan

@ppenna ppenna force-pushed the enhancement-catnip-prepend branch from 4391571 to 7d9c03d Compare July 16, 2024 15:57
@github-actions GitHub Actions
Copy link

libos = catpowder
commit id = 7d9c03d

collapsed_stack percent_time cycles_per_call nanoseconds_per_call
main 100.00 3333517985.00 1462543208.32
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::receive 78.26 7769.10 3392.10
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::receive 76.37 901.13 395.93
bgc::inetstack::poll_recv 61.65 1238.78 544.55
bgc::inetstack::tcp::established::background;tcp::established::background::receiver 32.03 1501.07 654.19
demikernel::new 27.94 92773935.38 40678475.40
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter 25.86 1193.13 522.73
bgc::inetstack::tcp::established::background;tcp::established::background::sender 19.05 809.13 354.23
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for;udp::receive 13.89 355.84 152.91
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger 7.89 348.34 152.40
bgc::inetstack::tcp::established::background 6.66 4202.18 1837.49
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for 4.41 59.65 26.30
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::for 4.35 400.73 175.22
ioc::network::libos::push 3.47 5946.66 2600.73
ioc::network::libos::pushto 2.10 5130.92 2233.85
ioc::network::libos::pop 1.10 942.12 410.79
demikernel::push 0.46 774.59 341.68
ioc::network::libos::connect 0.28 21914.57 9823.68
demikernel::sgaalloc 0.24 277.99 124.71
ioc::network::libos::close 0.21 10707.84 4757.98
demikernel::pushto 0.19 481.81 209.74
demikernel::pop 0.18 510.94 222.38
bgc::inetstack::poll_recv;inetstack::poll 0.04 9787.50 4277.88
demikernel::sgafree 0.04 82.99 36.32
bgc::inetstack::tcp::passiveopen::background 0.01 12624.18 5423.00
demikernel::connect 0.01 4471.15 1980.24
demikernel::async_close 0.01 663.96 295.98
demikernel::bind 0.00 10507.31 4568.92
demikernel::listen 0.00 5172.36 2222.51
bgc::passive_listening::poll 0.00 5025.95 2160.13
bgc::inetstack::icmp::background 0.00 2786.31 1225.34
ioc::network::libos::accept 0.00 2759.92 1182.68
bgc::inetstack::arp::background 0.00 2637.03 1149.88
demikernel::socket 0.00 1709.46 741.56
demikernel::accept 0.00 1237.21 532.22
demikernel::close 0.00 nan nan

@github-actions GitHub Actions
Copy link

libos = catnap
commit id = 7d9c03d

collapsed_stack percent_time cycles_per_call nanoseconds_per_call
main 100.00 3405895361.42 1535831110.75
demikernel::socket;catnap::linux::transport::socket 97.00 53323.71 24291.78
ioc::network::libos::close;catnap::linux::transport::close 95.68 22198.23 10156.97
demikernel::listen;catnap::linux::transport::listen 92.34 13725.08 6111.23
demikernel::bind;catnap::linux::transport::bind 80.95 23879.62 10735.64
ioc::network::libos::accept 43.17 913554074.61 402828317.17
bgc::catnap::transport::epoll 33.77 2346.80 1111.14
ioc::network::libos::pop 26.21 3349824.18 1622164.55
ioc::network::libos::pushto 23.52 8744.15 3911.73
ioc::network::libos::connect 22.80 3671830.09 1731179.90
ioc::network::libos::push 6.85 17896.86 8153.34
ioc::network::libos::pushto;catnap::linux::transport::push 6.51 556.28 249.25
ioc::network::libos::push;catnap::linux::transport::push 4.79 806.84 364.69
ioc::network::libos::pop;catnap::linux::transport::pop 2.21 517.21 236.67
ioc::network::libos::connect;catnap::linux::transport::connect 2.09 53848.48 25591.46
demikernel::pushto 1.27 428.59 192.20
demikernel::new 0.53 1599223.10 730275.61
demikernel::sgaalloc 0.25 264.22 125.32
demikernel::push 0.23 620.59 281.33
demikernel::pop 0.15 685.10 313.39
demikernel::socket 0.09 55103.77 25101.10
ioc::network::libos::close 0.07 23272.03 10648.05
demikernel::sgafree 0.04 78.91 36.90
demikernel::async_close 0.02 1019.18 466.13
demikernel::bind 0.01 29495.80 13262.51
demikernel::connect 0.01 2123.40 1016.78
demikernel::listen 0.00 14844.05 6612.44
ioc::network::libos::accept;catnap::linux::transport::accept 0.00 2991.62 1332.55
demikernel::accept 0.00 1659.15 735.60
demikernel::close 0.00 nan nan

@iyzhang iyzhang force-pushed the enhancement-catnip-prepend branch from 7d9c03d to 9e21d24 Compare July 16, 2024 17:17
@github-actions GitHub Actions
Copy link

libos = catpowder
commit id = 9e21d24

collapsed_stack percent_time cycles_per_call nanoseconds_per_call
main 100.00 3464178545.16 1505123959.67
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::receive 76.46 904.74 392.39
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::receive 75.45 6768.80 2926.19
bgc::inetstack::poll_recv 60.78 1252.14 543.37
bgc::inetstack::tcp::established::background;tcp::established::background::receiver 31.86 1558.71 669.63
demikernel::new 28.66 93686194.95 40511205.41
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter 25.15 1155.95 501.93
bgc::inetstack::tcp::established::background;tcp::established::background::sender 19.88 846.12 367.60
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for;udp::receive 14.97 360.39 155.94
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger 7.75 341.26 148.16
bgc::inetstack::tcp::established::background 6.69 4271.77 1847.03
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::for 5.53 486.00 208.99
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for 4.39 59.21 25.79
ioc::network::libos::push 3.58 6059.57 2644.94
ioc::network::libos::pushto 2.79 5837.18 2512.01
ioc::network::libos::pop 1.20 954.25 413.77
demikernel::push 0.43 748.86 325.68
demikernel::sgaalloc 0.29 349.80 155.10
ioc::network::libos::connect 0.25 24299.47 10685.99
demikernel::pushto 0.24 507.93 218.97
ioc::network::libos::close 0.18 10532.25 4576.35
demikernel::pop 0.17 495.90 214.14
demikernel::sgafree 0.04 80.62 35.07
bgc::inetstack::poll_recv;inetstack::poll 0.03 8938.73 3864.19
bgc::inetstack::tcp::passiveopen::background 0.01 11963.80 5119.84
demikernel::connect 0.01 4485.58 1980.16
demikernel::async_close 0.01 661.01 281.64
demikernel::bind 0.00 10266.75 4394.52
demikernel::listen 0.00 5244.79 2251.72
bgc::passive_listening::poll 0.00 4896.02 2092.97
bgc::inetstack::icmp::background 0.00 2863.72 1240.11
bgc::inetstack::arp::background 0.00 2749.12 1185.49
ioc::network::libos::accept 0.00 2532.41 1082.57
demikernel::socket 0.00 2485.06 1079.39
demikernel::accept 0.00 1352.50 578.51
demikernel::close 0.00 nan nan

@github-actions GitHub Actions
Copy link

libos = catnap
commit id = 9e21d24

collapsed_stack percent_time cycles_per_call nanoseconds_per_call
main 100.00 3385291885.62 1492891269.14
demikernel::socket;catnap::linux::transport::socket 97.22 54170.24 23888.66
ioc::network::libos::close;catnap::linux::transport::close 95.73 21993.96 9704.50
demikernel::listen;catnap::linux::transport::listen 91.33 12754.61 5617.21
demikernel::bind;catnap::linux::transport::bind 81.05 25037.80 10994.43
ioc::network::libos::accept 43.30 903105804.59 398407893.67
bgc::catnap::transport::epoll 33.80 2208.76 976.33
ioc::network::libos::pop 25.80 3813891.96 1667257.37
ioc::network::libos::connect 23.98 5670814.45 2468219.61
ioc::network::libos::pushto 23.13 9114.49 4001.80
ioc::network::libos::pushto;catnap::linux::transport::push 6.91 615.42 270.05
ioc::network::libos::push 6.75 17554.74 7753.25
ioc::network::libos::push;catnap::linux::transport::push 4.75 783.33 346.40
ioc::network::libos::pop;catnap::linux::transport::pop 2.19 505.61 221.91
ioc::network::libos::connect;catnap::linux::transport::connect 2.03 54940.43 24520.24
demikernel::pushto 1.23 439.99 193.09
demikernel::new 0.50 1598218.73 703918.73
demikernel::push 0.21 604.49 268.36
demikernel::sgaalloc 0.21 241.88 107.65
demikernel::pop 0.16 691.21 303.34
demikernel::socket 0.09 55829.07 24629.97
ioc::network::libos::close 0.07 23057.88 10174.63
demikernel::sgafree 0.04 77.51 34.07
demikernel::bind 0.01 30854.15 13556.32
demikernel::connect 0.01 2212.11 989.86
demikernel::async_close 0.01 866.88 379.39
demikernel::listen 0.00 14031.74 6180.44
ioc::network::libos::accept;catnap::linux::transport::accept 0.00 2883.82 1260.21
demikernel::accept 0.00 1692.93 743.48
demikernel::close 0.00 nan nan

@iyzhang iyzhang force-pushed the enhancement-catnip-prepend branch from 9e21d24 to 171099c Compare July 18, 2024 02:50
@iyzhang iyzhang closed this Jul 18, 2024
@iyzhang
Copy link
Contributor

iyzhang commented Jul 18, 2024

Creating new one

@github-actions GitHub Actions
Copy link

libos = catnap
commit id = 171099c

collapsed_stack percent_time cycles_per_call nanoseconds_per_call
udp-push-pop::main;demikernel::new inf 1660783.00 738583.08
tcp-push-pop::main;demikernel::new inf 1627419.00 703573.83
udp-ping-pong::main;demikernel::new inf 1598033.00 695238.40
tcp-wait::main;demikernel::new inf 1589284.17 690196.19
tcp-ping-pong::main;demikernel::new inf 1583709.00 666738.99
tcp-close::main;demikernel::new inf 1572381.50 690873.49
tcp-close::main;demikernel::socket inf 81961.00 36002.65
tcp-ping-pong::main;demikernel::socket inf 81405.00 34297.75
tcp-push-pop::main;demikernel::socket inf 78746.00 34042.62
udp-push-pop::main;demikernel::socket inf 78420.00 34880.22
udp-ping-pong::main;demikernel::socket inf 78257.00 34056.94
tcp-wait::main;demikernel::socket inf 74132.33 32195.93
tcp-close::main;demikernel::bind inf 35560.50 15563.57
udp-push-pop::main;demikernel::bind inf 33892.00 15075.66
tcp-wait::main;demikernel::bind inf 31882.33 13907.10
udp-ping-pong::main;demikernel::bind inf 29888.00 13008.75
tcp-push-pop::main;demikernel::bind inf 29650.00 12792.04
tcp-ping-pong::main;demikernel::bind inf 28912.00 12472.14
tcp-ping-pong::main;demikernel::connect inf 5858.00 2409.49
tcp-wait::main;demikernel::connect inf 5844.33 2527.94
tcp-push-pop::main;demikernel::connect inf 5564.00 2410.09
tcp-close::main;demikernel::connect inf 5210.50 2295.46
tcp-echo::main 100.00 3340218040.95 1490115756.05
udp-ping-pong::main;demikernel::socket;catnap::linux::transport::socket 98.01 76700.00 33379.60
tcp-push-pop::main;demikernel::socket;catnap::linux::transport::socket 97.59 76845.00 33220.59
tcp-ping-pong::main;demikernel::socket;catnap::linux::transport::socket 97.57 79431.00 33462.99
udp-push-pop::main;demikernel::socket;catnap::linux::transport::socket 97.46 76445.00 34001.89
tcp-close::main;demikernel::socket;catnap::linux::transport::socket 97.39 79958.50 35122.28
demikernel::socket;catnap::linux::transport::socket 97.25 51623.71 23356.95
tcp-wait::main;demikernel::socket;catnap::linux::transport::socket 96.44 71388.00 31008.69
ioc::network::libos::close;catnap::linux::transport::close 96.07 22544.96 10136.29
demikernel::listen;catnap::linux::transport::listen 92.28 12682.82 5667.89
tcp-push-pop::main;demikernel::bind;catnap::linux::transport::bind 82.56 24480.00 10561.52
udp-ping-pong::main;demikernel::bind;catnap::linux::transport::bind 81.18 24244.00 10551.35
demikernel::bind;catnap::linux::transport::bind 81.03 22906.66 10287.93
udp-push-pop::main;demikernel::bind;catnap::linux::transport::bind 79.80 27015.00 12016.49
tcp-wait::main;demikernel::bind;catnap::linux::transport::bind 76.77 23884.33 10419.47
tcp-ping-pong::main;demikernel::bind;catnap::linux::transport::bind 76.22 22036.00 9505.96
tcp-close::main;demikernel::bind;catnap::linux::transport::bind 73.53 25668.00 11234.50
ioc::network::libos::accept 43.06 904837900.77 402015841.49
bgc::catnap::transport::epoll 33.44 2518.53 1182.19
ioc::network::libos::pushto 26.27 9598.32 4197.73
ioc::network::libos::pop 26.12 4216923.72 1839060.17
ioc::network::libos::connect 24.71 4588046.72 2109507.92
ioc::network::libos::push 6.95 17673.52 8059.21
ioc::network::libos::pushto;catnap::linux::transport::push 6.09 563.01 246.73
ioc::network::libos::push;catnap::linux::transport::push 4.88 816.64 374.87
ioc::network::libos::pop;catnap::linux::transport::pop 2.25 529.28 237.68
ioc::network::libos::connect;catnap::linux::transport::connect 2.09 55889.60 25434.70
demikernel::pushto 1.38 441.63 193.49
demikernel::new 0.24 1612270.25 733203.64
demikernel::push 0.23 580.53 264.28
demikernel::sgaalloc 0.22 264.49 127.61
demikernel::pop 0.15 673.55 302.08
demikernel::socket 0.10 53217.09 24076.47
ioc::network::libos::close 0.07 23550.22 10590.49
demikernel::sgafree 0.04 80.99 36.73
demikernel::async_close 0.02 903.07 393.75
demikernel::connect 0.01 1793.08 824.75
demikernel::bind 0.00 28327.31 12730.53
demikernel::listen 0.00 13753.76 6148.04
ioc::network::libos::accept;catnap::linux::transport::accept 0.00 2931.12 1299.60
demikernel::accept 0.00 1680.85 745.88
demikernel::close 0.00 nan nan
tcp-close::main 0.00 nan nan
tcp-ping-pong::main 0.00 nan nan
tcp-push-pop::main 0.00 nan nan
tcp-wait::main 0.00 nan nan
udp-ping-pong::main 0.00 nan nan
udp-push-pop::main 0.00 nan nan

@github-actions GitHub Actions
Copy link

libos = catpowder
commit id = 171099c

collapsed_stack percent_time cycles_per_call nanoseconds_per_call
udp-push-pop::main;demikernel::new inf 122336279.50 53235056.78
tcp-push-pop::main;demikernel::new inf 92940755.00 40365043.88
udp-ping-pong::main;demikernel::new inf 92207556.00 39927694.09
tcp-wait::main;demikernel::new inf 91345666.00 40403286.14
tcp-ping-pong::main;demikernel::new inf 90809296.00 39413036.24
tcp-close::main;demikernel::new inf 75848240.62 33547087.90
tcp-close::main;demikernel::connect inf 9366.50 4311.11
tcp-wait::main;demikernel::connect inf 8689.00 3834.94
tcp-wait::main;demikernel::bind inf 8443.33 3763.21
tcp-push-pop::main;demikernel::bind inf 8160.00 3598.97
udp-ping-pong::main;demikernel::bind inf 8145.00 3515.87
tcp-close::main;demikernel::bind inf 8132.00 3506.51
tcp-ping-pong::main;demikernel::bind inf 7572.00 3265.97
udp-push-pop::main;demikernel::bind inf 7046.00 3065.47
tcp-push-pop::main;demikernel::connect inf 6436.00 2742.88
tcp-ping-pong::main;demikernel::connect inf 5442.00 2373.33
tcp-wait::main;demikernel::socket inf 4150.00 1879.17
udp-push-pop::main;demikernel::socket inf 2113.00 918.98
tcp-close::main;demikernel::socket inf 1798.50 792.12
udp-ping-pong::main;demikernel::socket inf 1504.00 650.46
tcp-ping-pong::main;demikernel::socket inf 1476.00 640.26
tcp-push-pop::main;demikernel::socket inf 1362.00 590.27
tcp-echo::main 100.00 3479229540.81 1529990975.32
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::receive 78.69 7048.33 3190.45
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::receive 76.51 915.18 411.56
bgc::inetstack::poll_recv 74.27 1256.46 565.46
ioc::network::libos::pushto 48.38 5805.13 2508.15
bgc::inetstack::tcp::established::background;tcp::established::background::receiver 31.91 1462.03 657.29
bgc::inetstack::tcp::established::background;tcp::established::background::retransmitter 25.50 1157.76 531.70
demikernel::new 20.59 94688763.44 43197740.17
bgc::inetstack::tcp::established::background;tcp::established::background::sender 18.76 795.72 362.08
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for;udp::receive 10.06 360.82 156.68
bgc::inetstack::tcp::established::background;tcp::established::background::acknowledger 7.93 347.93 159.25
bgc::inetstack::tcp::established::background 7.06 4116.25 1869.94
bgc::inetstack::poll_recv;inetstack::poll;inetstack::poll_bg_work::for::for 4.93 408.30 182.53
bgc::inetstack::poll_recv;inetstack::poll_bg_work::for::for 4.40 60.41 27.34
ioc::network::libos::push 4.24 6136.52 2784.34
demikernel::pushto 3.65 460.04 198.82
ioc::network::libos::pop 1.16 974.25 446.42
ioc::network::libos::connect 0.85 24280.05 10893.43
ioc::network::libos::close 0.72 10130.04 4546.85
demikernel::push 0.59 815.84 369.43
demikernel::sgaalloc 0.37 311.54 135.33
demikernel::pop 0.18 503.72 227.13
demikernel::sgafree 0.07 78.90 35.66
demikernel::async_close 0.05 656.97 291.31
demikernel::connect 0.03 3402.28 1488.19
bgc::inetstack::poll_recv;inetstack::poll 0.02 8908.17 4033.60
bgc::inetstack::tcp::passiveopen::background 0.01 11977.59 5414.76
demikernel::socket 0.01 1034.04 466.16
demikernel::bind 0.00 12258.88 5580.11
bgc::passive_listening::poll 0.00 4947.59 2239.52
demikernel::listen 0.00 4559.21 2050.68
bgc::inetstack::icmp::background 0.00 2851.63 1283.03
bgc::inetstack::arp::background 0.00 2579.88 1160.70
ioc::network::libos::accept 0.00 2552.34 1151.52
demikernel::accept 0.00 1207.47 545.86
demikernel::close 0.00 nan nan
tcp-close::main 0.00 nan nan
tcp-ping-pong::main 0.00 nan nan
tcp-push-pop::main 0.00 nan nan
tcp-wait::main 0.00 nan nan
udp-ping-pong::main 0.00 nan nan
udp-push-pop::main 0.00 nan nan

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@ppenna ppenna ppenna requested changes

Assignees

@ppenna ppenna

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

[catnip] Prepend Headers into DPDK MBufs when Possible and Appropriate
3 participants
@carvalhof @iyzhang @ppenna