[Artery] Compression table keeps temporary refs

[manuelbernhardt]

Not sure this belongs here, but it seems kind of odd.

In a current experiment of mine involving large clusters, I'm using Artery TCP as a transport and make calls from one system to another using actor selections + ask.

While debugging, I'm noticing that the compression table advertises those references every minute:

14:57:23 DEBUG akka.remote.artery.tcp.ArteryTcpTransport [ArteryTcpTransport(akka://ClusterSystem)] - Incoming ActorRef compression advertisement from [akka://ClusterSystem@127.0.0.1:25520#3106178554564488869], table: [CompressionTable(2426606393749214750,7,HashMap(Actor[akka://ClusterSystem/temp/$Ky] -> 918, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$qd] -> 69, Actor[akka://ClusterSystem/temp/$rg] -> 1254, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$cF] -> 2048, Actor[akka://ClusterSystem/temp/$mw] -> 438, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$xF] -> 1027, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Fy] -> 226, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Nw] -> 1778, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$tb] -> 1093, Actor[akka://ClusterSystem/temp/$Eu] -> 210, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Hs] -> 1644, Actor[akka://ClusterSystem/temp/$kg] -> 1251, Actor[akka://ClusterSystem/temp/$+r] -> 404, Actor[akka://ClusterSystem/temp/$3t] -> 419, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Wk] -> 41, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$4E] -> 2042, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$kh] -> 1283, Actor[akka://ClusterSystem/temp/$Cy] -> 916, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Hy] -> 1838, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$3p] -> 1, Actor[akka://ClusterSystem/temp/$Ff] -> 1229, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$zx] -> 1803, Actor[akka://ClusterSystem/temp/$in] -> 735, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$zg] -> 1258, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$5w] -> 1784, Actor[akka://ClusterSystem/temp/$4c] -> 1145, Actor[akka://ClusterSystem/temp/$nE] -> 2019, Actor[akka://ClusterSystem/temp/$jF] -> 1024, Actor[akka://ClusterSystem/temp/$wG] -> 1042, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$no] -> 374, Actor[akka://ClusterSystem/temp/$My] -> 1841, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$t] -> 530, Actor[akka://ClusterSystem/temp/$zr] -> 803, Actor[akka://ClusterSystem/temp/$rd] -> 1158, Actor[akka://ClusterSystem/temp/$yw] -> 883, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Js] -> 1647, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$3l] -> 714, Actor[akka://ClusterSystem/temp/$G] -> 531, Actor[akka://ClusterSystem/temp/$nu] -> 422, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Py] -> 919, Actor[akka://ClusterSystem/temp/$8f] -> 1244, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Wz] -> 27, Actor[akka://ClusterSystem/temp/$lp] -> 382, Actor[akka://ClusterSystem/temp/$tx] -> 898, Actor[akka://ClusterSystem/temp/$gj] -> 333, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$KC] -> 982, Actor[akka://ClusterSystem/temp/$wu] -> 423, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$sG] -> 2085, Actor[akka://ClusterSystem/temp/$pB] -> 1926, Actor[akka://ClusterSystem/temp/$Th] -> 78, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Ow] -> 887, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$do] -> 1503, Actor[akka://ClusterSystem/temp/$Fu] -> 1709, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Ig] -> 629, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Dt] -> 1674, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Pm] -> 727, Actor[akka://ClusterSystem/temp/$Kw] -> 441, Actor[akka://ClusterSystem/temp/$GG] -> 2091, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$kw] -> 1763, Actor[akka://ClusterSystem/temp/$uE] -> 503, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$+q] -> 796, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$be] -> 144, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$eF] -> 509, Actor[akka://ClusterSystem/temp/$RB] -> 239, Actor[akka://ClusterSystem/temp/$Yz] -> 937, Actor[akka://ClusterSystem/temp/$kd] -> 1155, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Mh] -> 1297, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Il] -> 1423, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$~F] -> 1036, Actor[akka://ClusterSystem/temp/$X] -> 31, Actor[akka://ClusterSystem/temp/$bn] -> 733, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$jk] -> 1378, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$hB] -> 1919, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Wf] -> 36, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$xl] -> 1417, Actor[akka://ClusterSystem/temp/$Bt] -> 836, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Si] -> 1332, Actor[akka://ClusterSystem/temp/$8u] -> 428, Actor[akka://ClusterSystem/temp/$xw] -> 1770, Actor[akka://ClusterSystem/temp/$Wo] -> 1526, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Sv] -> 434, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$oq] -> 784, Actor[akka://ClusterSystem/temp/$md] -> 576, Actor[akka://ClusterSystem/temp/$~w] -> 1790, Actor[akka://ClusterSystem/temp/$Rp] -> 191, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$if] -> 1217, Actor[akka://ClusterSystem/temp/$nw] -> 217, Actor[akka://ClusterSystem/temp/$Nq] -> 1585, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$rx] -> 897, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$fn] -> 734, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$0b] -> 1110, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$5h] -> 1302, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Ls] -> 822, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$JC] -> 1968, Actor[akka://ClusterSystem/temp/$Fk] -> 1389, Actor[akka://ClusterSystem/temp/$Eg] -> 154, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$ri] -> 79, Actor[akka://ClusterSystem/temp/$er] -> 1600, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$3i] -> 666, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Ze] -> 1206, Actor[akka://ClusterSystem/temp/$aC] -> 1950, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$yn] -> 1482, Actor[akka://ClusterSystem/temp/$qh] -> 1286, Actor[akka://ClusterSystem/temp/$qr] -> 1605, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$UC] -> 120, Actor[akka://ClusterSystem/temp/$IE] -> 1014, Actor[akka://ClusterSystem/temp/$OA] -> 1907, Actor[akka://ClusterSystem/temp/$mm] -> 720, Actor[akka://ClusterSystem/temp/$sj] -> 673, Actor[akka://ClusterSystem/temp/$CD] -> 246, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Jq] -> 789, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$cy] -> 1822, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Zt] -> 1686, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$ct] -> 829, Actor[akka://ClusterSystem/temp/$9d] -> 1180, Actor[akka://ClusterSystem/temp/$5y] -> 923, Actor[akka://ClusterSystem/temp/$hF] -> 2051, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$9r] -> 1628, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$qE] -> 2022, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$HD] -> 1999, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$3d] -> 1176, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$fi] -> 1311, Actor[akka://ClusterSystem/temp/$HB] -> 1936, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$QD] -> 247, Actor[akka://ClusterSystem/temp/$Rf] -> 616, Actor[akka://ClusterSystem/temp/$o] -> 527, Actor[akka://ClusterSystem/temp/$Zi] -> 665, Actor[akka://ClusterSystem/temp/$ez] -> 926, Actor[akka://ClusterSystem/temp/$2e] -> 602, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$lG] -> 1039, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Ui] -> 330, Actor[akka://ClusterSystem/temp/$6y] -> 1851, Actor[akka://ClusterSystem/temp/$vu] -> 850, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Vm] -> 1459, Actor[akka://ClusterSystem/temp/$st] -> 1671, Actor[akka://ClusterSystem/temp/$Ys] -> 825, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$TC] -> 243, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Jc] -> 1133, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$tE] -> 2024, Actor[akka://ClusterSystem/temp/$+B] -> 240, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$4c] -> 569, Actor[akka://ClusterSystem/temp/$Sc] -> 568, Actor[akka://ClusterSystem/temp/$hl] -> 1410, Actor[akka://ClusterSystem/temp/$VA] -> 1909, Actor[akka://ClusterSystem/system/cluster/core/daemon/messaging#-1066641984] -> 1046, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$k] -> 1052, Actor[akka://ClusterSystem/temp/$VD] -> 2005, Actor[akka://ClusterSystem/temp/$Kt] -> 417, Actor[akka://ClusterSystem/temp/$mE] -> 2020, Actor[akka://ClusterSystem/temp/$pe] -> 145, Actor[akka://ClusterSystem/temp/$5q] -> 1594, Actor[akka://ClusterSystem/temp/$Os] -> 823, Actor[akka://ClusterSystem/temp/$yE] -> 2027, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$vj] -> 1352, Actor[akka://ClusterSystem/temp/$Ly] -> 457, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Oj] -> 1362, Actor[akka://ClusterSystem/temp/$pb] -> 65, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$9o] -> 380, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$6m] -> 731, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$pC] -> 119, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Jl] -> 1424, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Em] -> 360, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Dk] -> 692, Actor[akka://ClusterSystem/temp/$zD] -> 1996, Actor[akka://ClusterSystem/temp/$~] -> 268, Actor[akka://ClusterSystem/temp/$8q] -> 1596, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$4] -> 538, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$aD] -> 1982, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$lq] -> 1568, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$bB] -> 957, Actor[akka://ClusterSystem/temp/$uA] -> 946, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$3f] -> 1237, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$dD] -> 1984, Actor[akka://ClusterSystem/temp/$wz] -> 1865, Actor[akka://ClusterSystem/temp/$Ie] -> 597, Actor[akka://ClusterSystem/temp/$iF] -> 2052, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$bl] -> 1404, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Ju] -> 424, Actor[akka://ClusterSystem/temp/$Gz] -> 933, Actor[akka://ClusterSystem/temp/$Ev] -> 1741, Actor[akka://ClusterSystem/temp/$qt] -> 1670, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$NE] -> 1015, Actor[akka://ClusterSystem/temp/$Ay] -> 1835, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$hG] -> 2077, Actor[akka://ClusterSystem/temp/$Ni] -> 1329, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$2n] -> 746, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Mz] -> 1873, Actor[akka://ClusterSystem/temp/$it] -> 831, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$1b] -> 553, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Eb] -> 547, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$sE] -> 2023, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$fs] -> 1632, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$zi] -> 1321, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Zw] -> 1783, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$5x] -> 1817, Actor[akka://ClusterSystem/temp/$JG] -> 520, Actor[akka://ClusterSystem/temp/$qc] -> 67, Actor[akka://ClusterSystem/temp/$8i] -> 1340, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$A] -> 532, Actor[akka://ClusterSystem/temp/$7C] -> 988, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$ju] -> 1698, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$rE] -> 1009, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$L] -> 1071, Actor[akka://ClusterSystem/temp/$sb] -> 1094, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$su] -> 1702, Actor[akka://ClusterSystem/temp/$St] -> 207, Actor[akka://ClusterSystem/temp/$yt] -> 835, Actor[akka://ClusterSystem/temp/$Gu] -> 1710, Actor[akka://ClusterSystem/temp/$Uj] -> 82, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$yf] -> 1223, Actor[akka://ClusterSystem/temp/$0x] -> 1815, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Cf] -> 1228, Actor[akka://ClusterSystem/temp/$zh] -> 1291, Actor[akka://ClusterSystem/temp/$Gr] -> 1614, Actor[akka://ClusterSystem/temp/$jl] -> 1411, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$XE] -> 1017, Actor[akka://ClusterSystem/temp/$Uo] -> 45, Actor[akka://ClusterSystem/temp/$Zp] -> 1558, Actor[akka://ClusterSystem/temp/$Pp] -> 776, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$nj] -> 672, Actor[akka://ClusterSystem/temp/$UF] -> 14, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$XB] -> 1941, Actor[akka://ClusterSystem/temp/$Wd] -> 34, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$LE] -> 2033, Actor[akka://ClusterSystem/temp/$Nd] -> 1170, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$jo] -> 1504, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$lo] -> 1508, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$pz] -> 1859, Actor[akka://ClusterSystem/temp/$Sr] -> 402, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$tG] -> 2086, Actor[akka://ClusterSystem/temp/$bd] -> 1150, Actor[akka://ClusterSystem/temp/$zB] -> 1932, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Eh] -> 158, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Ew] -> 218, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$uB] -> 962, Actor[akka://ClusterSystem/temp/$Bg] -> 1260, Actor[akka://ClusterSystem/temp/$cB] -> 1920, Actor[akka://ClusterSystem/temp/$0m] -> 1464, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$zl] -> 707, Actor[akka://ClusterSystem/temp/$Vq] -> 96, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Bx] -> 900, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Au] -> 851, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$rp] -> 769, Actor[akka://ClusterSystem/temp/$gc] -> 558, Actor[akka://ClusterSystem/temp/$po] -> 1509, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$5u] -> 1722, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$IF] -> 1030, Actor[akka://ClusterSystem/temp/$0E] -> 507, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$B] -> 264, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$7B] -> 1947, Actor[akka://ClusterSystem/temp/$2r] -> 810, Actor[akka://ClusterSystem/temp/$NA] -> 951, Actor[akka://ClusterSystem/temp/$k] -> 261, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Lm] -> 1453, Actor[akka://ClusterSystem/temp/$tl] -> 1415, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$No] -> 1519, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$~] -> 1084, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Tg] -> 314, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$ae] -> 292, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$lh] -> 1284, Actor[akka://ClusterSystem/temp/$Ce] -> 1196, Actor[akka://ClusterSystem/temp/$cw] -> 1759, Actor[akka://ClusterSystem/temp/$Ng] -> 1266, Actor[akka://ClusterSystem/temp/$Wt] -> 11, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$IC] -> 1967, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$gu] -> 846, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$KE] -> 505, Actor[akka://ClusterSystem/temp/$Ns] -> 1650, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Zl] -> 86, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$RD] -> 122, Actor[akka://ClusterSystem/temp/$To] -> 92, Actor[akka://ClusterSystem/temp/$YC] -> 1975, Actor[akka://ClusterSystem/temp/$ms] -> 816, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Ck] -> 1388, Actor[akka://ClusterSystem/temp/$UA] -> 57, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$qi] -> 161, Actor[akka://ClusterSystem/temp/$3e] -> 299, Actor[akka://ClusterSystem/temp/$f] -> 1054, Actor[akka://ClusterSystem/temp/$yj] -> 1354, Actor[akka://ClusterSystem/temp/$Eq] -> 392, Actor[akka://ClusterSystem/temp/$QC] -> 984, Actor[akka://ClusterSystem/temp/$wB] -> 1930, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$5p] -> 387, Actor[akka://ClusterSystem/temp/$al] -> 1406, Actor[akka://ClusterSystem/temp/$Fs] -> 1645, Actor[akka://ClusterSystem/temp/$1h] -> 1303, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$AE] -> 2028, Actor[akka://ClusterSystem/temp/$6o] -> 1532, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Xp] -> 4, Actor[akka://ClusterSystem/temp/$8n] -> 748, Actor[akka://ClusterSystem/temp/$cr] -> 797, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$ty] -> 225, Actor[akka://ClusterSystem/temp/$zj] -> 675, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Wh] -> 18, Actor[akka://ClusterSystem/temp/$rF] -> 2056, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Rt] -> 840, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$1C] -> 1973, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Oy] -> 1842, Actor[akka://ClusterSystem/temp/$Ij] -> 1359, Actor[akka://ClusterSystem/temp/$wc] -> 1128, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$od] -> 286, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Kf] -> 1232, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$9D] -> 500, Actor[akka://ClusterSystem/temp/$qy] -> 1829, Actor[akka://ClusterSystem/temp/$YE] -> 2040, Actor[akka://ClusterSystem/temp/$so] -> 1511, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Td] -> 290, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$K] -> 533, Actor[akka://ClusterSystem/temp/$vs] -> 818, Actor[akka://ClusterSystem/temp/$xB] -> 963, Actor[akka://ClusterSystem/temp/$wn] -> 1481, Actor[akka://ClusterSystem/temp/$Bb] -> 1099, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$7E] -> 1020, Actor[akka://ClusterSystem/temp/$bb] -> 132, Actor[akka://ClusterSystem/temp/$oB] -> 1925, Actor[akka://ClusterSystem/temp/$4o] -> 763, Actor[akka://ClusterSystem/temp/$fG] -> 2080, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$ar] -> 196, Actor[akka://ClusterSystem/temp/$bs] -> 1630, Actor[akka://ClusterSystem/temp/$4y] -> 1850, Actor[akka://ClusterSystem/temp/$Gm] -> 1454, Actor[akka://ClusterSystem/temp/$7g] -> 1276, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Zm] -> 729, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$LB] -> 965, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$hx] -> 1794, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$xy] -> 455, Actor[akka://ClusterSystem/temp/$1E] -> 2041, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$~D] -> 2013, Actor[akka://ClusterSystem/temp/$0c] -> 1143, Actor[akka://ClusterSystem/temp/$mz] -> 462, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$c] -> 1047, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$GD] -> 997, Actor[akka://ClusterSystem/temp/$Qx] -> 450, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Bw] -> 439, Actor[akka://ClusterSystem/temp/$aq] -> 192, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$ic] -> 277, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Ft] -> 1677, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$dn] -> 364, Actor[akka://ClusterSystem/temp/$UD] -> 2003, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$cb] -> 1085, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Oh] -> 647, Actor[akka://ClusterSystem/temp/$Ag] -> 1259, Actor[akka://ClusterSystem/temp/$oc] -> 278, Actor[akka://ClusterSystem/temp/$Je] -> 1199, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$8e] -> 1211, Actor[akka://ClusterSystem/temp/$tv] -> 1736, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Ec] -> 564, Actor[akka://ClusterSystem/temp/$6l] -> 715, Actor[akka://ClusterSystem/temp/$sg] -> 625, Actor[akka://ClusterSystem/temp/$xm] -> 1449, Actor[akka://ClusterSystem/temp/$gv] -> 1729, Actor[akka://ClusterSystem/temp/$XC] -> 985, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Tk] -> 1394, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$nt] -> 414, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$qk] -> 83, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Lz] -> 465, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$+D] -> 248, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$VC] -> 59, Actor[akka://ClusterSystem/temp/$7s] -> 1660, Actor[akka://ClusterSystem/temp/$Oi] -> 1330, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$gk] -> 686, Actor[akka://ClusterSystem/temp/$Pk] -> 1395, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Nm] -> 1457, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$rf] -> 1221, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$ed] -> 1151, Actor[akka://ClusterSystem/temp/$qG] -> 127, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$qz] -> 1861, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$0D] -> 2008, Actor[akka://ClusterSystem/temp/$Vo] -> 1525, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Is] -> 821, Actor[akka://ClusterSystem/temp/$et] -> 830, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$wF] -> 2058, Actor[akka://ClusterSystem/temp/$ow] -> 107, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$9y] -> 924, Actor[akka://ClusterSystem/temp/$HE] -> 2032, Actor[akka://ClusterSystem/temp/$Kj] -> 678, Actor[akka://ClusterSystem/temp/$oD] -> 1989, Actor[akka://ClusterSystem/temp/$2w] -> 1785, Actor[akka://ClusterSystem/temp/$cE] -> 2016, Actor[akka://ClusterSystem/temp/$4A] -> 955, Actor[akka://ClusterSystem/temp/$Lv] -> 1745, Actor[akka://ClusterSystem/temp/$iA] -> 943, Actor[akka://ClusterSystem/temp/$Nn] -> 743, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Sb] -> 1108, Actor[akka://ClusterSystem/temp/$F] -> 1066, Actor[akka://ClusterSystem/temp/$3y] -> 1849, Actor[akka://ClusterSystem/temp/$9x] -> 908, Actor[akka://ClusterSystem/temp/$ku] -> 1699, Actor[akka://ClusterSystem/temp/$eG] -> 2079, Actor[akka://ClusterSystem/temp/$hA] -> 1890, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Cm] -> 1452, Actor[akka://ClusterSystem/temp/$qv] -> 1734, Actor[akka://ClusterSystem/temp/$cp] -> 1536, Actor[akka://ClusterSystem/temp/$P] -> 534, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$5f] -> 1241, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$De] -> 295, Actor[akka://ClusterSystem/temp/$2h] -> 1304, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Om] -> 1458, Actor[akka://ClusterSystem/temp/$0u] -> 1720, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$ik] -> 1377, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Bd] -> 1163, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$fg] -> 1248, Actor[akka://ClusterSystem/temp/$ld] -> 1156, Actor[akka://ClusterSystem/temp/$9k] -> 348, Actor[akka://ClusterSystem/temp/$Ml] -> 1426, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Ob] -> 1104, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Jp] -> 1549, Actor[akka://ClusterSystem/temp/$Tj] -> 167, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Lw] -> 1774, Actor[akka://ClusterSystem/temp/$Md] -> 289, Actor[akka://ClusterSystem/temp/$se] -> 1190, Actor[akka://ClusterSystem/temp/$td] -> 1159, Actor[akka://ClusterSystem/temp/$Cn] -> 368, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$~e] -> 300, Actor[akka://ClusterSystem/temp/$Od] -> 583, Actor[akka://ClusterSystem/temp/$Qw] -> 888, Actor[akka://ClusterSystem/temp/$YA] -> 1911, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$n] -> 1060, Actor[akka://ClusterSystem/temp/$4B] -> 1946, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$xx] -> 1799, Actor[akka://ClusterSystem/temp/$Se] -> 600, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$4z] -> 1881, Actor[akka://ClusterSystem/temp/$Dl] -> 174, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Ti] -> 664, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$lD] -> 992, Actor[akka://ClusterSystem/temp/$ij] -> 1346, Actor[akka://ClusterSystem/temp/$Mb] -> 273, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$vG] -> 2087, Actor[akka://ClusterSystem/temp/$WC] -> 1974, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$vm] -> 1448, Actor[akka://ClusterSystem/temp/$We] -> 35, Actor[akka://ClusterSystem/temp/$kp] -> 768, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$iB] -> 959, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$sB] -> 1927, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$fv] -> 862, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$by] -> 1821, Actor[akka://ClusterSystem/temp/$lf] -> 1220, Actor[akka://ClusterSystem/temp/$Xb] -> 15, Actor[akka://ClusterSystem/temp/$ji] -> 1314, Actor[akka://ClusterSystem/temp/$5e] -> 1210, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$nl] -> 350, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Bi] -> 659, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$cq] -> 1565, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Vk] -> 84, Actor[akka://ClusterSystem/temp/$he] -> 293, Actor[akka://ClusterSystem/temp/$gD] -> 1986, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Up] -> 46, Actor[akka://ClusterSystem/temp/$GB] -> 1935, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$my] -> 912, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Mf] -> 305, Actor[akka://ClusterSystem/temp/$Gs] -> 1646, Actor[akka://ClusterSystem/temp/$9i] -> 668, Actor[akka://ClusterSystem/temp/$sq] -> 1574, Actor[akka://ClusterSystem/temp/$8E] -> 252, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Kd] -> 1168, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$kD] -> 1988, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Sl] -> 354, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$th] -> 1287, Actor[akka://ClusterSystem/temp/$Jb] -> 1103, Actor[akka://ClusterSystem/temp/$Sy] -> 112, Actor[akka://ClusterSystem/temp/$9C] -> 244, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$ne] -> 1188, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$tr] -> 801, Actor[akka://ClusterSystem/temp/$Zx] -> 905, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$bt] -> 1662, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$FF] -> 1028, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Dr] -> 804, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$hp] -> 1538, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Kp] -> 385, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$qx] -> 1798, Actor[akka://ClusterSystem/temp/$ht] -> 1666, Actor[akka://ClusterSystem/temp/$ej] -> 1344, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$wb] -> 1096, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Ux] -> 54, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Pv] -> 870, Actor[akka://ClusterSystem/temp/$kF] -> 510, Actor[akka://ClusterSystem/temp/$~f] -> 152, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$dv] -> 1727, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Dh] -> 320, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Ph] -> 1299, Actor[akka://ClusterSystem/temp/$DA] -> 234, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Vx] -> 26, Actor[akka://ClusterSystem/temp/$Px] -> 904, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$fC] -> 974, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$tc] -> 1126, Actor[akka://ClusterSystem/temp/$l] -> 1057, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$ih] -> 1282, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$db] -> 541, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$ol] -> 173, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$tk] -> 689, Actor[akka://ClusterSystem/temp/$Yg] -> 633, Actor[akka://ClusterSystem/temp/$yy] -> 1834, Actor[akka://ClusterSystem/temp/$6b] -> 1114, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$CB] -> 480, Actor[akka://ClusterSystem/temp/$ax] -> 893, Actor[akka://ClusterSystem/temp/$5b] -> 1113, Actor[akka://ClusterSystem/temp/$7i] -> 1339, Actor[akka://ClusterSystem/temp/$Oq] -> 1586, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$pg] -> 153, Actor[akka://ClusterSystem/temp/$xf] -> 1225, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Vs] -> 100, Actor[akka://ClusterSystem/temp/$Gh] -> 645, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$di] -> 1308, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$oF] -> 2053, Actor[akka://ClusterSystem/temp/$qe] -> 71, Actor[akka://ClusterSystem/temp/$nf] -> 302, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$jp] -> 1539, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$xb] -> 546, Actor[akka://ClusterSystem/temp/$sD] -> 994, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$rr] -> 1604, Actor[akka://ClusterSystem/temp/$wr] -> 399, Actor[akka://ClusterSystem/temp/$Ov] -> 1747, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$vw] -> 882, Actor[akka://ClusterSystem/temp/$On] -> 1491, Actor[akka://ClusterSystem/temp/$0p] -> 777, Actor[akka://ClusterSystem/temp/$Gf] -> 1230, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$wq] -> 1576, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$0j] -> 681, Actor[akka://ClusterSystem/temp/$fc] -> 1120, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$tj] -> 334, Actor[akka://ClusterSystem/temp/$nG] -> 2084, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$+l] -> 716, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Mc] -> 566, Actor[akka://ClusterSystem/temp/$mk] -> 688, Actor[akka://ClusterSystem/temp/$0i] -> 1335, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Cp] -> 384, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$BE] -> 1012, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$pv] -> 105, Actor[akka://ClusterSystem/temp/$5o] -> 1531, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$tz] -> 1863, Actor[akka://ClusterSystem/temp/$+f] -> 308, Actor[akka://ClusterSystem/temp/$+d] -> 588, Actor[akka://ClusterSystem/temp/$Dq] -> 788, Actor[akka://ClusterSystem/temp/$pG] -> 257, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$zs] -> 1642, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Cc] -> 1131, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$mF] -> 253, Actor[akka://ClusterSystem/temp/$Sf] -> 306, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Iq] -> 1582, Actor[akka://ClusterSystem/temp/$ul] -> 1416, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$uw] -> 1768, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$wl] -> 351, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Rn] -> 1489, Actor[akka://ClusterSystem/temp/$Yn] -> 745, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Xf] -> 17, Actor[akka://ClusterSystem/temp/$fe] -> 1184, Actor[akka://ClusterSystem/temp/$1m] -> 730, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Rx] -> 1810, Actor[akka://ClusterSystem/temp/$Iy] -> 1839, Actor[akka://ClusterSystem/temp/$eu] -> 1696, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$hz] -> 1857, Actor[akka://ClusterSystem/temp/$Ty] -> 1844, Actor[akka://ClusterSystem/temp/$6n] -> 1499, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$9v] -> 1753, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$4i] -> 331, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Li] -> 1328, Actor[akka://ClusterSystem/temp/$kz] -> 1860, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$sk] -> 1382, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Rd] -> 1169, Actor[akka://ClusterSystem/temp/$v] -> 1061, Actor[akka://ClusterSystem/temp/$Fi] -> 162, Actor[akka://ClusterSystem/temp/$Co] -> 376, Actor[akka://ClusterSystem/temp/$yf] -> 1226, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$9A] -> 1914, Actor[akka://ClusterSystem/temp/$dE] -> 1006, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Vp] -> 22, Actor[akka://ClusterSystem/temp/$op] -> 1541, Actor[akka://ClusterSystem/temp/$Kc] -> 1136, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Kk] -> 1392, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Xt] -> 418, Actor[akka://ClusterSystem/temp/$I] -> 1067, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$nF] -> 125, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Rv] -> 872, Actor[akka://ClusterSystem/temp/$Uh] -> 38, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$lv] -> 429, Actor[akka://ClusterSystem/temp/$Xd] -> 7, Actor[akka://ClusterSystem/temp/$ye] -> 1193, Actor[akka://ClusterSystem/temp/$Av] -> 1740, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Dm] -> 724, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Rs] -> 409, Actor[akka://ClusterSystem/temp/$wE] -> 2026, Actor[akka://ClusterSystem/temp/$ch] -> 1279, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$xA] -> 1897, Actor[akka://ClusterSystem/temp/$ub] -> 1095, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Mk] -> 345, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$sp] -> 1543, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$ny] -> 454, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Jd] -> 1167, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$tB] -> 1928, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Nf] -> 1233, Actor[akka://ClusterSystem/temp/$6q] -> 795, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$3F] -> 2072, Actor[akka://ClusterSystem/temp/$Ke] -> 1200, Actor[akka://ClusterSystem/temp/$Zs] -> 1655, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$cl] -> 701, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Mp] -> 1554, Actor[akka://ClusterSystem/temp/$+u] -> 1724, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$He] -> 1197, Actor[akka://ClusterSystem/temp/$Wn] -> 1493, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$OD] -> 1000, Actor[akka://ClusterSystem/temp/$Ex] -> 1806, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Af] -> 611, Actor[akka://ClusterSystem/temp/$fo] -> 373, Actor[akka://ClusterSystem/temp/$3B] -> 1945, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$5n] -> 1498, Actor[akka://ClusterSystem/temp/$Sk] -> 346, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Dz] -> 464, Actor[akka://ClusterSystem/temp/$oE] -> 2021, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Xz] -> 1877, Actor[akka://ClusterSystem/temp/$az] -> 1854, Actor[akka://ClusterSystem/temp/$Yf] -> 1238, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Yh] -> 3, Actor[akka://ClusterSystem/temp/$Yu] -> 857, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$HF] -> 2064, Actor[akka://ClusterSystem/temp/$tF] -> 511, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Ln] -> 369, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$ir] -> 1601, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$PF] -> 2065, Actor[akka://ClusterSystem/temp/$fm] -> 718, Actor[akka://ClusterSystem/temp/$9E] -> 2045, Actor[akka://ClusterSystem/temp/$4h] -> 323, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$wj] -> 674, Actor[akka://ClusterSystem/temp/$4l] -> 1433, Actor[akka://ClusterSystem/temp/$Ik] -> 1391, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Tv] -> 215, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$oA] -> 233, Actor[akka://ClusterSystem/temp/$0h] -> 649, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Rb] -> 1107, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$0t] -> 841, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$NB] -> 967, Actor[akka://ClusterSystem/temp/$LF] -> 1031, Actor[akka://ClusterSystem/temp/$uf] -> 1224, Actor[akka://ClusterSystem/temp/$rD] -> 1991, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$xs] -> 1638, Actor[akka://ClusterSystem/temp/$li] -> 1315, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$Ro] -> 760, Actor[akka://ClusterSystem/temp/$vE] -> 2025, Actor[akka://ClusterSystem/temp/$Ms] -> 1649, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$qu] -> 103, Actor[akka://ClusterSystem/temp/$kE] -> 249, Actor[akka://ClusterSystem@127.0.0.1:25520/temp/$8y] -> 1852 (etc. etc.).

Just wondering - isn't this a waste? After all those references won't mean anything after the ask timeout, which often is much smaller than a minute.

[johanandren]

We fixed ask recently (#28528 ) but maybe there are more surprising temporary refs in some scenario?

[patriknw]

That fix was in 2.6.4

[manuelbernhardt]

Oh great. Thanks!

[manuelbernhardt]

Hmm, I was too trigger-happy closing this. I'm using the version that has this fix - or at least I've got that code in the codebase I'm deploying with. And I still observe all these temporary refs when receiving a compression advertisement.

This is the "heavy hitters" map / data structure which gets updated here I think, if I'm not mistaken.

[nodefactory-bk]

Will this be back ported to 2.5.x?

[patriknw]

We don't consider it as a critical bug so there is currently no plan to backport.

[nodefactory-bk]

I seem to still be getting cached PromiseActorRefs with akka 2.6.14.
A heap dump of a severely memory constrained app that crashed shows lots of PromiseActorRef's referenced from TopHeavyHitters.

This is a screenshot from memory analyzer:

Looking at git I can no longer find the change that added PromiseActorRef as not cacheable (pull request #28528), and in akka-remote/src/main/scala/akka/remote/serialization/ActorRefResolveCache.scala the isCacheable function seems not to know about PromiseActorRef.

[patriknw]

@nodefactory-bk There was a follow up in #29834 introducing InternalActorRef.isTemporaryRef.

Note that compression and TopHeavyHitters is a different thing than ActorRefResolveCache.

I agree that it seems unnecessary to fill the TopHeavyHitters with PromiseActorRef in the first place. Could you create a new issue about that?

Note that you can reduce the number of items in the TopHeavyHitters with config:

akka.remote.artery.advanced.compression.actor-refs.max