Description
Noticed this when trying to make a 1M sat payment today:
node_id: 031f2669adab71548fad4432277a0d90233e3bc07ac29cfb0b3e01bd3fb26cb9fa, short_channel_id: 873706024403271681, fee_msat: 101060
But it was failing at that channel due to incorrect_fee reasons.
On my RGS postgresql database, this is what I was seeing, expecting 130 PPM for the fee:
SELECT id, short_channel_id, timestamp, channel_flags, direction, disable, cltv_expiry_delta, htlc_minimum_msat, fee_base_msat , fee_proportional_millionths , htlc_maximum_msat, seen FROM channel_updates WHERE short_channel_id = 873706024403271681 ORDER BY direction, seen;
id | short_channel_id | timestamp | channel_flags | direction | disable | cltv_expiry_delta | htlc_minimum_msat | fee_base_msat | fee_proportional_millionths | htlc_maximum_msat | seen
---------+--------------------+------------+---------------+-----------+---------+-------------------+-------------------+---------------+-----------------------------+-------------------+----------------------------
15502 | 873706024403271681 | 1693507369 | 0 | f | f | 100 | 1000 | 1000 | 38 | 10000000000 | 2023-09-01 05:35:11.748784
247841 | 873706024403271681 | 1693593990 | 0 | f | f | 100 | 1000 | 1000 | 38 | 10000000000 | 2023-09-01 18:52:43.61318
447515 | 873706024403271681 | 1693680390 | 0 | f | f | 100 | 1000 | 1000 | 38 | 10000000000 | 2023-09-02 18:49:44.298348
585121 | 873706024403271681 | 1693749109 | 0 | f | f | 100 | 1000 | 1000 | 200 | 10000000000 | 2023-09-03 13:54:29.804143
729121 | 873706024403271681 | 1693836991 | 0 | f | f | 100 | 1000 | 1000 | 200 | 10000000000 | 2023-09-04 14:19:38.937046
931701 | 873706024403271681 | 1693925190 | 0 | f | f | 100 | 1000 | 1000 | 200 | 10000000000 | 2023-09-05 14:51:16.707509
1112401 | 873706024403271681 | 1694008323 | 0 | f | f | 100 | 1000 | 1000 | 209 | 10000000000 | 2023-09-06 13:56:51.222476
1136977 | 873706024403271681 | 1694018628 | 2 | f | t | 100 | 1000 | 1000 | 209 | 10000000000 | 2023-09-06 16:47:14.999251
1138764 | 873706024403271681 | 1694019342 | 0 | f | f | 100 | 1000 | 1000 | 209 | 10000000000 | 2023-09-06 17:00:21.656834
1148384 | 873706024403271681 | 1694023548 | 2 | f | t | 100 | 1000 | 1000 | 209 | 10000000000 | 2023-09-06 18:09:01.657005
1149419 | 873706024403271681 | 1694023850 | 0 | f | f | 100 | 1000 | 1000 | 209 | 10000000000 | 2023-09-06 18:16:00.804636
1188505 | 873706024403271681 | 1694042148 | 2 | f | t | 100 | 1000 | 1000 | 209 | 10000000000 | 2023-09-06 23:19:21.038322
1189091 | 873706024403271681 | 1694042448 | 0 | f | f | 100 | 1000 | 1000 | 209 | 10000000000 | 2023-09-06 23:23:40.936604
1293025 | 873706024403271681 | 1694092428 | 2 | f | t | 100 | 1000 | 1000 | 209 | 10000000000 | 2023-09-07 13:17:40.79054
1293393 | 873706024403271681 | 1694092743 | 0 | f | f | 100 | 1000 | 1000 | 209 | 10000000000 | 2023-09-07 13:21:34.623002
1297879 | 873706024403271681 | 1694094948 | 2 | f | t | 100 | 1000 | 1000 | 209 | 10000000000 | 2023-09-07 13:59:46.285513
1298703 | 873706024403271681 | 1694095329 | 0 | f | f | 100 | 1000 | 1000 | 209 | 10000000000 | 2023-09-07 14:06:06.578566
1309753 | 873706024403271681 | 1694100468 | 2 | f | t | 100 | 1000 | 1000 | 209 | 10000000000 | 2023-09-07 15:31:06.75473
1310321 | 873706024403271681 | 1694100754 | 0 | f | f | 100 | 1000 | 1000 | 209 | 10000000000 | 2023-09-07 15:35:41.105463
1322167 | 873706024403271681 | 1694106168 | 2 | f | t | 100 | 1000 | 1000 | 209 | 10000000000 | 2023-09-07 17:07:25.934965
1325240 | 873706024403271681 | 1694107716 | 0 | f | f | 100 | 1000 | 1000 | 209 | 10000000000 | 2023-09-07 17:32:15.032081
1336331 | 873706024403271681 | 1694111988 | 2 | f | t | 100 | 1000 | 1000 | 209 | 10000000000 | 2023-09-07 18:43:15.95753
1345006 | 873706024403271681 | 1694116170 | 0 | f | f | 100 | 1000 | 1000 | 209 | 10000000000 | 2023-09-07 19:54:11.635986
1356864 | 873706024403271681 | 1694121588 | 2 | f | t | 100 | 1000 | 1000 | 209 | 10000000000 | 2023-09-07 21:25:52.619199
1365139 | 873706024403271681 | 1694124869 | 0 | f | f | 100 | 1000 | 1000 | 209 | 10000000000 | 2023-09-07 22:18:06.76145
1370112 | 873706024403271681 | 1694126868 | 2 | f | t | 100 | 1000 | 1000 | 209 | 10000000000 | 2023-09-07 22:51:01.339276
1373550 | 873706024403271681 | 1694128376 | 0 | f | f | 100 | 1000 | 1000 | 209 | 10000000000 | 2023-09-07 23:15:50.330677
1482994 | 873706024403271681 | 1694182848 | 2 | f | t | 100 | 1000 | 1000 | 209 | 10000000000 | 2023-09-08 14:24:02.545283
1483284 | 873706024403271681 | 1694182916 | 0 | f | f | 100 | 1000 | 1000 | 209 | 10000000000 | 2023-09-08 14:25:39.503017
1486637 | 873706024403271681 | 1694184408 | 2 | f | t | 100 | 1000 | 1000 | 209 | 10000000000 | 2023-09-08 14:50:52.477101
1491688 | 873706024403271681 | 1694186566 | 0 | f | f | 100 | 1000 | 1000 | 209 | 10000000000 | 2023-09-08 15:28:22.063673
1504741 | 873706024403271681 | 1694192688 | 2 | f | t | 100 | 1000 | 1000 | 209 | 10000000000 | 2023-09-08 17:09:30.906925
1506395 | 873706024403271681 | 1694193560 | 0 | f | f | 100 | 1000 | 1000 | 209 | 10000000000 | 2023-09-08 17:23:11.27144
1522609 | 873706024403271681 | 1694201088 | 2 | f | t | 100 | 1000 | 1000 | 209 | 10000000000 | 2023-09-08 19:29:05.838715
1522813 | 873706024403271681 | 1694201131 | 0 | f | f | 100 | 1000 | 1000 | 209 | 10000000000 | 2023-09-08 19:30:51.187243
1542392 | 873706024403271681 | 1694210688 | 2 | f | t | 100 | 1000 | 1000 | 209 | 10000000000 | 2023-09-08 22:10:42.436836
1544634 | 873706024403271681 | 1694211576 | 0 | f | f | 100 | 1000 | 1000 | 209 | 10000000000 | 2023-09-08 22:23:52.552234
1556311 | 873706024403271681 | 1694216928 | 2 | f | t | 100 | 1000 | 1000 | 209 | 10000000000 | 2023-09-08 23:52:01.197772
1562437 | 873706024403271681 | 1694219924 | 0 | f | f | 100 | 1000 | 1000 | 209 | 10000000000 | 2023-09-09 00:41:41.696928
1594604 | 873706024403271681 | 1694267536 | 0 | f | f | 100 | 1000 | 1000 | 210 | 10000000000 | 2023-09-09 16:58:00.938937
1791353 | 873706024403271681 | 1694355390 | 0 | f | f | 100 | 1000 | 1000 | 210 | 10000000000 | 2023-09-10 14:21:20.247764
1971384 | 873706024403271681 | 1694441790 | 0 | f | f | 100 | 1000 | 1000 | 210 | 10000000000 | 2023-09-11 14:17:29.261606
2007489 | 873706024403271681 | 1694457048 | 2 | f | t | 100 | 1000 | 1000 | 210 | 10000000000 | 2023-09-11 18:32:34.654661
2011327 | 873706024403271681 | 1694458808 | 0 | f | f | 100 | 1000 | 1000 | 210 | 10000000000 | 2023-09-11 19:02:35.477949
2160782 | 873706024403271681 | 1694526734 | 0 | f | f | 100 | 1000 | 1000 | 200 | 10000000000 | 2023-09-12 13:53:31.471492
2370180 | 873706024403271681 | 1694614590 | 0 | f | f | 100 | 1000 | 1000 | 200 | 10000000000 | 2023-09-13 14:17:30.858651
2505861 | 873706024403271681 | 1694672148 | 2 | f | t | 100 | 1000 | 1000 | 200 | 10000000000 | 2023-09-14 06:18:34.141987
2594264 | 873706024403271681 | 1694707381 | 0 | f | f | 100 | 1000 | 1000 | 200 | 10000000000 | 2023-09-14 16:13:16.351301
2806404 | 873706024403271681 | 1694794765 | 0 | f | f | 100 | 1000 | 1000 | 200 | 10000000000 | 2023-09-15 16:23:04.327612
5239346 | 873706024403271681 | 1695909301 | 0 | f | f | 100 | 1000 | 1000 | 130 | 10000000000 | 2023-09-28 20:27:42.790376
15501 | 873706024403271681 | 1693300588 | 1 | t | f | 34 | 1 | 1000 | 10 | 9900000000 | 2023-09-01 05:35:11.747999
241922 | 873706024403271681 | 1693591751 | 3 | t | t | 34 | 1 | 1000 | 10 | 9900000000 | 2023-09-01 18:13:44.225598
242207 | 873706024403271681 | 1693591752 | 1 | t | f | 34 | 1 | 1000 | 10 | 9900000000 | 2023-09-01 18:15:45.392541
5239345 | 873706024403271681 | 1695003621 | 1 | t | f | 34 | 1 | 1000 | 10 | 9900000000 | 2023-09-28 20:27:42.789177
However, client side I was seeing 100 PPM + 1 base:
nettwork graph: features: 0000, node_one: 031f2669adab71548fad4432277a0d90233e3bc07ac29cfb0b3e01bd3fb26cb9fa, one_to_two: Some(ChannelUpdateInfo { last_update: 1695326400, enabled: true, cltv_expiry_delta: 100, htlc_minimum_msat: 1000, htlc_maximum_msat: 10000000000, fees: RoutingFees { base_msat: 1000, proportional_millionths: 38 }, last_update_message: None }), node_two: 03aefa43fbb4009b21a4129d05953974b7dbabbbfb511921410080860fca8ee1f0, two_to_one: Some(ChannelUpdateInfo { last_update: 1695326400, enabled: true, cltv_expiry_delta: 34, htlc_minimum_msat: 1, htlc_maximum_msat: 9900000000, fees: RoutingFees { base_msat: 1000, proportional_millionths: 10 }, last_update_message: None })
We do hourly syncs and even forced a few syncs (and confirmed the message / update counts lined up) but the 38 value persisted. When we pointed to your RGS server today, it was showing 100 instead of 130 for the fee. I'm not sure what historical values you had for the LDK RGS server, but one funny thing is that when we went back in time to the first update we had stored for the channel, it was at 38 PPM.
If you're able to reproduce an RGS client showing 100 for this channel, I'm curious if the 100 PPM is the first entry you have on that server. I was able to solve this by wiping my DB and resyncing gossip again. We only do full sync retrieval in Mutiny so it's not a problem for us but it would be quite annoying to keep doing that every day, and would be unreasonable for you guys to in order to support partial syncs.
Also, maybe unrelated note: This channel either had stopped updating or there was a problem with our RGS in that it stopped syncing updates. We didn't get anything for this channel from 9-15 to 9-28 until we restarted the server today and got that last entry.