Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

deadlock on setprice #1172

Closed
cipig opened this issue Dec 21, 2021 · 2 comments
Closed

deadlock on setprice #1172

cipig opened this issue Dec 21, 2021 · 2 comments

Comments

@cipig
Copy link
Member

cipig commented Dec 21, 2021

mm2 from mm2.1 branch runs into a deadlock on setprice requests after running for a day. When it happens, i have to kill mm2 and restart. There is no load or CPU usage.

logfile:
mm.log.txt

deadlock does not happen on dev branch
the logfile is from a node that has this many orders/updates:

· 2021-12-21 10:42:38 +0000 [pubkey=02dbd8c73e2e80e4f3cf88d2f04a9d2d0df4269496608b14a3e17556fdcb01e0c1] history.commited_changes=3123 orders_uuids=1371
· 2021-12-21 10:47:38 +0000 [pubkey=02dbd8c73e2e80e4f3cf88d2f04a9d2d0df4269496608b14a3e17556fdcb01e0c1] history.commited_changes=3299 orders_uuids=1371
· 2021-12-21 10:52:38 +0000 [pubkey=02dbd8c73e2e80e4f3cf88d2f04a9d2d0df4269496608b14a3e17556fdcb01e0c1] history.commited_changes=3234 orders_uuids=1371
· 2021-12-21 10:57:38 +0000 [pubkey=02dbd8c73e2e80e4f3cf88d2f04a9d2d0df4269496608b14a3e17556fdcb01e0c1] history.commited_changes=3057 orders_uuids=1371
· 2021-12-21 11:02:38 +0000 [pubkey=02dbd8c73e2e80e4f3cf88d2f04a9d2d0df4269496608b14a3e17556fdcb01e0c1] history.commited_changes=3075 orders_uuids=1371
· 2021-12-21 11:07:38 +0000 [pubkey=02dbd8c73e2e80e4f3cf88d2f04a9d2d0df4269496608b14a3e17556fdcb01e0c1] history.commited_changes=3241 orders_uuids=1371
@cipig cipig mentioned this issue Dec 21, 2021
@cipig
Copy link
Member Author

cipig commented Dec 21, 2021

one of my nodes ran into this deadlock just now (mm2.1 branch)... i can still query orderbook, but setprice calls are not working any more, they simply don't return and also don't timeout (eg curl --url "http://127.0.0.1:7783" --data "{\"userpass\":\"$userpass\",\"method\":\"setprice\",\"base\":\"NAV-BEP20\",\"rel\":\"NAV\",\"price\":1.02,\"max\":true,\"min_volume\":30}") does simply nothing
same with my_orders, it get's stuck
but my_balance is still working

it is the same node as above, with the same number of orders, last output on seed node looks the same (orders_uuids=1371):

· 2021-12-21 13:37:38 +0000 [pubkey=02dbd8c73e2e80e4f3cf88d2f04a9d2d0df4269496608b14a3e17556fdcb01e0c1] history.commited_changes=3036 orders_uuids=1371
· 2021-12-21 13:42:38 +0000 [pubkey=02dbd8c73e2e80e4f3cf88d2f04a9d2d0df4269496608b14a3e17556fdcb01e0c1] history.commited_changes=3034 orders_uuids=1371
· 2021-12-21 13:47:38 +0000 [pubkey=02dbd8c73e2e80e4f3cf88d2f04a9d2d0df4269496608b14a3e17556fdcb01e0c1] history.commited_changes=3031 orders_uuids=1371
· 2021-12-21 13:52:38 +0000 [pubkey=02dbd8c73e2e80e4f3cf88d2f04a9d2d0df4269496608b14a3e17556fdcb01e0c1] history.commited_changes=3024 orders_uuids=1371
· 2021-12-21 13:57:38 +0000 [pubkey=02dbd8c73e2e80e4f3cf88d2f04a9d2d0df4269496608b14a3e17556fdcb01e0c1] history.commited_changes=3024 orders_uuids=1371
· 2021-12-21 14:02:38 +0000 [pubkey=02dbd8c73e2e80e4f3cf88d2f04a9d2d0df4269496608b14a3e17556fdcb01e0c1] history.commited_changes=3023 orders_uuids=1371
· 2021-12-21 14:07:38 +0000 [pubkey=02dbd8c73e2e80e4f3cf88d2f04a9d2d0df4269496608b14a3e17556fdcb01e0c1] history.commited_changes=3019 orders_uuids=1371
· 2021-12-21 14:12:38 +0000 [pubkey=02dbd8c73e2e80e4f3cf88d2f04a9d2d0df4269496608b14a3e17556fdcb01e0c1] history.commited_changes=3019 orders_uuids=1371
· 2021-12-21 14:17:38 +0000 [pubkey=02dbd8c73e2e80e4f3cf88d2f04a9d2d0df4269496608b14a3e17556fdcb01e0c1] history.commited_changes=3017 orders_uuids=1371
· 2021-12-21 14:22:38 +0000 [pubkey=02dbd8c73e2e80e4f3cf88d2f04a9d2d0df4269496608b14a3e17556fdcb01e0c1] history.commited_changes=3010 orders_uuids=1371
· 2021-12-21 14:27:38 +0000 [pubkey=02dbd8c73e2e80e4f3cf88d2f04a9d2d0df4269496608b14a3e17556fdcb01e0c1] history.commited_changes=3004 orders_uuids=1371
· 2021-12-21 14:32:38 +0000 [pubkey=02dbd8c73e2e80e4f3cf88d2f04a9d2d0df4269496608b14a3e17556fdcb01e0c1] history.commited_changes=3000 orders_uuids=1371

logfile of that node:
mm.log

strange thing about this is that it didn't happen a couple days ago and i have not increased the number of orders, i actually decreased it by lowering the number of base coins from 10 to 8 on all nodes

@cipig
Copy link
Member Author

cipig commented Mar 16, 2022

closing because it doesn't happen on dev branch... running for a long time on many nodes, including GUI

@cipig cipig closed this as completed Mar 16, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant