Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

nil pointer exception on v7.0.1-beta #613

Closed
albrow opened this issue Dec 26, 2019 · 18 comments
Closed

nil pointer exception on v7.0.1-beta #613

albrow opened this issue Dec 26, 2019 · 18 comments
Labels
bug Something isn't working

Comments

@albrow
Copy link
Contributor

albrow commented Dec 26, 2019

A user reported this on Discord:

25.12.19 21:26:38 (-0700)  0x_mesh  panic: runtime error: invalid memory address or nil pointer dereference
25.12.19 21:26:38 (-0700)  0x_mesh  [signal SIGSEGV: segmentation violation code=0x1 addr=0x4 pc=0x16440]
25.12.19 21:26:38 (-0700)  0x_mesh
25.12.19 21:26:38 (-0700)  0x_mesh  goroutine 150 [running]:
25.12.19 21:26:38 (-0700)  0x_mesh  github.com/0xProject/0x-mesh/p2p/ratevalidator.(trackingRateLimiter).resetViolations(...)
25.12.19 21:26:38 (-0700)  0x_mesh      /go/src/github.com/0xProject/0x-mesh/p2p/ratevalidator/tracking_rate_limiter.go:23
25.12.19 21:26:38 (-0700)  0x_mesh  github.com/0xProject/0x-mesh/p2p/ratevalidator.(Validator).periodicallyLogStats(0x30d8640, 0xc3ffa8, 0x39ec020)
25.12.19 21:26:38 (-0700)  0x_mesh      /go/src/github.com/0xProject/0x-mesh/p2p/ratevalidator/validator.go:154 +0xb8
25.12.19 21:26:38 (-0700)  0x_mesh  created by github.com/0xProject/0x-mesh/p2p/ratevalidator.New
25.12.19 21:26:38 (-0700)  0x_mesh      /go/src/github.com/0xProject/0x-mesh/p2p/ratevalidator/validator.go:88 +0x1bc
25.12.19 21:27:54 (-0700)  0x_mesh  04:27:54.043 ERROR     swarm2: swarm listener accept error: connection write timeout swarm_listen.go:83

At first glance, I cannot see how this could happen in trackingRateLimiter.resetViolations. Need to investigate further.

@albrow albrow added the bug Something isn't working label Dec 26, 2019
@jacobrosenthal
Copy link

If it helps at all its a pi4 node built with node:11 (latest?) and golang/v1.13.4 and I can answer any other question or try anything.

@albrow
Copy link
Contributor Author

albrow commented Dec 31, 2019

@jacobrosenthal we don't currently test Mesh with Go 1.13 and we know that there are some issues with it. See #480. Can you try Go 1.12?

@jacobrosenthal
Copy link

jacobrosenthal commented Dec 31, 2019 via email

@jacobrosenthal
Copy link

I think this was an arch issue with docker and pi. Either way by cleaning up my dockerfile because of the new go modules development branch, I havent seen it again. Please close.

@jacobrosenthal
Copy link

Nevermind. Found it in logs again today.
golang 1.12.9
64bit pi
development branch

04.01.20 12:51:38 (-0700)  0x_mesh  panic: runtime error: invalid memory address or nil pointer dereference
04.01.20 12:51:38 (-0700)  0x_mesh  [signal SIGSEGV: segmentation violation code=0x1 addr=0x4 pc=0x1672c]
04.01.20 12:51:38 (-0700)  0x_mesh  
04.01.20 12:51:38 (-0700)  0x_mesh  goroutine 141 [running]:
04.01.20 12:51:38 (-0700)  0x_mesh  github.com/0xProject/0x-mesh/p2p/ratevalidator.(*trackingRateLimiter).resetViolations(...)
04.01.20 12:51:38 (-0700)  0x_mesh      /build/0x-mesh/p2p/ratevalidator/tracking_rate_limiter.go:23
04.01.20 12:51:38 (-0700)  0x_mesh  github.com/0xProject/0x-mesh/p2p/ratevalidator.(*Validator).periodicallyLogStats(0xc9d76c0, 0xc7c288, 0x6e5e620)
04.01.20 12:51:38 (-0700)  0x_mesh      /build/0x-mesh/p2p/ratevalidator/validator.go:154 +0xc4
04.01.20 12:51:38 (-0700)  0x_mesh  created by github.com/0xProject/0x-mesh/p2p/ratevalidator.New
04.01.20 12:51:38 (-0700)  0x_mesh      /build/0x-mesh/p2p/ratevalidator/validator.go:88 +0x22c

@jacobrosenthal
Copy link

Possibly related, I have all this in the logs a few min before

04.01.20 12:48:54 (-0700)  0x_mesh  {"error_string":"cannot perform more than one operation (insert/delete/update) on the same model within a transaction","level":"error","msg":"Failed to update order","myPeerID":"16Uiu2HAmV67b9D8Xffa33k6mSm3GenRoSL2Cbc2n5gAEfQiN3kXQ","order_meshdb_Order":{"Hash":"0x9acc3d9688b07d6647a9678058fcdcd8f3741f6271b5060ab64d8123364e60b8","SignedOrder":{"chainId":1,"exchangeAddress":"0x61935cbdd02287b511119ddb11aeb42f1593b7ef","makerAddress":"0x998497ffc64240d6a70c38e544521d09dcd23293","makerAssetData":"0xf47261b0000000000000000000000000a0b86991c6218b36c1d19d4a2e9eb0ce3606eb48","makerFeeAssetData":"0x","makerAssetAmount":"4807486656","makerFee":"0","takerAddress":"0x0000000000000000000000000000000000000000","takerAssetData":"0xf47261b0000000000000000000000000c02aaa39b223fe8d0a0e5c4f27ead9083c756cc2","takerFeeAssetData":"0x","takerAssetAmount":"36000000000000000000","takerFee":"0","senderAddress":"0x0000000000000000000000000000000000000000","feeRecipientAddress":"0x0000000000000000000000000000000000000000","expirationTimeSeconds":"1578167250","salt":"1578167128906","signature":"0x1b695389d35d008b514680a04ef3774fdbc50313b6bd5b198711f07e969f09c4480c7e1860ab532cf8386e1b78a32f2c92acc822522ee52718ef6b9a58ee66193802"},"LastUpdated":"2020-01-04T19:48:54.595205773Z","FillableTakerAssetAmount":0,"IsRemoved":true,"IsPinned":false},"time":"2020-01-04T19:48:54Z"}
04.01.20 12:48:54 (-0700)  0x_mesh  {"error_string":"cannot perform more than one operation (insert/delete/update) on the same model within a transaction","level":"error","msg":"Failed to update order","myPeerID":"16Uiu2HAmV67b9D8Xffa33k6mSm3GenRoSL2Cbc2n5gAEfQiN3kXQ","order_meshdb_Order":{"Hash":"0x0807db5dab9b6fcf7f43dd317a91f89958d3bb20ca0dda24d73241c81cc4add7","SignedOrder":{"chainId":1,"exchangeAddress":"0x61935cbdd02287b511119ddb11aeb42f1593b7ef","makerAddress":"0x998497ffc64240d6a70c38e544521d09dcd23293","makerAssetData":"0xf47261b0000000000000000000000000c02aaa39b223fe8d0a0e5c4f27ead9083c756cc2","makerFeeAssetData":"0x","makerAssetAmount":"54000000000000000000","makerFee":"0","takerAddress":"0x0000000000000000000000000000000000000000","takerAssetData":"0xf47261b0000000000000000000000000a0b86991c6218b36c1d19d4a2e9eb0ce3606eb48","takerFeeAssetData":"0x","takerAssetAmount":"7286296680","takerFee":"0","senderAddress":"0x0000000000000000000000000000000000000000","feeRecipientAddress":"0x0000000000000000000000000000000000000000","expirationTimeSeconds":"1578167299","salt":"1578167173157","signature":"0x1c8dc5d3480d1a68d20132bc251b6ece41aa6730f181eab0695524d7cad1c236446a8e946941e34dcec5773acbe886a0501c0fe38bbeb80baf81e699d75a1c235602"},"LastUpdated":"2020-01-04T19:48:54.595494327Z","FillableTakerAssetAmount":0,"IsRemoved":true,"IsPinned":false},"time":"2020-01-04T19:48:54Z"}
04.01.20 12:48:54 (-0700)  0x_mesh  {"error_string":"cannot perform more than one operation (insert/delete/update) on the same model within a transaction","level":"error","msg":"Failed to update order","myPeerID":"16Uiu2HAmV67b9D8Xffa33k6mSm3GenRoSL2Cbc2n5gAEfQiN3kXQ","order_meshdb_Order":{"Hash":"0x5ed2ea0815578032186f4789423e0ab3e1e4cf2300ed91f1d41a9d95cd9cb9e6","SignedOrder":{"chainId":1,"exchangeAddress":"0x61935cbdd02287b511119ddb11aeb42f1593b7ef","makerAddress":"0x998497ffc64240d6a70c38e544521d09dcd23293","makerAssetData":"0xf47261b0000000000000000000000000a0b86991c6218b36c1d19d4a2e9eb0ce3606eb48","makerFeeAssetData":"0x","makerAssetAmount":"4807486656","makerFee":"0","takerAddress":"0x0000000000000000000000000000000000000000","takerAssetData":"0xf47261b0000000000000000000000000c02aaa39b223fe8d0a0e5c4f27ead9083c756cc2","takerFeeAssetData":"0x","takerAssetAmount":"36000000000000000000","takerFee":"0","senderAddress":"0x0000000000000000000000000000000000000000","feeRecipientAddress":"0x0000000000000000000000000000000000000000","expirationTimeSeconds":"1578167254","salt":"1578167128031","signature":"0x1cab7213d6183ffd5a049694c7a913f584d9d25db967e586841beb0ae03d38456310a4be3423bd0c44114e4de24131a8f6622bf69613e73b45d43927e95426e33802"},"LastUpdated":"2020-01-04T19:48:54.595763215Z","FillableTakerAssetAmount":0,"IsRemoved":true,"IsPinned":false},"time":"2020-01-04T19:48:54Z"}
04.01.20 12:48:54 (-0700)  0x_mesh  {"error_string":"cannot perform more than one operation (insert/delete/update) on the same model within a transaction","level":"error","msg":"Failed to update order","myPeerID":"16Uiu2HAmV67b9D8Xffa33k6mSm3GenRoSL2Cbc2n5gAEfQiN3kXQ","order_meshdb_Order":{"Hash":"0xaf7765c62e829b432248329aa21e3025f94ad0545f0031c749e03ac4bd8d1c6a","SignedOrder":{"chainId":1,"exchangeAddress":"0x61935cbdd02287b511119ddb11aeb42f1593b7ef","makerAddress":"0x998497ffc64240d6a70c38e544521d09dcd23293","makerAssetData":"0xf47261b0000000000000000000000000a0b86991c6218b36c1d19d4a2e9eb0ce3606eb48","makerFeeAssetData":"0x","makerAssetAmount":"7189526844","makerFee":"0","takerAddress":"0x0000000000000000000000000000000000000000","takerAssetData":"0xf47261b0000000000000000000000000c02aaa39b223fe8d0a0e5c4f27ead9083c756cc2","takerFeeAssetData":"0x","takerAssetAmount":"54000000000000000000","takerFee":"0","senderAddress":"0x0000000000000000000000000000000000000000","feeRecipientAddress":"0x0000000000000000000000000000000000000000","expirationTimeSeconds":"1578167252","salt":"1578167128515","signature":"0x1ccba1a68f7e1915f12e70c813f2db975d4b2896096416c0c691dc7e18f612e4cc1e0bcfad9e60b060b79e3a11d7109e2b363c7ebc5124e9a656e031dd35d1843a02"},"LastUpdated":"2020-01-04T19:48:54.596026547Z","FillableTakerAssetAmount":0,"IsRemoved":true,"IsPinned":false},"time":"2020-01-04T19:48:54Z"}
04.01.20 12:48:54 (-0700)  0x_mesh  {"error_string":"cannot perform more than one operation (insert/delete/update) on the same model within a transaction","level":"error","msg":"Failed to update order","myPeerID":"16Uiu2HAmV67b9D8Xffa33k6mSm3GenRoSL2Cbc2n5gAEfQiN3kXQ","order_meshdb_Order":{"Hash":"0xd43fba0a8e1b9a366abf1609731ca328657ec9c64333871a5589fe69f6e75912","SignedOrder":{"chainId":1,"exchangeAddress":"0x61935cbdd02287b511119ddb11aeb42f1593b7ef","makerAddress":"0x998497ffc64240d6a70c38e544521d09dcd23293","makerAssetData":"0xf47261b0000000000000000000000000a0b86991c6218b36c1d19d4a2e9eb0ce3606eb48","makerFeeAssetData":"0x","makerAssetAmount":"1045957605","makerFee":"0","takerAddress":"0x0000000000000000000000000000000000000000","takerAssetData":"0xf47261b00000000000000000000000006b175474e89094c44da98b954eedeac495271d0f","takerFeeAssetData":"0x","takerAssetAmount":"1050000000000000000000","takerFee":"0","senderAddress":"0x0000000000000000000000000000000000000000","feeRecipientAddress":"0x0000000000000000000000000000000000000000","expirationTimeSeconds":"1578167250","salt":"1578167128106","signature":"0x1b19c6d02010afefe767c530a3f938b8f4d445231663d34014e4dab8906049aa387fe16af5c1b8bd520ecf9619694b54df95d9873a7e47da9aed90e0b8a742a63e02"},"LastUpdated":"2020-01-04T19:48:54.596290323Z","FillableTakerAssetAmount":0,"IsRemoved":true,"IsPinned":false},"time":"2020-01-04T19:48:54Z"}
04.01.20 12:48:54 (-0700)  0x_mesh  {"error_string":"cannot perform more than one operation (insert/delete/update) on the same model within a transaction","level":"error","msg":"Failed to update order","myPeerID":"16Uiu2HAmV67b9D8Xffa33k6mSm3GenRoSL2Cbc2n5gAEfQiN3kXQ","order_meshdb_Order":{"Hash":"0x3e59341b8548f08ab31974626ebbb10415c68b879c0e004d6b7689ffc5b725eb","SignedOrder":{"chainId":1,"exchangeAddress":"0x61935cbdd02287b511119ddb11aeb42f1593b7ef","makerAddress":"0x998497ffc64240d6a70c38e544521d09dcd23293","makerAssetData":"0xf47261b00000000000000000000000006b175474e89094c44da98b954eedeac495271d0f","makerFeeAssetData":"0x","makerAssetAmount":"5775000000000000000000","makerFee":"0","takerAddress":"0x0000000000000000000000000000000000000000","takerAssetData":"0xf47261b0000000000000000000000000a0b86991c6218b36c1d19d4a2e9eb0ce3606eb48","takerFeeAssetData":"0x","takerAssetAmount":"5776748670","takerFee":"0","senderAddress":"0x0000000000000000000000000000000000000000","feeRecipientAddress":"0x0000000000000000000000000000000000000000","expirationTimeSeconds":"1578167259","salt":"1578167128060","signature":"0x1c2f17e1cfd5b72cdf52d4bc006b81d05b1859e6cfc164cdaf4caff804a678d0f616494ea89e6135fee8bde834c41edb7bfb883e3071d86aab58923b2fc08033a602"},"LastUpdated":"2020-01-04T19:48:54.596534896Z","FillableTakerAssetAmount":0,"IsRemoved":true,"IsPinned":false},"time":"2020-01-04T19:48:54Z"}
04.01.20 12:48:54 (-0700)  0x_mesh  {"error_string":"cannot perform more than one operation (insert/delete/update) on the same model within a transaction","level":"error","msg":"Failed to update order","myPeerID":"16Uiu2HAmV67b9D8Xffa33k6mSm3GenRoSL2Cbc2n5gAEfQiN3kXQ","order_meshdb_Order":{"Hash":"0x748af18b6e0ed8ff65bc09288bcb6d2f6c1b2613aaca68eea612f6f505c3b89a","SignedOrder":{"chainId":1,"exchangeAddress":"0x61935cbdd02287b511119ddb11aeb42f1593b7ef","makerAddress":"0x998497ffc64240d6a70c38e544521d09dcd23293","makerAssetData":"0xf47261b0000000000000000000000000c02aaa39b223fe8d0a0e5c4f27ead9083c756cc2","makerFeeAssetData":"0x","makerAssetAmount":"36000000000000000000","makerFee":"0","takerAddress":"0x0000000000000000000000000000000000000000","takerAssetData":"0xf47261b0000000000000000000000000a0b86991c6218b36c1d19d4a2e9eb0ce3606eb48","takerFeeAssetData":"0x","takerAssetAmount":"4843048320","takerFee":"0","senderAddress":"0x0000000000000000000000000000000000000000","feeRecipientAddress":"0x0000000000000000000000000000000000000000","expirationTimeSeconds":"1578167254","salt":"1578167128027","signature":"0x1bfc96771c4f8e94e30d6978f04e3b013a93fed3b411efd17e530222f010c050bd73ef48c94096b560932a7c9a0abbc6e1ebba4a62f839d530b4280595e862c35102"},"LastUpdated":"2020-01-04T19:48:54.596791525Z","FillableTakerAssetAmount":0,"IsRemoved":true,"IsPinned":false},"time":"2020-01-04T19:48:54Z"}
04.01.20 12:48:54 (-0700)  0x_mesh  {"error_string":"cannot perform more than one operation (insert/delete/update) on the same model within a transaction","level":"error","msg":"Failed to update order","myPeerID":"16Uiu2HAmV67b9D8Xffa33k6mSm3GenRoSL2Cbc2n5gAEfQiN3kXQ","order_meshdb_Order":{"Hash":"0x7acef83a8740c88f5f670c8611d7b00cdc685ad37c6af6eca1f791636f831d7c","SignedOrder":{"chainId":1,"exchangeAddress":"0x61935cbdd02287b511119ddb11aeb42f1593b7ef","makerAddress":"0x998497ffc64240d6a70c38e544521d09dcd23293","makerAssetData":"0xf47261b0000000000000000000000000a0b86991c6218b36c1d19d4a2e9eb0ce3606eb48","makerFeeAssetData":"0x","makerAssetAmount":"7189526844","makerFee":"0","takerAddress":"0x0000000000000000000000000000000000000000","takerAssetData":"0xf47261b0000000000000000000000000c02aaa39b223fe8d0a0e5c4f27ead9083c756cc2","takerFeeAssetData":"0x","takerAssetAmount":"54000000000000000000","takerFee":"0","senderAddress":"0x0000000000000000000000000000000000000000","feeRecipientAddress":"0x0000000000000000000000000000000000000000","expirationTimeSeconds":"1578167249","salt":"1578167128047","signature":"0x1b8233bdd1cf464458b3abdbf4f5532ee76b77cc4a0da3f761a575444fd83b6ad575435a1edcff7f4639bb27307b123fd5610fb5509b6dac9794f0de41f0f3349802"},"LastUpdated":"2020-01-04T19:48:54.597050875Z","FillableTakerAssetAmount":0,"IsRemoved":true,"IsPinned":false},"time":"2020-01-04T19:48:54Z"}
04.01.20 12:48:54 (-0700)  0x_mesh  {"error_string":"cannot perform more than one operation (insert/delete/update) on the same model within a transaction","level":"error","msg":"Failed to update order","myPeerID":"16Uiu2HAmV67b9D8Xffa33k6mSm3GenRoSL2Cbc2n5gAEfQiN3kXQ","order_meshdb_Order":{"Hash":"0xe56083f52bfb52f354b61965041661b34fd275965333f34d08490f81df2de538","SignedOrder":{"chainId":1,"exchangeAddress":"0x61935cbdd02287b511119ddb11aeb42f1593b7ef","makerAddress":"0x998497ffc64240d6a70c38e544521d09dcd23293","makerAssetData":"0xf47261b0000000000000000000000000c02aaa39b223fe8d0a0e5c4f27ead9083c756cc2","makerFeeAssetData":"0x","makerAssetAmount":"54000000000000000000","makerFee":"0","takerAddress":"0x0000000000000000000000000000000000000000","takerAssetData":"0xf47261b0000000000000000000000000a0b86991c6218b36c1d19d4a2e9eb0ce3606eb48","takerFeeAssetData":"0x","takerAssetAmount":"7286296680","takerFee":"0","senderAddress":"0x0000000000000000000000000000000000000000","feeRecipientAddress":"0x0000000000000000000000000000000000000000","expirationTimeSeconds":"1578167249","salt":"1578167128043","signature":"0x1b1c87c09389e5982e539053bd8439a692dde2389c21c45d023ebebe909467d0502ec57375e3288b719d742597dc938ce2eb48a88282039796989f206bbbaa471b02"},"LastUpdated":"2020-01-04T19:48:54.597293096Z","FillableTakerAssetAmount":0,"IsRemoved":true,"IsPinned":false},"time":"2020-01-04T19:48:54Z"}
04.01.20 12:48:54 (-0700)  0x_mesh  {"error_string":"cannot perform more than one operation (insert/delete/update) on the same model within a transaction","level":"error","msg":"Failed to update order","myPeerID":"16Uiu2HAmV67b9D8Xffa33k6mSm3GenRoSL2Cbc2n5gAEfQiN3kXQ","order_meshdb_Order":{"Hash":"0xa732063e9f7fa50d923ab0f9a812117e92b1571811878fc95c45b4a147310fbc","SignedOrder":{"chainId":1,"exchangeAddress":"0x61935cbdd02287b511119ddb11aeb42f1593b7ef","makerAddress":"0x998497ffc64240d6a70c38e544521d09dcd23293","makerAssetData":"0xf47261b0000000000000000000000000a0b86991c6218b36c1d19d4a2e9eb0ce3606eb48","makerFeeAssetData":"0x","makerAssetAmount":"5224552200","makerFee":"0","takerAddress":"0x0000000000000000000000000000000000000000","takerAssetData":"0xf47261b00000000000000000000000006b175474e89094c44da98b954eedeac495271d0f","takerFeeAssetData":"0x","takerAssetAmount":"5250000000000000000000","takerFee":"0","senderAddress":"0x0000000000000000000000000000000000000000","feeRecipientAddress":"0x0000000000000000000000000000000000000000","expirationTimeSeconds":"1578167253","salt":"1578167128093","signature":"0x1bf1620a4ee9d415d52649be8a53c286ec6a0fad069267ff5ba7125f3fefdba5a50e81413299bfcbf0e099ea4fc442fe27e6dac2678fa30a1de94b84d84983222102"},"LastUpdated":"2020-01-04T19:48:54.597524928Z","FillableTakerAssetAmount":0,"IsRemoved":true,"IsPinned":false},"time":"2020-01-04T19:48:54Z"}
04.01.20 12:48:54 (-0700)  0x_mesh  {"error_string":"cannot perform more than one operation (insert/delete/update) on the same model within a transaction","level":"error","msg":"Failed to update order","myPeerID":"16Uiu2HAmV67b9D8Xffa33k6mSm3GenRoSL2Cbc2n5gAEfQiN3kXQ","order_meshdb_Order":{"Hash":"0xa44a1f53b96a1e9753ccdc4616c41914f95681af562f69004bac9485a340d039","SignedOrder":{"chainId":1,"exchangeAddress":"0x61935cbdd02287b511119ddb11aeb42f1593b7ef","makerAddress":"0x998497ffc64240d6a70c38e544521d09dcd23293","makerAssetData":"0xf47261b0000000000000000000000000a0b86991c6218b36c1d19d4a2e9eb0ce3606eb48","makerFeeAssetData":"0x","makerAssetAmount":"1069883352","makerFee":"0","takerAddress":"0x0000000000000000000000000000000000000000","takerAssetData":"0xf47261b0000000000000000000000000c02aaa39b223fe8d0a0e5c4f27ead9083c756cc2","takerFeeAssetData":"0x","takerAssetAmount":"8000000000000000000","takerFee":"0","senderAddress":"0x0000000000000000000000000000000000000000","feeRecipientAddress":"0x0000000000000000000000000000000000000000","expirationTimeSeconds":"1578167249","salt":"1578167128013","signature":"0x1bb3f14b3037348fe6b6e43f1d2a001b6b220f87f284656f890e9cb06fb3eabb484c0e5e59f9310ce3a3f39884e9bdae0791066e6bbad28f9b265724e5496d1b6802"},"LastUpdated":"2020-01-04T19:48:54.597777483Z","FillableTakerAssetAmount":0,"IsRemoved":true,"IsPinned":false},"time":"2020-01-04T19:48:54Z"}
04.01.20 12:48:54 (-0700)  0x_mesh  {"error_string":"cannot perform more than one operation (insert/delete/update) on the same model within a transaction","level":"error","msg":"Failed to update order","myPeerID":"16Uiu2HAmV67b9D8Xffa33k6mSm3GenRoSL2Cbc2n5gAEfQiN3kXQ","order_meshdb_Order":{"Hash":"0x0e3e47ad1aefb4ac8fedd62544761e2dc29565d788f3f48c4ede291143e14428","SignedOrder":{"chainId":1,"exchangeAddress":"0x61935cbdd02287b511119ddb11aeb42f1593b7ef","makerAddress":"0x998497ffc64240d6a70c38e544521d09dcd23293","makerAssetData":"0xf47261b0000000000000000000000000c02aaa39b223fe8d0a0e5c4f27ead9083c756cc2","makerFeeAssetData":"0x","makerAssetAmount":"36000000000000000000","makerFee":"0","takerAddress":"0x0000000000000000000000000000000000000000","takerAssetData":"0xf47261b0000000000000000000000000a0b86991c6218b36c1d19d4a2e9eb0ce3606eb48","takerFeeAssetData":"0x","takerAssetAmount":"4843048320","takerFee":"0","senderAddress":"0x0000000000000000000000000000000000000000","feeRecipientAddress":"0x0000000000000000000000000000000000000000","expirationTimeSeconds":"1578167250","salt":"1578167128917","signature":"0x1b8f3c7b7578bc61a8c8c852f4d7904188f8e0c23f322547bec63da4bd1c5bd9290eb518f11d8c3d1f3d8e2d5e6c272ab7009da8c7dba6a31aa7f396262571833802"},"LastUpdated":"2020-01-04T19:48:54.598022537Z","FillableTakerAssetAmount":0,"IsRemoved":true,"IsPinned":false},"time":"2020-01-04T19:48:54Z"}
04.01.20 12:48:54 (-0700)  0x_mesh  {"error_string":"cannot perform more than one operation (insert/delete/update) on the same model within a transaction","level":"error","msg":"Failed to update order","myPeerID":"16Uiu2HAmV67b9D8Xffa33k6mSm3GenRoSL2Cbc2n5gAEfQiN3kXQ","order_meshdb_Order":{"Hash":"0x969c8b8318e28941643b0a12aac5b120a8c284765553235c2a989dfa8f46b6cf","SignedOrder":{"chainId":1,"exchangeAddress":"0x61935cbdd02287b511119ddb11aeb42f1593b7ef","makerAddress":"0x998497ffc64240d6a70c38e544521d09dcd23293","makerAssetData":"0xf47261b00000000000000000000000006b175474e89094c44da98b954eedeac495271d0f","makerFeeAssetData":"0x","makerAssetAmount":"1050000000000000000000","makerFee":"0","takerAddress":"0x0000000000000000000000000000000000000000","takerAssetData":"0xf47261b0000000000000000000000000a0b86991c6218b36c1d19d4a2e9eb0ce3606eb48","takerFeeAssetData":"0x","takerAssetAmount":"1049008275","takerFee":"0","senderAddress":"0x0000000000000000000000000000000000000000","feeRecipientAddress":"0x0000000000000000000000000000000000000000","expirationTimeSeconds":"1578167253","salt":"1578167128098","signature":"0x1b28a7b414f9e2811faf3185f72fde08cd63823bf481392389b976b5ae25b128184617418bf8388f81dffcb56bba7fca2b37bce2968c1e284762f7c1969d0cd64202"},"LastUpdated":"2020-01-04T19:48:54.598285091Z","FillableTakerAssetAmount":0,"IsRemoved":true,"IsPinned":false},"time":"2020-01-04T19:48:54Z"}
04.01.20 12:48:54 (-0700)  0x_mesh  {"error_string":"cannot perform more than one operation (insert/delete/update) on the same model within a transaction","level":"error","msg":"Failed to update order","myPeerID":"16Uiu2HAmV67b9D8Xffa33k6mSm3GenRoSL2Cbc2n5gAEfQiN3kXQ","order_meshdb_Order":{"Hash":"0x8e6d19cef4b78c2ac2ed7152388c72d955a43d75abfa456c4591022e054617f1","SignedOrder":{"chainId":1,"exchangeAddress":"0x61935cbdd02287b511119ddb11aeb42f1593b7ef","makerAddress":"0x998497ffc64240d6a70c38e544521d09dcd23293","makerAssetData":"0xf47261b00000000000000000000000006b175474e89094c44da98b954eedeac495271d0f","makerFeeAssetData":"0x","makerAssetAmount":"5347519580000000000000","makerFee":"0","takerAddress":"0x0000000000000000000000000000000000000000","takerAssetData":"0xf47261b0000000000000000000000000c02aaa39b223fe8d0a0e5c4f27ead9083c756cc2","takerFeeAssetData":"0x","takerAssetAmount":"40000000000000000000","takerFee":"0","senderAddress":"0x0000000000000000000000000000000000000000","feeRecipientAddress":"0x0000000000000000000000000000000000000000","expirationTimeSeconds":"1578167262","salt":"1578167128069","signature":"0x1b82309d74323c83aaf8c63cae1c2bb41557df9901ac9fa24dd9f1a534a3c2e5911d4a166ba1c2848caa839b21056c886c726a88f7cf44e6c1e612d0b9ad54690a02"},"LastUpdated":"2020-01-04T19:48:54.598533886Z","FillableTakerAssetAmount":0,"IsRemoved":true,"IsPinned":false},"time":"2020-01-04T19:48:54Z"}
04.01.20 12:48:54 (-0700)  0x_mesh  {"error_string":"cannot perform more than one operation (insert/delete/update) on the same model within a transaction","level":"error","msg":"Failed to update order","myPeerID":"16Uiu2HAmV67b9D8Xffa33k6mSm3GenRoSL2Cbc2n5gAEfQiN3kXQ","order_meshdb_Order":{"Hash":"0xd09f8a891c75c49b35d1ad1c49133bcb986b446e469b5670b264b0266d37439f","SignedOrder":{"chainId":1,"exchangeAddress":"0x61935cbdd02287b511119ddb11aeb42f1593b7ef","makerAddress":"0x998497ffc64240d6a70c38e544521d09dcd23293","makerAssetData":"0xf47261b00000000000000000000000006b175474e89094c44da98b954eedeac495271d0f","makerFeeAssetData":"0x","makerAssetAmount":"5347519580000000000000","makerFee":"0","takerAddress":"0x0000000000000000000000000000000000000000","takerAssetData":"0xf47261b0000000000000000000000000c02aaa39b223fe8d0a0e5c4f27ead9083c756cc2","takerFeeAssetData":"0x","takerAssetAmount":"40000000000000000000","takerFee":"0","senderAddress":"0x0000000000000000000000000000000000000000","feeRecipientAddress":"0x0000000000000000000000000000000000000000","expirationTimeSeconds":"1578167255","salt":"1578167127917","signature":"0x1b71b765410dfbb777e8b9c4b1a1b948fecf07733921060583f7f5da0071c79f3f304a3ac60f1c03f5a8c07d7ace059c6d496d717541bb33623cad024988537fb102"},"LastUpdated":"2020-01-04T19:48:54.598764663Z","FillableTakerAssetAmount":0,"IsRemoved":true,"IsPinned":false},"time":"2020-01-04T19:48:54Z"}
04.01.20 12:48:54 (-0700)  0x_mesh  {"error_string":"cannot perform more than one operation (insert/delete/update) on the same model within a transaction","level":"error","msg":"Failed to update order","myPeerID":"16Uiu2HAmV67b9D8Xffa33k6mSm3GenRoSL2Cbc2n5gAEfQiN3kXQ","order_meshdb_Order":{"Hash":"0x8c67be28daa0fc311d1119e4c06fbaada0ff0dcc1c0bc471e3a7ce98a7c08d55","SignedOrder":{"chainId":1,"exchangeAddress":"0x61935cbdd02287b511119ddb11aeb42f1593b7ef","makerAddress":"0x998497ffc64240d6a70c38e544521d09dcd23293","makerAssetData":"0xf47261b00000000000000000000000006b175474e89094c44da98b954eedeac495271d0f","makerFeeAssetData":"0x","makerAssetAmount":"5347519580000000000000","makerFee":"0","takerAddress":"0x0000000000000000000000000000000000000000","takerAssetData":"0xf47261b0000000000000000000000000c02aaa39b223fe8d0a0e5c4f27ead9083c756cc2","takerFeeAssetData":"0x","takerAssetAmount":"40000000000000000000","takerFee":"0","senderAddress":"0x0000000000000000000000000000000000000000","feeRecipientAddress":"0x0000000000000000000000000000000000000000","expirationTimeSeconds":"1578167272","salt":"1578167128080","signature":"0x1cbc48a2de514ce4d9a5ba3cfccfc70bbae46669d0ff509aad8d1c3c47a1aa1eed7da890e5e2730aceb902299b92387465dea6ad655a74b6d343806036757a76a502"},"LastUpdated":"2020-01-04T19:48:54.599006403Z","FillableTakerAssetAmount":0,"IsRemoved":true,"IsPinned":false},"time":"2020-01-04T19:48:54Z"}
04.01.20 12:48:54 (-0700)  0x_mesh  {"error_string":"cannot perform more than one operation (insert/delete/update) on the same model within a transaction","level":"error","msg":"Failed to update order","myPeerID":"16Uiu2HAmV67b9D8Xffa33k6mSm3GenRoSL2Cbc2n5gAEfQiN3kXQ","order_meshdb_Order":{"Hash":"0x35574b42e32019cdf1dc73a62c457b1e74b9a8819cbcc27e3d2453b36ce34fe3","SignedOrder":{"chainId":1,"exchangeAddress":"0x61935cbdd02287b511119ddb11aeb42f1593b7ef","makerAddress":"0x998497ffc64240d6a70c38e544521d09dcd23293","makerAssetData":"0xf47261b0000000000000000000000000c02aaa39b223fe8d0a0e5c4f27ead9083c756cc2","makerFeeAssetData":"0x","makerAssetAmount":"40000000000000000000","makerFee":"0","takerAddress":"0x0000000000000000000000000000000000000000","takerAssetData":"0xf47261b00000000000000000000000006b175474e89094c44da98b954eedeac495271d0f","takerFeeAssetData":"0x","takerAssetAmount":"5404219036000000000000","takerFee":"0","senderAddress":"0x0000000000000000000000000000000000000000","feeRecipientAddress":"0x0000000000000000000000000000000000000000","expirationTimeSeconds":"1578167262","salt":"1578167128065","signature":"0x1ce29fc1eb4f10c4d982a871fad24a7b959ac61330b893778f286ba24e4ff0fdde5b76c9c0e04fcd477591af62352d366f407bd716896d634a31dde508ce86e79802"},"LastUpdated":"2020-01-04T19:48:54.605124687Z","FillableTakerAssetAmount":0,"IsRemoved":true,"IsPinned":false},"time":"2020-01-04T19:48:54Z"}
04.01.20 12:48:54 (-0700)  0x_mesh  {"error_string":"cannot perform more than one operation (insert/delete/update) on the same model within a transaction","level":"error","msg":"Failed to update order","myPeerID":"16Uiu2HAmV67b9D8Xffa33k6mSm3GenRoSL2Cbc2n5gAEfQiN3kXQ","order_meshdb_Order":{"Hash":"0x1c3cca89fe034b1f97b93547d2e3f2026f45fb8d1363035da704dac8406fa87a","SignedOrder":{"chainId":1,"exchangeAddress":"0x61935cbdd02287b511119ddb11aeb42f1593b7ef","makerAddress":"0x998497ffc64240d6a70c38e544521d09dcd23293","makerAssetData":"0xf47261b0000000000000000000000000a0b86991c6218b36c1d19d4a2e9eb0ce3606eb48","makerFeeAssetData":"0x","makerAssetAmount":"7189526844","makerFee":"0","takerAddress":"0x0000000000000000000000000000000000000000","takerAssetData":"0xf47261b0000000000000000000000000c02aaa39b223fe8d0a0e5c4f27ead9083c756cc2","takerFeeAssetData":"0x","takerAssetAmount":"54000000000000000000","takerFee":"0","senderAddress":"0x0000000000000000000000000000000000000000","feeRecipientAddress":"0x0000000000000000000000000000000000000000","expirationTimeSeconds":"1578167256","salt":"1578167128815","signature":"0x1bf9657a54ed574d458a5e974bee96df339a8a67949edef518f5d1b8d5e6e8479f795b0a9f4c838839a91fefaa02a1fb93d66fbbebd66bb075485912340f55f32002"},"LastUpdated":"2020-01-04T19:48:54.605457649Z","FillableTakerAssetAmount":0,"IsRemoved":true,"IsPinned":false},"time":"2020-01-04T19:48:54Z"}

@albrow
Copy link
Contributor Author

albrow commented Jan 8, 2020

@jacobrosenthal can you please provide steps to reproduce?

The cannot perform more than one operation (insert/delete/update) on the same model within a transaction error is not related. That is a separate bug which we are working on fixing. See #608, #614, and #623.

@jacobrosenthal
Copy link

jacobrosenthal commented Jan 8, 2020 via email

@jacobrosenthal
Copy link

Note this is reoccurring with no client connecting. so its not related to client code requests.

@albrow
Copy link
Contributor Author

albrow commented Jan 13, 2020

@jacobrosenthal so to be clear, this happens whenever you run the docker container? Are you doing anything else to trigger it? Does it happen every time?

@jacobrosenthal
Copy link

Yeah after some amount of time running, not immediately. Yeah eventually it kills itself, gets restarted, and then works seemingly flawlessy again for half hour or hour or something I think.

@fabioberger
Copy link
Contributor

@jacobrosenthal we fixed a bunch of nil pointer exceptions in the latest version of Mesh (8.2.0), can you see if this issue is still occurring? If not, let's close this issue.

@jacobrosenthal
Copy link

I tried v8.2.0 today, still there

@albrow
Copy link
Contributor Author

albrow commented Feb 3, 2020

@jacobrosenthal can you share the entire stack trace? Is there anything before invalid memory address or nil pointer dereference?

Noe one else has reported an issue exactly like this so I'm starting to think it might be a problem with your platform/setup.

@jacobrosenthal
Copy link

Im up to v9.0.0, golang:1.13.4, Still there. Message looks same as all other versions

Not sure how to give you more from golang. Happy to run with some debug environment variable or something if you can point me to it.

21.02.20 15:58:53 (-0700)  0x_mesh  panic: runtime error: invalid memory address or nil pointer dereference
21.02.20 15:58:53 (-0700)  0x_mesh  [signal SIGSEGV: segmentation violation code=0x1 addr=0x4 pc=0x16470]
21.02.20 15:58:53 (-0700)  0x_mesh  
21.02.20 15:58:53 (-0700)  0x_mesh  goroutine 168 [running]:
21.02.20 15:58:53 (-0700)  0x_mesh  github.com/0xProject/0x-mesh/p2p/ratevalidator.(*trackingRateLimiter).resetViolations(...)
21.02.20 15:58:53 (-0700)  0x_mesh      /build/0x-mesh/p2p/ratevalidator/tracking_rate_limiter.go:23
21.02.20 15:58:53 (-0700)  0x_mesh  github.com/0xProject/0x-mesh/p2p/ratevalidator.(*Validator).periodicallyLogStats(0x71816640, 0xcae510, 0x67e0bd80)
21.02.20 15:58:53 (-0700)  0x_mesh      /build/0x-mesh/p2p/ratevalidator/validator.go:154 +0xb8
21.02.20 15:58:53 (-0700)  0x_mesh  created by github.com/0xProject/0x-mesh/p2p/ratevalidator.New
21.02.20 15:58:53 (-0700)  0x_mesh      /build/0x-mesh/p2p/ratevalidator/validator.go:88 +0x1bc

@jacobrosenthal
Copy link

9.1.2, golang:1.13.4, Still there. . Previously I could use it for.. 30m or hour or something and just reconnect the order watcher. Now I cant receive a single order, connecting to the node seemingly crashes and restarts immediately now.

@albrow
Copy link
Contributor Author

albrow commented Mar 31, 2020

@jacobrosenthal here are some things you can try:

  1. Wipe your database with something like rm -rf $DATA_DIR/db.
  2. Make sure that your Ethereum RPC provider matches the chain id in the Mesh config.

If neither of those fixes the issue, I'm fairly certain the problem lies with your platform and not with Mesh. Have you tried opening an issue for balena?

@albrow
Copy link
Contributor Author

albrow commented Aug 11, 2020

Closing this issue because there has not been any activity for a while. @jacobrosenthal let us know if we're missing something and we can potentially re-open the issue. At this point, Mesh is fairly stable in production and I have not seen anyone else report an issue like this. I think we have to assume it is an issue that is specific to either the Raspberry Pi or Balena.

@albrow albrow closed this as completed Aug 11, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants