Liq. Mon Auction - Core crashes when entering/leaving auction

[ponthief]

Problem encountered

Core crashes when entering/leaving Liq Mon auction

System response

2021-03-25T09:49:03.304Z	DEBUG	execution.matching	matching/orderbook.go:843	Failed to remove order	{"order": "id:\"V0000000083-0000000012\" market_id:\"137b4864e667e3bff0193a92639c088f7a49eb1764db748af476046af659d199\" party_id:\"c05c99d6f85c2dbf35ed091178afa83bd7132d09adfe35420a1ec0ff7121bb8f\" side:SIDE_SELL price:4750 size:2 remaining:2 time_in_force:TIME_IN_FORCE_GTC type:TYPE_LIMIT created_at:1616665713762314375 status:STATUS_ACTIVE reference:\"fc035ae2-16d4-4b7c-aa7d-7117618fb068\" updated_at:1616665717552917357 version:1 batch_id:5 pegged_order:<reference:PEGGED_REFERENCE_BEST_ASK offset:3000 > ", "error": "OrderError: Order Not Found", "order-book": "137b4864e667e3bff0193a92639c088f7a49eb1764db748af476046af659d199"}
2021-03-25T09:49:03.305Z	PANIC	execution	execution/market.go:2216	Failure to remove order from matching engine	{"party-id": "c05c99d6f85c2dbf35ed091178afa83bd7132d09adfe35420a1ec0ff7121bb8f", "order-id": "V0000000083-0000000012", "market": "137b4864e667e3bff0193a92639c088f7a49eb1764db748af476046af659d199", "error": "OrderError: Order Removal Failure"}
2021-03-25T09:49:03.305Z	ERROR	tm.abci.socket-server	server/socket_server.go:142	Connection error [err recovered from panic: Failure to remove order from matching engine
goroutine 208 [running]:
github.com/tendermint/tendermint/abci/server.(*SocketServer).handleRequests.func1(0xc000784a50, 0xc000f47020)
	/home/djordje/go/src/vega/vendor/github.com/tendermint/tendermint/abci/server/socket_server.go:165 +0xb5
panic(0x1884de0, 0xc0011b5e50)
	/usr/local/go/src/runtime/panic.go:969 +0x166
go.uber.org/zap/zapcore.(*CheckedEntry).Write(0xc0011542c0, 0xc01d518900, 0x4, 0x4)
	/home/djordje/go/src/vega/vendor/go.uber.org/zap/zapcore/entry.go:230 +0x545
go.uber.org/zap.(*Logger).Panic(0xc000781680, 0x1bda740, 0x2c, 0xc01d518900, 0x4, 0x4)
	/home/djordje/go/src/vega/vendor/go.uber.org/zap/logger.go:225 +0x7f
code.vegaprotocol.io/vega/execution.(*Market).parkOrder(0xc01ddb5380, 0x20176a0, 0xc01d5bdec0, 0xc01e378340)
	/home/djordje/go/src/vega/execution/market.go:2216 +0x5ba
code.vegaprotocol.io/vega/execution.(*Market).EnterAuction(0xc01ddb5380, 0x20176a0, 0xc01d5bdec0)
	/home/djordje/go/src/vega/execution/market.go:816 +0x317
code.vegaprotocol.io/vega/execution.(*Market).checkPriceAndGetTrades(0xc01ddb5380, 0x20176a0, 0xc01d5bdec0, 0xc01e378340, 0xc01e378340, 0x0, 0x0, 0x6989df7055495380, 0xcb490ba50bda387d)
	/home/djordje/go/src/vega/execution/market.go:1349 +0x4fc
code.vegaprotocol.io/vega/execution.(*Market).submitValidatedOrder(0xc01ddb5380, 0x20176a0, 0xc01d5bdec0, 0xc01e378340, 0x0, 0x0, 0x0)
	/home/djordje/go/src/vega/execution/market.go:1265 +0x2cf
code.vegaprotocol.io/vega/execution.(*Market).repriceAllPeggedOrders(0xc01ddb5380, 0x20176a0, 0xc01d5bdec0, 0x7, 0xc000793308, 0x1, 0x1, 0x1)
	/home/djordje/go/src/vega/execution/market.go:728 +0xd43
code.vegaprotocol.io/vega/execution.(*Market).LeaveAuction(0xc01ddb5380, 0x20176a0, 0xc01d5bdec0, 0x380af155, 0xed7ee538d, 0x0)
	/home/djordje/go/src/vega/execution/market.go:908 +0x1234
code.vegaprotocol.io/vega/execution.(*Market).commandLiquidityAuction(0xc01ddb5380, 0x20176a0, 0xc01d5bdec0)
	/home/djordje/go/src/vega/execution/market.go:3521 +0x510
code.vegaprotocol.io/vega/execution.(*Market).submitValidatedOrder(0xc01ddb5380, 0x20176a0, 0xc01d5bdec0, 0xc0001161a0, 0x0, 0x0, 0x0)
	/home/djordje/go/src/vega/execution/market.go:1328 +0x86b
code.vegaprotocol.io/vega/execution.(*Market).submitOrder(0xc01ddb5380, 0x20176a0, 0xc01d5bdec0, 0xc0001161a0, 0x1, 0x0, 0x0, 0x0)
	/home/djordje/go/src/vega/execution/market.go:1170 +0x2f7
code.vegaprotocol.io/vega/execution.(*Market).SubmitOrder(0xc01ddb5380, 0x20176a0, 0xc01d5bdec0, 0xc0001161a0, 0xc01d6b3f68, 0x1, 0x0)
	/home/djordje/go/src/vega/execution/market.go:1127 +0x7f
code.vegaprotocol.io/vega/execution.(*Engine).SubmitOrder(0xc0001d9540, 0x20176a0, 0xc01d5bdec0, 0xc0001161a0, 0x0, 0xc000f60838, 0x49d906)
	/home/djordje/go/src/vega/execution/engine.go:437 +0x1ce
code.vegaprotocol.io/vega/processor.(*App).DeliverSubmitOrder(0xc00011d860, 0x20176a0, 0xc01d5bdec0, 0x2025700, 0xc0011d4020, 0x0, 0xc0007848f0)
	/home/djordje/go/src/vega/processor/abci.go:351 +0x250
code.vegaprotocol.io/vega/blockchain/abci.(*App).DeliverTx(0xc0003e5650, 0xc01d66b500, 0x161, 0x180, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, ...)
	/home/djordje/go/src/vega/blockchain/abci/abci.go:111 +0x249
github.com/tendermint/tendermint/abci/server.(*SocketServer).handleRequest(0xc000784a50, 0xc01d5f01b0, 0xc000f47080)
	/home/djordje/go/src/vega/vendor/github.com/tendermint/tendermint/abci/server/socket_server.go:207 +0x105b
github.com/tendermint/tendermint/abci/server.(*SocketServer).handleRequests(0xc000784a50, 0xc000f47020, 0x1fe7fc0, 0xc0007928b0, 0xc000f47080)
	/home/djordje/go/src/vega/vendor/github.com/tendermint/tendermint/abci/server/socket_server.go:189 +0x173
created by github.com/tendermint/tendermint/abci/server.(*SocketServer).acceptConnectionsRoutine
	/home/djordje/go/src/vega/vendor/github.com/tendermint/tendermint/abci/server/socket_server.go:127 +0x2b3
]

System version: Specify the system version (0.34)
Protocol: Specify the protocol

• gRPC
• REST
• GraphQL

Component: Specify the components that might be related

• Vega
• Tendermint
• Console
• Ethereum Bridge
• Vega Wallet

Steps to reproduce