Race condition in service startup prevents continuous deployment from working correctly

[0x234]

watcher-0 watcher 2019-02-27 03:43:25,762 INFO    :Starting Launcher
watcher-0 watcher 2019-02-27 03:43:25,769 INFO    :Service type to launch is Elixir Watcher
watcher-0 watcher 2019-02-27 03:43:25,769 INFO    :Starting launch process for build 9de723cf21ca81223f09d188e85c050a770c53db
watcher-0 watcher 2019-02-27 03:43:25,805 INFO    :Connected to the Ethereum client
watcher-0 watcher 2019-02-27 03:43:25,806 INFO    :Ethereum client is b'{"jsonrpc":"2.0","id":67,"result":"Geth/v1.8.22-stable/linux-amd64/go1.11.5"}\n'
watcher-0 watcher 2019-02-27 03:43:27,581 INFO    :Elixir mix compile successful
watcher-0 watcher 2019-02-27 03:43:27,581 INFO    :Using pre-deployed contract on network RINKEBY
watcher-0 watcher 2019-02-27 03:43:27,581 INFO    :Writing config_watcher.exs
watcher-0 watcher 2019-02-27 03:43:27,582 INFO    :Chain data found
watcher-0 watcher 2019-02-27 03:43:27,582 INFO    :Launcher process complete
watcher-0 watcher 2019-02-27 03:43:29.668 [info] module=OMG.Watcher.Application function=start/2 ⋅Starting OMG.Watcher.Application⋅
watcher-0 watcher 2019-02-27 03:43:29.670 [info] module=OMG.Watcher.Supervisor function=init/1 ⋅Starting OMG.Watcher.Supervisor⋅
watcher-0 watcher 2019-02-27 03:43:30.154 [info] module=OMG.API.EthereumEventListener function=init/1 ⋅Starting EthereumEventListener for depositor⋅
watcher-0 watcher 2019-02-27 03:43:30.167 [info] module=OMG.API.EthereumEventListener function=init/1 ⋅Starting EthereumEventListener for convenience_deposit_processor⋅
watcher-0 watcher 2019-02-27 03:43:30.173 [info] module=OMG.DB function=exit_infos/1 ⋅Reading exits' info, this might take a while. Allowing 60000 ms⋅
watcher-0 watcher 2019-02-27 03:43:30.532 [info] module=OMG.DB function=in_flight_exits_info/1 ⋅Reading in flight exits' info, this might take a while. Allowing 60000 ms⋅
watcher-0 watcher 2019-02-27 03:43:30.819 [info] module=OMG.DB function=competitors_info/1 ⋅Reading competitors' info, this might take a while. Allowing 60000 ms⋅
watcher-0 watcher 2019-02-27 03:43:31.138 [info] module=OMG.Watcher.ExitProcessor function=init/1 ⋅Initializing with: {:ok, %OMG.Watcher.ExitProcessor.Core{competitors: %{<<5, 25, 246, 202, 22, 10, 22, 70, 48, 85, 161, 205, 64, 232, 27, 213, 15, 100, 114, 178, 178, 199, 135, 141, 109, 176, 223, 160, 38, 20, 207, 27>> => %OMG.Watcher.ExitProcessor.CompetitorInfo{competing_input_index: 0, competing_input_signature: <<95, 47, 135, 253, 150, 132, 113, 83, 52, 114, 235, 166, 88, 44, 182, 27, 128, 6, 206, 198, 178, 176, 226, 146, 100, 6, 252, 204, 154, 191, 105, 2, 126, 54, 70, 229, 203, 172, 107, 25, 47, 37, 53, 217, ...>>, tx: %OMG.API.State.Transaction.Signed{raw_tx: %OMG.API.State.Transaction{inputs: [%{blknum: 92000, oindex: 0, txindex: 0}, %{blknum: 0, oindex: 0, txindex: 0}, %{blknum: 0, oindex: 0, txindex: 0}, %{blknum: 0, oindex: 0, txindex: 0}], outputs: [%{amount: 5, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<211, 135, 183, 91, 96, 210, 71, 152, 137, 144, 134, 120, 136, 127, 42, 235, 50, 221, 215, 8>>}, %{amount: 0, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>}, %{amount: 0, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>}, %{amount: 0, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>}]}, signed_tx_bytes: nil, sigs: [<<95, 47, 135, 253, 150, 132, 113, 83, 52, 114, 235, 166, 88, 44, 182, 27, 128, 6, 206, 198, 178, 176, 226, 146, 100, 6, 252, 204, 154, 191, 105, 2, 126, 54, 70, 229, 203, 172, 107, ...>>]}}, <<111, 131, 146, 125, 71, 86, 162, 126, 71, 74, 144, 199, 8, 208, 138, 113, 246, 168, 26, 245, 50, 231, 80, 211, 236, 69, 201, 157, 182, 149, 211, 238>> => %OMG.Watcher.ExitProcessor.CompetitorInfo{competing_input_index: 0, competing_input_signature: <<208, 138, 238, 15, 28, 71, 112, 128, 135, 30, 209, 68, 79, 99, 26, 237, 118, 221, 179, 32, 253, 66, 115, 3, 130, 6, 36, 231, 102, 247, 12, 80, 95, 91, 7, 239, 13, 21, 41, 2, 192, 76, 195, ...>>, tx: %OMG.API.State.Transaction.Signed{raw_tx: %OMG.API.State.Transaction{inputs: [%{blknum: 88002, oindex: 0, txindex: 0}, %{blknum: 0, oindex: 0, txindex: 0}, %{blknum: 0, oindex: 0, txindex: 0}, %{blknum: 0, oindex: 0, txindex: 0}], outputs: [%{amount: 9, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<131, 22, 38, 25, 106, 35, 178, 202, 36, 239, 138, 121, 90, 96, 132, 55, 44, 185, 161, 193>>}, %{amount: 1, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<211, 135, 183, 91, 96, 210, 71, 152, 137, 144, 134, 120, 136, 127, 42, 235, 50, 221, 215, 8>>}, %{amount: 0, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>}, %{amount: 0, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>}]}, signed_tx_bytes: nil, sigs: [<<208, 138, 238, 15, 28, 71, 112, 128, 135, 30, 209, 68, 79, 99, 26, 237, 118, 221, 179, 32, 253, 66, 115, 3, 130, 6, 36, 231, 102, 247, 12, 80, 95, 91, 7, 239, 13, 21, ...>>]}}, <<128, 179, 44, 122, 103, 36, 204, 127, 151, 184, 247, 6, 15, 128, 78, 110, 113, 109, 201, 125, 19, 52, 186, 194, 48, 235, 103, 160, 89, 22, 197, 201>> => %OMG.Watcher.ExitProcessor.CompetitorInfo{competing_input_index: 0, competing_input_signature: <<81, 133, 116, 4, 172, 120, 101, 166, 144, 71, 153, 108, 136, 4, 69, 49, 57, 16, 254, 2, 223, 44, 112, 129, 187, 250, 182, 84, 207, 79, 70, 8, 13, 81, 153, 214, 83, 103, 175, 119, 233, 28, ...>>, tx: %OMG.API.State.Transaction.Signed{raw_tx: %OMG.API.State.Transaction{inputs: [%{blknum: 93000, oindex: 0, txindex: 0}, %{blknum: 0, oindex: 0, txindex: 0}, %{blknum: 0, oindex: 0, txindex: 0}, %{blknum: 0, oindex: 0, txindex: 0}], outputs: [%{amount: 4, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<211, 135, 183, 91, 96, 210, 71, 152, 137, 144, 134, 120, 136, 127, 42, 235, 50, 221, 215, 8>>}, %{amount: 0, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>}, %{amount: 0, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>}, %{amount: 0, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>}]}, signed_tx_bytes: nil, sigs: [<<81, 133, 116, 4, 172, 120, 101, 166, 144, 71, 153, 108, 136, 4, 69, 49, 57, 16, 254, 2, 223, 44, 112, 129, 187, 250, 182, 84, 207, 79, 70, 8, 13, 81, 153, 214, 83, ...>>]}}}, exits: %{{:utxo_position, 41000, 0, 1} => %OMG.Watcher.ExitProcessor.ExitInfo{amount: 211200000, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, eth_height: 3909229, is_active: true, owner: <<248, 107, 91, 28, 44, 141, 225, 234, 77, 199, 55, 200, 73, 39, 35, 64, 250, 53, 97, 197>>}, {:utxo_position, 88000, 0, 2} => %OMG.Watcher.ExitProcessor.ExitInfo{amount: 1, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, eth_height: 3914646, is_active: true, owner: <<211, 135, 183, 91, 96, 210, 71, 152, 137, 144, 134, 120, 136, 127, 42, 235, 50, 221, 215, 8>>}}, in_flight_exits: %{<<5, 25, 246, 202, 22, 10, 22, 70, 48, 85, 161, 205, 64, 232, 27, 213, 15, 100, 114, 178, 178, 199, 135, 141, 109, 176, 223, 160, 38, 20, 207, 27>> => %{__struct__: OMG.Watcher.ExitProcessor.InFlightExitInfo, contract_id: 2370316990351448335720246544088407191758179935141667380790, eth_height: 3914978, exit_map: %{0 => %{is_finalized: false, is_piggybacked: false}, 1 => %{is_finalized: false, is_piggybacked: false}, 2 => %{is_finalized: false, is_piggybacked: false}, 3 => %{is_finalized: false, is_piggybacked: false}, 4 => %{is_finalized: false, is_piggybacked: false}, 5 => %{is_finalized: false, is_piggybacked: false}, 6 => %{is_finalized: false, is_piggybacked: false}, 7 => %{is_finalized: false, is_piggybacked: false}}, is_active: true, is_canonical: true, oldest_competitor: nil, timestamp: 1550853739, tx: %OMG.API.State.Transaction.Signed{raw_tx: %OMG.API.State.Transaction{inputs: [%{blknum: 92000, oindex: 0, txindex: 0}, %{blknum: 0, oindex: 0, txindex: 0}, %{blknum: 0, oindex: 0, txindex: 0}, %{blknum: 0, oindex: 0, txindex: 0}], outputs: [%{amount: 5, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<211, 135, 183, 91, 96, 210, 71, 152, 137, 144, 134, 120, 136, 127, 42, 235, 50, 221, 215, 8>>}, %{amount: 0, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>}, %{amount: 0, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>}, %{amount: 0, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>}]}, signed_tx_bytes: nil, sigs: [<<95, 47, 135, 253, 150, 132, 113, 83, 52, 114, 235, 166, 88, 44, 182, 27, 128, 6, 206, 198, 178, 176, 226, 146, 100, 6, 252, 204, 154, 191, 105, ...>>]}, tx_pos: nil}, <<31, 74, 173, 77, 68, 34, 166, 4, 205, 30, 146, 119, 237, 111, 157, 147, 234, 58, 235, 240, 130, 196, 193, 237, 144, 112, 108, 148, 183, 87, 253, 240>> => %{__struct__: OMG.Watcher.ExitProcessor.InFlightExitInfo, contract_id: 3781925471690620519351709730178971532336882711452340714464, eth_height: 3909406, exit_map: %{0 => %{is_finalized: false, is_piggybacked: false}, 1 => %{is_finalized: false, is_piggybacked: false}, 2 => %{is_finalized: false, is_piggybacked: false}, 3 => %{is_finalized: false, is_piggybacked: false}, 4 => %{is_finalized: false, is_piggybacked: false}, 5 => %{is_finalized: false, is_piggybacked: false}, 6 => %{is_finalized: false, is_piggybacked: false}, 7 => %{is_finalize (truncated)⋅
watcher-0 watcher 2019-02-27 03:43:31.138 [info] module=OMG.API.EthereumEventListener function=init/1 ⋅Starting EthereumEventListener for exit_processor⋅
watcher-0 watcher 2019-02-27 03:43:31.141 [info] module=OMG.API.EthereumEventListener function=init/1 ⋅Starting EthereumEventListener for convenience_exit_processor⋅
watcher-0 watcher 2019-02-27 03:43:31.144 [info] module=OMG.API.EthereumEventListener function=init/1 ⋅Starting EthereumEventListener for exit_finalizer⋅
watcher-0 watcher 2019-02-27 03:43:31.146 [info] module=OMG.API.EthereumEventListener function=init/1 ⋅Starting EthereumEventListener for exit_challenger⋅
watcher-0 watcher 2019-02-27 03:43:31.148 [info] module=OMG.API.EthereumEventListener function=init/1 ⋅Starting EthereumEventListener for in_flight_exit_processor⋅
watcher-0 watcher 2019-02-27 03:43:31.151 [info] module=OMG.API.EthereumEventListener function=init/1 ⋅Starting EthereumEventListener for piggyback_processor⋅
watcher-0 watcher 2019-02-27 03:43:31.154 [info] module=OMG.API.EthereumEventListener function=init/1 ⋅Starting EthereumEventListener for competitor_processor⋅
watcher-0 watcher 2019-02-27 03:43:31.156 [info] module=OMG.API.EthereumEventListener function=init/1 ⋅Starting EthereumEventListener for challenges_responds_processor⋅
watcher-0 watcher 2019-02-27 03:43:31.158 [info] module=OMG.API.EthereumEventListener function=init/1 ⋅Starting EthereumEventListener for piggyback_challenges_processor⋅
watcher-0 watcher 2019-02-27 03:43:31.161 [info] module=OMG.API.EthereumEventListener function=init/1 ⋅Starting EthereumEventListener for ife_exit_finalizer⋅
watcher-0 watcher 2019-02-27 03:43:31.222 [info] module=Phoenix.Endpoint.CowboyAdapter function=start_link/3 ⋅Running OMG.Watcher.Web.Endpoint with cowboy 1.1.2 at http://localhost:7434⋅
watcher-0 watcher 2019-02-27 03:43:31.223 [info] module=OMG.Watcher.BlockGetter.Supervisor function=init/1 ⋅Starting OMG.Watcher.BlockGetter.Supervisor⋅
watcher-0 watcher 2019-02-27 03:43:31.224 [info] module=OMG.DB function=utxos/1 ⋅Reading UTXO set, this might take a while. Allowing 600000 ms⋅
watcher-0 watcher 2019-02-27 03:43:31.708 [info] module=OMG.API.State function=init/1 ⋅Started State, height: 99000, deposit height: 93010⋅
watcher-0 watcher 2019-02-27 03:43:31.755 [error] module=gen_server function=error_info/7 ⋅GenServer OMG.Watcher.ExitProcessor terminating
watcher-0 watcher ** (KeyError) key :tx_seen_in_blocks_at not found in: %{__struct__: OMG.Watcher.ExitProcessor.InFlightExitInfo, contract_id: 2370316990351448335720246544088407191758179935141667380790, eth_height: 3914978, exit_map: %{0 => %{is_finalized: false, is_piggybacked: false}, 1 => %{is_finalized: false, is_piggybacked: false}, 2 => %{is_finalized: false, is_piggybacked: false}, 3 => %{is_finalized: false, is_piggybacked: false}, 4 => %{is_finalized: false, is_piggybacked: false}, 5 => %{is_finalized: false, is_piggybacked: false}, 6 => %{is_finalized: false, is_piggybacked: false}, 7 => %{is_finalized: false, is_piggybacked: false}}, is_active: true, is_canonical: true, oldest_competitor: nil, timestamp: 1550853739, tx: %OMG.API.State.Transaction.Signed{raw_tx: %OMG.API.State.Transaction{inputs: [%{blknum: 92000, oindex: 0, txindex: 0}, %{blknum: 0, oindex: 0, txindex: 0}, %{blknum: 0, oindex: 0, txindex: 0}, %{blknum: 0, oindex: 0, txindex: 0}], outputs: [%{amount: 5, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<211, 135, 183, 91, 96, 210, 71, 152, 137, 144, 134, 120, 136, 127, 42, 235, 50, 221, 215, 8>>}, %{amount: 0, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>}, %{amount: 0, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>}, %{amount: 0, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>}]}, signed_tx_bytes: nil, sigs: [<<95, 47, 135, 253, 150, 132, 113, 83, 52, 114, 235, 166, 88, 44, 182, 27, 128, 6, 206, 198, 178, 176, 226, 146, 100, 6, 252, 204, 154, 191, 105, 2, 126, 54, 70, 229, 203, ...>>]}, tx_pos: nil}
watcher-0 watcher     (omg_watcher) lib/exit_processor/core.ex:916: anonymous fn/1 in OMG.Watcher.ExitProcessor.Core.find_ifes_in_blocks/2
watcher-0 watcher     (elixir) lib/enum.ex:907: anonymous fn/3 in Enum.filter/2
watcher-0 watcher     (stdlib) maps.erl:257: :maps.fold_1/3
watcher-0 watcher     (elixir) lib/enum.ex:1956: Enum.filter/2
watcher-0 watcher     (omg_watcher) lib/exit_processor/core.ex:916: OMG.Watcher.ExitProcessor.Core.find_ifes_in_blocks/2
watcher-0 watcher     (omg_watcher) lib/exit_processor.ex:336: OMG.Watcher.ExitProcessor.prepare_validity_check/1
watcher-0 watcher     (omg_watcher) lib/exit_processor.ex:255: OMG.Watcher.ExitProcessor.handle_call/3
watcher-0 watcher     (stdlib) gen_server.erl:661: :gen_server.try_handle_call/4
watcher-0 watcher     (stdlib) gen_server.erl:690: :gen_server.handle_msg/6
watcher-0 watcher     (stdlib) proc_lib.erl:249: :proc_lib.init_p_do_apply/3
watcher-0 watcher Last message (from OMG.Watcher.BlockGetter): :check_validity⋅
watcher-0 watcher 2019-02-27 03:43:31.759 [info] module=OMG.DB function=exit_infos/1 ⋅Reading exits' info, this might take a while. Allowing 60000 ms⋅
watcher-0 watcher 2019-02-27 03:43:31.811 [error] module=gen_event function=report_error/5 ⋅:gen_event handler Sentry.Logger installed in :error_logger terminating
watcher-0 watcher ** (stop) exited in: GenServer.call(Sentry.TaskSupervisor, {:start_task, [{:nonode@nohost, :error_logger, #PID<0.371.0>}, [#PID<0.371.0>], :monitor, {:erlang, :apply, [#Function<3.89165438/0 in Sentry.Client.do_send_event/3>, []]}], :temporary, nil}, :infinity)
watcher-0 watcher     ** (EXIT) no process: the process is not alive or there's no process currently associated with the given name, possibly because its application isn't started
watcher-0 watcher Last message: {:error_report, #PID<0.408.0>, {#PID<0.435.0>, :crash_report, [[initial_call: {OMG.Watcher.ExitProcessor, :init, [:Argument__1]}, pid: #PID<0.435.0>, registered_name: OMG.Watcher.ExitProcessor, error_info: {:error, {:badkey, :tx_seen_in_blocks_at, %{__struct__: OMG.Watcher.ExitProcessor.InFlightExitInfo, contract_id: 2370316990351448335720246544088407191758179935141667380790, eth_height: 3914978, exit_map: %{0 => %{is_finalized: false, is_piggybacked: false}, 1 => %{is_finalized: false, is_piggybacked: false}, 2 => %{is_finalized: false, is_piggybacked: false}, 3 => %{is_finalized: false, is_piggybacked: false}, 4 => %{is_finalized: false, is_piggybacked: false}, 5 => %{is_finalized: false, is_piggybacked: false}, 6 => %{is_finalized: false, is_piggybacked: false}, 7 => %{is_finalized: false, is_piggybacked: false}}, is_active: true, is_canonical: true, oldest_competitor: nil, timestamp: 1550853739, tx: %OMG.API.State.Transaction.Signed{raw_tx: %OMG.API.State.Transaction{inputs: [%{blknum: 92000, oindex: 0, txindex: 0}, %{blknum: 0, oindex: 0, txindex: 0}, %{blknum: 0, oindex: 0, txindex: 0}, %{blknum: 0, oindex: 0, txindex: 0}], outputs: [%{amount: 5, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, ...>>, owner: <<211, 135, 183, 91, 96, 210, 71, 152, 137, 144, 134, 120, 136, 127, 42, 235, 50, 221, ...>>}, %{amount: 0, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, ...>>, owner: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, ...>>}, %{amount: 0, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, ...>>, owner: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, ...>>}, %{amount: 0, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, ...>>, owner: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, ...>>}]}, signed_tx_bytes: nil, sigs: [<<95, 47, 135, 253, 150, 132, 113, 83, 52, 114, 235, 166, 88, 44, 182, 27, 128, 6, 206, 198, 178, ...>>]}, tx_pos: nil}}, [{OMG.Watcher.ExitProcessor.Core, :"-find_ifes_in_blocks/2-fun-2-", 1, [file: 'lib/exit_processor/core.ex', line: 916]}, {Enum, :"-filter/2-fun-0-", 3, [file: 'lib/enum.ex', line: 907]}, {:maps, :fold_1, 3, [file: 'maps.erl', line: 257]}, {Enum, :filter, 2, [file: 'lib/enum.ex', line: 1956]}, {OMG.Watcher.ExitProcessor.Core, :find_ifes_in_blocks, 2, [file: 'lib/exit_processor/core.ex', line: 916]}, {OMG.Watcher.ExitProcessor, :prepare_validity_check, 1, [file: 'lib/exit_processor.ex', line: 336]}, {OMG.Watcher.ExitProcessor, :handle_call, 3, [file: 'lib/exit_processor.ex', line: 255]}, {:gen_server, :try_handle_call, 4, [file: 'gen_server.erl', line: 661]}, {:gen_server, :handle_msg, 6, [file: 'gen_server.erl', line: 690]}, {:proc_lib, :init_p_do_apply, 3, [file: 'proc_lib.erl', line: 249]}]}, ancestors: [OMG.Watcher.Supervisor, OMG.Watcher.RootSupervisor, #PID<0.409.0>], message_queue_len: 0, messages: [], links: [#PID<0.411.0>], dictionary: [], trap_exit: false, status: :running, heap_size: 28690, stack_size: 27, reductions: 325946], []]}}⋅
watcher-0 watcher 2019-02-27 03:43:32.180 [info] module=OMG.DB function=in_flight_exits_info/1 ⋅Reading in flight exits' info, this might take a while. Allowing 60000 ms⋅
watcher-0 watcher 2019-02-27 03:43:32.619 [info] module=OMG.DB function=competitors_info/1 ⋅Reading competitors' info, this might take a while. Allowing 60000 ms⋅
watcher-0 watcher 2019-02-27 03:43:33.081 [info] module=OMG.Watcher.ExitProcessor function=init/1 ⋅Initializing with: {:ok, %OMG.Watcher.ExitProcessor.Core{competitors: %{<<5, 25, 246, 202, 22, 10, 22, 70, 48, 85, 161, 205, 64, 232, 27, 213, 15, 100, 114, 178, 178, 199, 135, 141, 109, 176, 223, 160, 38, 20, 207, 27>> => %OMG.Watcher.ExitProcessor.CompetitorInfo{competing_input_index: 0, competing_input_signature: <<95, 47, 135, 253, 150, 132, 113, 83, 52, 114, 235, 166, 88, 44, 182, 27, 128, 6, 206, 198, 178, 176, 226, 146, 100, 6, 252, 204, 154, 191, 105, 2, 126, 54, 70, 229, 203, 172, 107, 25, 47, 37, 53, 217, ...>>, tx: %OMG.API.State.Transaction.Signed{raw_tx: %OMG.API.State.Transaction{inputs: [%{blknum: 92000, oindex: 0, txindex: 0}, %{blknum: 0, oindex: 0, txindex: 0}, %{blknum: 0, oindex: 0, txindex: 0}, %{blknum: 0, oindex: 0, txindex: 0}], outputs: [%{amount: 5, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<211, 135, 183, 91, 96, 210, 71, 152, 137, 144, 134, 120, 136, 127, 42, 235, 50, 221, 215, 8>>}, %{amount: 0, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>}, %{amount: 0, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>}, %{amount: 0, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>}]}, signed_tx_bytes: nil, sigs: [<<95, 47, 135, 253, 150, 132, 113, 83, 52, 114, 235, 166, 88, 44, 182, 27, 128, 6, 206, 198, 178, 176, 226, 146, 100, 6, 252, 204, 154, 191, 105, 2, 126, 54, 70, 229, 203, 172, 107, ...>>]}}, <<111, 131, 146, 125, 71, 86, 162, 126, 71, 74, 144, 199, 8, 208, 138, 113, 246, 168, 26, 245, 50, 231, 80, 211, 236, 69, 201, 157, 182, 149, 211, 238>> => %OMG.Watcher.ExitProcessor.CompetitorInfo{competing_input_index: 0, competing_input_signature: <<208, 138, 238, 15, 28, 71, 112, 128, 135, 30, 209, 68, 79, 99, 26, 237, 118, 221, 179, 32, 253, 66, 115, 3, 130, 6, 36, 231, 102, 247, 12, 80, 95, 91, 7, 239, 13, 21, 41, 2, 192, 76, 195, ...>>, tx: %OMG.API.State.Transaction.Signed{raw_tx: %OMG.API.State.Transaction{inputs: [%{blknum: 88002, oindex: 0, txindex: 0}, %{blknum: 0, oindex: 0, txindex: 0}, %{blknum: 0, oindex: 0, txindex: 0}, %{blknum: 0, oindex: 0, txindex: 0}], outputs: [%{amount: 9, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<131, 22, 38, 25, 106, 35, 178, 202, 36, 239, 138, 121, 90, 96, 132, 55, 44, 185, 161, 193>>}, %{amount: 1, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<211, 135, 183, 91, 96, 210, 71, 152, 137, 144, 134, 120, 136, 127, 42, 235, 50, 221, 215, 8>>}, %{amount: 0, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>}, %{amount: 0, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>}]}, signed_tx_bytes: nil, sigs: [<<208, 138, 238, 15, 28, 71, 112, 128, 135, 30, 209, 68, 79, 99, 26, 237, 118, 221, 179, 32, 253, 66, 115, 3, 130, 6, 36, 231, 102, 247, 12, 80, 95, 91, 7, 239, 13, 21, ...>>]}}, <<128, 179, 44, 122, 103, 36, 204, 127, 151, 184, 247, 6, 15, 128, 78, 110, 113, 109, 201, 125, 19, 52, 186, 194, 48, 235, 103, 160, 89, 22, 197, 201>> => %OMG.Watcher.ExitProcessor.CompetitorInfo{competing_input_index: 0, competing_input_signature: <<81, 133, 116, 4, 172, 120, 101, 166, 144, 71, 153, 108, 136, 4, 69, 49, 57, 16, 254, 2, 223, 44, 112, 129, 187, 250, 182, 84, 207, 79, 70, 8, 13, 81, 153, 214, 83, 103, 175, 119, 233, 28, ...>>, tx: %OMG.API.State.Transaction.Signed{raw_tx: %OMG.API.State.Transaction{inputs: [%{blknum: 93000, oindex: 0, txindex: 0}, %{blknum: 0, oindex: 0, txindex: 0}, %{blknum: 0, oindex: 0, txindex: 0}, %{blknum: 0, oindex: 0, txindex: 0}], outputs: [%{amount: 4, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<211, 135, 183, 91, 96, 210, 71, 152, 137, 144, 134, 120, 136, 127, 42, 235, 50, 221, 215, 8>>}, %{amount: 0, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>}, %{amount: 0, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>}, %{amount: 0, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>}]}, signed_tx_bytes: nil, sigs: [<<81, 133, 116, 4, 172, 120, 101, 166, 144, 71, 153, 108, 136, 4, 69, 49, 57, 16, 254, 2, 223, 44, 112, 129, 187, 250, 182, 84, 207, 79, 70, 8, 13, 81, 153, 214, 83, ...>>]}}}, exits: %{{:utxo_position, 41000, 0, 1} => %OMG.Watcher.ExitProcessor.ExitInfo{amount: 211200000, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, eth_height: 3909229, is_active: true, owner: <<248, 107, 91, 28, 44, 141, 225, 234, 77, 199, 55, 200, 73, 39, 35, 64, 250, 53, 97, 197>>}, {:utxo_position, 88000, 0, 2} => %OMG.Watcher.ExitProcessor.ExitInfo{amount: 1, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, eth_height: 3914646, is_active: true, owner: <<211, 135, 183, 91, 96, 210, 71, 152, 137, 144, 134, 120, 136, 127, 42, 235, 50, 221, 215, 8>>}}, in_flight_exits: %{<<5, 25, 246, 202, 22, 10, 22, 70, 48, 85, 161, 205, 64, 232, 27, 213, 15, 100, 114, 178, 178, 199, 135, 141, 109, 176, 223, 160, 38, 20, 207, 27>> => %{__struct__: OMG.Watcher.ExitProcessor.InFlightExitInfo, contract_id: 2370316990351448335720246544088407191758179935141667380790, eth_height: 3914978, exit_map: %{0 => %{is_finalized: false, is_piggybacked: false}, 1 => %{is_finalized: false, is_piggybacked: false}, 2 => %{is_finalized: false, is_piggybacked: false}, 3 => %{is_finalized: false, is_piggybacked: false}, 4 => %{is_finalized: false, is_piggybacked: false}, 5 => %{is_finalized: false, is_piggybacked: false}, 6 => %{is_finalized: false, is_piggybacked: false}, 7 => %{is_finalized: false, is_piggybacked: false}}, is_active: true, is_canonical: true, oldest_competitor: nil, timestamp: 1550853739, tx: %OMG.API.State.Transaction.Signed{raw_tx: %OMG.API.State.Transaction{inputs: [%{blknum: 92000, oindex: 0, txindex: 0}, %{blknum: 0, oindex: 0, txindex: 0}, %{blknum: 0, oindex: 0, txindex: 0}, %{blknum: 0, oindex: 0, txindex: 0}], outputs: [%{amount: 5, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<211, 135, 183, 91, 96, 210, 71, 152, 137, 144, 134, 120, 136, 127, 42, 235, 50, 221, 215, 8>>}, %{amount: 0, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>}, %{amount: 0, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>}, %{amount: 0, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>}]}, signed_tx_bytes: nil, sigs: [<<95, 47, 135, 253, 150, 132, 113, 83, 52, 114, 235, 166, 88, 44, 182, 27, 128, 6, 206, 198, 178, 176, 226, 146, 100, 6, 252, 204, 154, 191, 105, ...>>]}, tx_pos: nil}, <<31, 74, 173, 77, 68, 34, 166, 4, 205, 30, 146, 119, 237, 111, 157, 147, 234, 58, 235, 240, 130, 196, 193, 237, 144, 112, 108, 148, 183, 87, 253, 240>> => %{__struct__: OMG.Watcher.ExitProcessor.InFlightExitInfo, contract_id: 3781925471690620519351709730178971532336882711452340714464, eth_height: 3909406, exit_map: %{0 => %{is_finalized: false, is_piggybacked: false}, 1 => %{is_finalized: false, is_piggybacked: false}, 2 => %{is_finalized: false, is_piggybacked: false}, 3 => %{is_finalized: false, is_piggybacked: false}, 4 => %{is_finalized: false, is_piggybacked: false}, 5 => %{is_finalized: false, is_piggybacked: false}, 6 => %{is_finalized: false, is_piggybacked: false}, 7 => %{is_finalize (truncated)⋅
watcher-0 watcher 2019-02-27 03:43:33.086 [info] module=application_controller function=info_exited/3 ⋅Application omg_watcher exited: OMG.Watcher.Application.start(:normal, []) returned an error: shutdown: failed to start child: OMG.Watcher.BlockGetter.Supervisor
watcher-0 watcher     ** (EXIT) shutdown: failed to start child: OMG.Watcher.BlockGetter
watcher-0 watcher         ** (EXIT) exited in: GenServer.call(OMG.Watcher.ExitProcessor, :check_validity, 5000)
watcher-0 watcher ** (MatchError) no match of right hand side value: {:error, {:omg_watcher, {{:shutdown, {:failed_to_start_child, OMG.Watcher.BlockGetter.Supervisor, {:shutdown, {:failed_to_start_child, OMG.Watcher.BlockGetter, {{{:badkey, :tx_seen_in_blocks_at, %{__struct__: OMG.Watcher.ExitProcessor.InFlightExitInfo, contract_id: 2370316990351448335720246544088407191758179935141667380790, eth_height: 3914978, exit_map: %{0 => %{is_finalized: false, is_piggybacked: false}, 1 => %{is_finalized: false, is_piggybacked: false}, 2 => %{is_finalized: false, is_piggybacked: false}, 3 => %{is_finalized: false, is_piggybacked: false}, 4 => %{is_finalized: false, is_piggybacked: false}, 5 => %{is_finalized: false, is_piggybacked: false}, 6 => %{is_finalized: false, is_piggybacked: false}, 7 => %{is_finalized: false, is_piggybacked: false}}, is_active: true, is_canonical: true, oldest_competitor: nil, timestamp: 1550853739, tx: %OMG.API.State.Transaction.Signed{raw_tx: %OMG.API.State.Transaction{inputs: [%{blknum: 92000, oindex: 0, txindex: 0}, %{blknum: 0, oindex: 0, txindex: 0}, %{blknum: 0, oindex: 0, txindex: 0}, %{blknum: 0, oindex: 0, txindex: 0}], outputs: [%{amount: 5, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, ...>>, owner: <<211, 135, 183, 91, 96, 210, 71, 152, 137, 144, 134, 120, 136, 127, ...>>}, %{amount: 0, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, ...>>, owner: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, ...>>}, %{amount: 0, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, ...>>, owner: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, ...>>}, %{amount: 0, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, ...>>, owner: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, ...>>}]}, signed_tx_bytes: nil, sigs: [<<95, 47, 135, 253, 150, 132, 113, 83, 52, 114, 235, 166, 88, 44, 182, 27, 128, ...>>]}, tx_pos: nil}}, [{OMG.Watcher.ExitProcessor.Core, :"-find_ifes_in_blocks/2-fun-2-", 1, [file: 'lib/exit_processor/core.ex', line: 916]}, {Enum, :"-filter/2-fun-0-", 3, [file: 'lib/enum.ex', line: 907]}, {:maps, :fold_1, 3, [file: 'maps.erl', line: 257]}, {Enum, :filter, 2, [file: 'lib/enum.ex', line: 1956]}, {OMG.Watcher.ExitProcessor.Core, :find_ifes_in_blocks, 2, [file: 'lib/exit_processor/core.ex', line: 916]}, {OMG.Watcher.ExitProcessor, :prepare_validity_check, 1, [file: 'lib/exit_processor.ex', line: 336]}, {OMG.Watcher.ExitProcessor, :handle_call, 3, [file: 'lib/exit_processor.ex', line: 255]}, {:gen_server, :try_handle_call, 4, [file: 'gen_server.erl', line: 661]}, {:gen_server, :handle_msg, 6, [file: 'gen_server.erl', line: 690]}, {:proc_lib, :init_p_do_apply, 3, [file: 'proc_lib.erl', line: 249]}]}, {GenServer, :call, [OMG.Watcher.ExitProcessor, :check_validity, 5000]}}}}}}, {OMG.Watcher.Application, :start, [:normal, []]}}}}
watcher-0 watcher             ** (EXIT) an exception was raised:
watcher-0 watcher                 ** (KeyError) key :tx_seen_in_blocks_at not found in: %{__struct__: OMG.Watcher.ExitProcessor.InFlightExitInfo, contract_id: 2370316990351448335720246544088407191758179935141667380790, eth_height: 3914978, exit_map: %{0 => %{is_finalized: false, is_piggybacked: false}, 1 => %{is_finalized: false, is_piggybacked: false}, 2 => %{is_finalized: false, is_piggybacked: false}, 3 => %{is_finalized: false, is_piggybacked: false}, 4 => %{is_finalized: false, is_piggybacked: false}, 5 => %{is_finalized: false, is_piggybacked: false}, 6 => %{is_finalized: false, is_piggybacked: false}, 7 => %{is_finalized: false, is_piggybacked: false}}, is_active: true, is_canonical: true, oldest_competitor: nil, timestamp: 1550853739, tx: %OMG.API.State.Transaction.Signed{raw_tx: %OMG.API.State.Transaction{inputs: [%{blknum: 92000, oindex: 0, txindex: 0}, %{blknum: 0, oindex: 0, txindex: 0}, %{blknum: 0, oindex: 0, txindex: 0}, %{blknum: 0, oindex: 0, txindex: 0}], outputs: [%{amount: 5, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<211, 135, 183, 91, 96, 210, 71, 152, 137, 144, 134, 120, 136, 127, 42, 235, 50, 221, 215, 8>>}, %{amount: 0, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>}, %{amount: 0, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>}, %{amount: 0, currency: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>, owner: <<0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0>>}]}, signed_tx_bytes: nil, sigs: [<<95, 47, 135, 253, 150, 132, 113, 83, 52, 114, 235, 166, 88, 44, 182, 27, 128, 6, 206, 198, 178, 176, 226, 146, 100, 6, 252, 204, 154, 191, 105, 2, 126, 54, 70, 229, 203, ...>>]}, tx_pos: nil}
watcher-0 watcher                     (omg_watcher) lib/exit_processor/core.ex:916: anonymous fn/1 in OMG.Watcher.ExitProcessor.Core.find_ifes_in_blocks/2
watcher-0 watcher                     (elixir) lib/enum.ex:907: anonymous fn/3 in Enum.filter/2
watcher-0 watcher                     (stdlib) maps.erl:257: :maps.fold_1/3
watcher-0 watcher                     (elixir) lib/enum.ex:1956: Enum.filter/2
watcher-0 watcher                     (omg_watcher) lib/exit_processor/core.ex:916: OMG.Watcher.ExitProcessor.Core.find_ifes_in_blocks/2
watcher-0 watcher                     (omg_watcher) lib/exit_processor.ex:336: OMG.Watcher.ExitProcessor.prepare_validity_check/1
watcher-0 watcher                     (omg_watcher) lib/exit_processor.ex:255: OMG.Watcher.ExitProcessor.handle_call/3
watcher-0 watcher                     (stdlib) gen_server.erl:661: :gen_server.try_handle_call/4
watcher-0 watcher                     (stdlib) gen_server.erl:690: :gen_server.handle_msg/6
watcher-0 watcher                     (stdlib) proc_lib.erl:249: :proc_lib.init_p_do_apply/3⋅
watcher-0 watcher 2019-02-27 03:43:33.087 [info] module=application_controller function=info_exited/3 ⋅Application phoenix_ecto exited: :stopped⋅
watcher-0 watcher 2019-02-27 03:43:33.087 [info] module=application_controller function=info_exited/3 ⋅Application ecto exited: :stopped⋅
watcher-0 watcher 2019-02-27 03:43:33.088 [info] module=application_controller function=info_exited/3 ⋅Application cors_plug exited: :stopped⋅
watcher-0 watcher 2019-02-27 03:43:33.088 [info] module=application_controller function=info_exited/3 ⋅Application omg_eth exited: :stopped⋅
watcher-0 watcher 2019-02-27 03:43:33.088 [info] module=application_controller function=info_exited/3 ⋅Application exexec exited: :stopped⋅
watcher-0 watcher 2019-02-27 03:43:33.088 [info] module=application_controller function=info_exited/3 ⋅Application ethereumex exited: :stopped⋅
watcher-0 watcher 2019-02-27 03:43:33.088 [info] module=application_controller function=info_exited/3 ⋅Application httpoison exited: :stopped⋅
watcher-0 watcher 2019-02-27 03:43:33.088 [info] module=application_controller function=info_exited/3 ⋅Application poolboy exited: :stopped⋅
watcher-0 watcher 2019-02-27 03:43:33.088 [info] module=application_controller function=info_exited/3 ⋅Application ex_abi exited: :stopped⋅
watcher-0 watcher 2019-02-27 03:43:33.088 [info] module=application_controller function=info_exited/3 ⋅Application exth_crypto exited: :stopped⋅
watcher-0 watcher 2019-02-27 03:43:33.088 [info] module=application_controller function=info_exited/3 ⋅Application keccakf1600 exited: :stopped⋅
watcher-0 watcher 2019-02-27 03:43:33.088 [info] module=application_controller function=info_exited/3 ⋅Application binary exited: :stopped⋅
watcher-0 watcher 2019-02-27 03:43:33.088 [info] module=application_controller function=info_exited/3 ⋅Application libsecp256k1 exited: :stopped⋅
watcher-0 watcher 2019-02-27 03:43:33.096 [info] module=application_controller function=info_exited/3 ⋅Application omg_db exited: :stopped⋅
watcher-0 watcher 2019-02-27 03:43:33.096 [info] module=application_controller function=info_exited/3 ⋅Application exleveldb exited: :stopped⋅
watcher-0 watcher     lib/utils.ex:25: XomgTasks.Utils.generic_run/2
watcher-0 watcher     (mix) lib/mix/task.ex:331: Mix.Task.run_task/3
watcher-0 watcher     (mix) lib/mix/cli.ex:79: Mix.CLI.run_task/2
watcher-0 watcher     (elixir) lib/code.ex:767: Code.require_file/2
watcher-0 watcher 2019-02-27 03:43:33.096 [info] module=application_controller function=info_exited/3 ⋅Application eleveldb exited: :stopped⋅
watcher-0 watcher 2019-02-27 03:43:33.097 [info] module=application_controller function=info_exited/3 ⋅Application appsignal exited: :stopped⋅
watcher-0 watcher 2019-02-27 03:43:33.097 [info] module=application_controller function=info_exited/3 ⋅Application poison exited: :stopped⋅
watcher-0 watcher 2019-02-27 03:43:33.098 [info] module=application_controller function=info_exited/3 ⋅Application hackney exited: :stopped⋅
watcher-0 watcher 2019-02-27 03:43:33.098 [info] module=application_controller function=info_exited/3 ⋅Application metrics exited: :stopped⋅
watcher-0 watcher 2019-02-27 03:43:33.098 [info] module=application_controller function=info_exited/3 ⋅Application ssl_verify_fun exited: :stopped⋅
watcher-0 watcher 2019-02-27 03:43:33.098 [info] module=application_controller function=info_exited/3 ⋅Application certifi exited: :stopped⋅
watcher-0 watcher 2019-02-27 03:43:33.098 [info] module=application_controller function=info_exited/3 ⋅Application mimerl exited: :stopped⋅
watcher-0 watcher 2019-02-27 03:43:33.098 [info] module=application_controller function=info_exited/3 ⋅Application idna exited: :stopped⋅
watcher-0 watcher 2019-02-27 03:43:33.098 [info] module=application_controller function=info_exited/3 ⋅Application unicode_util_compat exited: :stopped⋅
watcher-0 watcher 2019-02-27 03:43:33.098 [info] module=application_controller function=info_exited/3 ⋅Application decorator exited: :stopped⋅
watcher-0 watcher 2019-02-27 03:43:33.099 [info] module=application_controller function=info_exited/3 ⋅Application postgrex exited: :stopped⋅
watcher-0 watcher 2019-02-27 03:43:33.100 [info] module=application_controller function=info_exited/3 ⋅Application db_connection exited: :stopped⋅
watcher-0 watcher 2019-02-27 03:43:33.100 [info] module=application_controller function=info_exited/3 ⋅Application connection exited: :stopped⋅
watcher-0 watcher 2019-02-27 03:43:33.100 [info] module=application_controller function=info_exited/3 ⋅Application fake_server exited: :stopped⋅
watcher-0 watcher 2019-02-27 03:43:33.101 [info] module=application_controller function=info_exited/3 ⋅Application briefly exited: :stopped⋅
watcher-0 watcher 2019-02-27 03:43:33.101 [info] module=application_controller function=info_exited/3 ⋅Application deferred_config exited: :stopped⋅
watcher-0 watcher 2019-02-27 03:43:33.101 [info] module=application_controller function=info_exited/3 ⋅Application socket exited: :stopped⋅
watcher-0 watcher 2019-02-27 03:43:33.102 [info] module=application_controller function=info_exited/3 ⋅Application runtime_tools exited: :stopped⋅

[0x234]

I believe #468 will fix this.

[pdobacz]

This looks unrelated to #468.

Rather this looks like the aftermath of premature merging of OMG-313 in #422 , it is being made right now in #471.

Does this make sense (e.g. compared to which sha have you seen it on @JBunCE)?

[pdobacz]

I think we can close this now, it was related to the back and forth with the PRs as mentioned above. Also, I think the deployments kick off cleanly now.