v44 Chain upgrade with IBC v2.0, Hermes

[blewater]

This is WIP.

1. Set max_expected_time_per_block param

Chains have experienced IBC connectivity issues when they omitted the following in their upgrade handler or genesis migration

            // set max expected block time parameter. Replace the default with your expected value
            // https://github.com/cosmos/ibc-go/blob/release/v1.0.x/docs/ibc/proto-docs.md#params-2
            app.IBCKeeper.ConnectionKeeper.SetParams(ctx, ibcconnectiontypes.DefaultParams())

e.g. a chain patch to add it reference

How it looks in our test handler

2. Do not change the chain-ID during an upgrade unless it is accompanied with an IBC client upgrade

Copying here from the IBC upgrade guide

WARNING: Please read at least the quick guide for IBC client upgrades before upgrading your chain. It is highly recommended you do not change the chain-ID during an upgrade, otherwise, you must follow the IBC client upgrade instructions.

Details here

3. Upgrade the Hermes configuration to their revamped v0.9+ format

Our working testnet configuration: https://github.com/e-money/em-ledger/blob/v44-ibc-1.x/networks/ibc/emoney-config.toml

[blewater]

Adding a note on Hermes v0.9 errors when testing with Gaia v6 (go mod github.com/cosmos/ibc-go/v2 v2.0.0). Similar output is expected when testing with any ibc-go > v1.2.x chain till they release a 2.0 compatible relayer:

2021-12-01T16:58:13.393471Z ERROR ThreadId(35) [localnet_reuse] estimate_gas: failed to simulate tx with non-recoverable error: gRPC call failed with status: status: InvalidArgument, message: "account sequence mismatch, expected 11, got 10: incorrect account sequence: invalid request", details: [], metadata: MetadataMap { headers: {"content-type": "application/grpc"} }
2021-12-01T16:58:13.393500Z ERROR ThreadId(37) [gaia:transfer/channel-0 -> localnet_reuse] worker: schedule execution encountered error: failed with underlying error: gRPC call failed with status: status: InvalidArgument, message: "account sequence mismatch, expected 11, got 10: incorrect account sequence: invalid request", details: [], metadata: MetadataMap { headers: {"content-type": "application/grpc"} }```