Improve Gaia QA process

[mpoke]

Problem

To enable a regular release cycle of a rock-solid Gaia, we need to improve the QA process so that we can identify bugs faster.

Task list

Must have

Beta Give feedback

1. Set up nightly testing workflow with Hypha #2426
   scope: testing +1
   
2. Evaluate Tendermock #2173
   general questions scope: testing +2
   
3. Outline long term QA goals #2427
   scope: testing type: feature-request +2
   
4. Categorize past bug reports #2414
   scope: docs +1
   
5. Refactor and simplify e2e testing startup #2434
   S: Productivity scope: testing type: feature-request type: tech-debt +4
   
6. Refactor and simplify e2e test traces loading and execution #2435
   1 of 2
   S: Productivity admin: epic other: decayed scope: testing type: feature-request type: tech-debt +6
   
7. Improve usability/documentation of Gaia e2e tests #2902
   0 of 3
   S: Productivity admin: epic scope: docs scope: testing +4
   

Nice to have

Beta Give feedback

1. Improve our data collection regarding bugs #2420
   S: Productivity +1
   
2. Assessing MBT landscape and what we want our testing product to look like #2428
   S: Productivity +1
3. Spike: Implement CometMock prototype in Go interchain-security#917
   scope: testing +1
   

Existing e2e-related issues

Beta Give feedback

1. assess the relevance of these issues
2. EPIC: tests - compatibility, e2e, github action #1318
   S: Productivity admin: epic more-info-needed scope: testing +4
3. Refactor: e2e test #1608
   S: Productivity admin: epic more-info-needed scope: testing type: tech-debt +5
4. Add AuthZ E2E Tests #1632
   S: Productivity scope: testing +2
5. Create Gov mediated ICA E2E Test #1746
   S: Productivity scope: testing +2
   
6. refactor: e2e ibc test #2570
   S: Productivity code-hygiene scope: testing +3