Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upgrade (v13) Time Reached, No Alarm #45

Open
gaia opened this issue Dec 8, 2022 · 0 comments
Open

Upgrade (v13) Time Reached, No Alarm #45

gaia opened this issue Dec 8, 2022 · 0 comments

Comments

@gaia
Copy link

gaia commented Dec 8, 2022

Running the latest version

2022/12/08 05:44:23 tenderduty |  🧊 osmosis-1    block 7241420
2022/12/08 05:46:21 tenderduty |  🧊 osmosis-1    block 7241440
2022/12/08 05:48:16 tenderduty |  🧊 osmosis-1    block 7241460
2022/12/08 05:50:12 tenderduty |  🧊 osmosis-1    block 7241480 _(v13 Upgrade Height)_
2022/12/08 05:53:46 tenderduty |  🛑 osmosis-1 websocket idle for 1 minute, exiting
2022/12/08 05:53:46 tenderduty |  osmosis-1 🌀 websocket exited! Restarting monitoring
2022/12/08 05:53:51 tenderduty |  ⚙️ osmosis-1    watching for NewBlock and Vote events via http://192.168.0.56:31657
2022/12/08 05:54:51 tenderduty |  🛑 osmosis-1 websocket idle for 1 minute, exiting
2022/12/08 05:54:51 tenderduty |  osmosis-1 🌀 websocket exited! Restarting monitoring
2022/12/08 05:54:56 tenderduty |  ⚙️ osmosis-1    watching for NewBlock and Vote events via http://192.168.0.56:31657
2022/12/08 05:55:56 tenderduty |  🛑 osmosis-1 websocket idle for 1 minute, exiting
2022/12/08 05:55:56 tenderduty |  osmosis-1 🌀 websocket exited! Restarting monitoring

then it just looped like that until (2.5 hrs later), I got another alert that the node was down and restarted it with the upgraded version (we don't use Cosmovisor, and the upgrade height came earlier than expected)

2022/12/08 08:39:41 tenderduty |  osmosis-1 🌀 websocket exited! Restarting monitoring
2022/12/08 08:39:46 tenderduty |  ⚙️ osmosis-1    watching for NewBlock and Vote events via http://192.168.0.56:31657
2022/12/08 08:40:46 tenderduty |  🛑 osmosis-1 websocket idle for 1 minute, exiting
2022/12/08 08:40:46 tenderduty |  osmosis-1 🌀 websocket exited! Restarting monitoring
2022/12/08 08:40:51 tenderduty |  ⚙️ osmosis-1    watching for NewBlock and Vote events via http://192.168.0.56:31657
2022/12/08 08:41:25 tenderduty |  osmosis-1 🌀 websocket exited! Restarting monitoring
2022/12/08 08:41:30 tenderduty |  osmosis-1 ⛑ attemtping to use public fallback node https://rpc-osmosis.ecostake.com:443
2022/12/08 08:41:31 tenderduty |  osmosis-1 ⛑ connected to public endpoint https://rpc-osmosis.ecostake.com:443
2022/12/08 08:41:34 tenderduty |  ⚙️ osmosis-1    watching for NewBlock and Vote events via https://rpc-osmosis.ecostake.com:443
2022/12/08 08:41:35 tenderduty |  🚨 ALERT        new alarm on Osmosis (Validator has missed > 2% of the slashing window's blocks on osmosis-1) - notifying PagerDuty
2022/12/08 08:41:44 tenderduty |  🧊 osmosis-1    block 7243020
2022/12/08 08:41:44 tenderduty |  ❌ warning      Validator missed block 7243020 on osmosis-1
2022/12/08 08:41:44 tenderduty |  ❌ warning      Validator  missed block 7243021 on osmosis-1
2022/12/08 08:41:50 tenderduty |  ❌ warning      Validator  missed block 7243022 on osmosis-1

Settings:
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant