Skip to content

Conversation

@willcl-ark
Copy link
Contributor

@willcl-ark willcl-ark commented Aug 7, 2024

I think our log grepper is quite powerful but a bit clunky to use. Improve it.

  • Strip k8s logtime which makes it ugly, unless specified
  • Sort the log lines alpabetically (optional, on by default, nice for bitcoind logs!)
    *Prepend pod name to each log

Before this PR:

₿ warcli bitcoin grep-logs Initializing
2024-08-07T10:18:21.161356518Z 2024-08-07T10:18:21.161342Z Initializing databases...
2024-08-07T10:18:21.161461071Z 2024-08-07T10:18:21.161448Z Initializing chainstate Chainstate [ibd] @ height -1 (null)
2024-08-07T10:18:21.323877797Z 2024-08-07T10:18:21.323865Z Initializing databases...
2024-08-07T10:18:21.323983338Z 2024-08-07T10:18:21.323967Z Initializing chainstate Chainstate [ibd] @ height -1 (null)
2024-08-07T10:18:21.551314578Z 2024-08-07T10:18:21.551302Z Initializing databases...
2024-08-07T10:18:21.551435664Z 2024-08-07T10:18:21.551413Z Initializing chainstate Chainstate [ibd] @ height -1 (null)
2024-08-07T10:18:21.817181115Z 2024-08-07T10:18:21.817157Z Initializing databases...
2024-08-07T10:18:21.817275403Z 2024-08-07T10:18:21.817255Z Initializing chainstate Chainstate [ibd] @ height -1 (null)
2024-08-07T10:18:22.060957785Z 2024-08-07T10:18:22.060934Z Initializing databases...
2024-08-07T10:18:22.061057790Z 2024-08-07T10:18:22.061031Z Initializing chainstate Chainstate [ibd] @ height -1 (null)
2024-08-07T10:18:22.305982959Z 2024-08-07T10:18:22.305969Z Initializing databases...
2024-08-07T10:18:22.306090335Z 2024-08-07T10:18:22.306068Z Initializing chainstate Chainstate [ibd] @ height -1 (null)
2024-08-07T10:18:22.305975622Z 2024-08-07T10:18:22.305958Z Initializing databases...
2024-08-07T10:18:22.306078788Z 2024-08-07T10:18:22.306064Z Initializing chainstate Chainstate [ibd] @ height -1 (null)
2024-08-07T10:18:22.455449969Z 2024-08-07T10:18:22.455391Z Initializing databases...
2024-08-07T10:18:22.455536429Z 2024-08-07T10:18:22.455513Z Initializing chainstate Chainstate [ibd] @ height -1 (null)
2024-08-07T10:18:22.441591344Z 2024-08-07T10:18:22.441581Z Initializing databases...
2024-08-07T10:18:22.441821913Z 2024-08-07T10:18:22.441712Z Initializing chainstate Chainstate [ibd] @ height -1 (null)
2024-08-07T10:18:22.485264186Z 2024-08-07T10:18:22.485250Z Initializing databases...
2024-08-07T10:18:22.485390875Z 2024-08-07T10:18:22.485365Z Initializing chainstate Chainstate [ibd] @ height -1 (null)
2024-08-07T10:18:22.547192744Z 2024-08-07T10:18:22.547181Z Initializing databases...
2024-08-07T10:18:22.547295334Z 2024-08-07T10:18:22.547280Z Initializing chainstate Chainstate [ibd] @ height -1 (null)
2024-08-07T10:18:22.671101862Z 2024-08-07T10:18:22.671022Z Initializing databases...
2024-08-07T10:18:22.671232129Z 2024-08-07T10:18:22.671135Z Initializing chainstate Chainstate [ibd] @ height -1 (null)

After this PR (sorted, with pod name prepended):

₿ warcli bitcoin grep-logs Initializing
warnet-tank-000000: 2024-08-07T10:18:21.161342Z Initializing databases...
warnet-tank-000000: 2024-08-07T10:18:21.161448Z Initializing chainstate Chainstate [ibd] @ height -1 (null)
warnet-tank-000001: 2024-08-07T10:18:21.323865Z Initializing databases...
warnet-tank-000001: 2024-08-07T10:18:21.323967Z Initializing chainstate Chainstate [ibd] @ height -1 (null)
warnet-tank-000002: 2024-08-07T10:18:21.551302Z Initializing databases...
warnet-tank-000002: 2024-08-07T10:18:21.551413Z Initializing chainstate Chainstate [ibd] @ height -1 (null)
warnet-tank-000003: 2024-08-07T10:18:21.817157Z Initializing databases...
warnet-tank-000003: 2024-08-07T10:18:21.817255Z Initializing chainstate Chainstate [ibd] @ height -1 (null)
warnet-tank-000004: 2024-08-07T10:18:22.060934Z Initializing databases...
warnet-tank-000004: 2024-08-07T10:18:22.061031Z Initializing chainstate Chainstate [ibd] @ height -1 (null)
warnet-tank-000006: 2024-08-07T10:18:22.305958Z Initializing databases...
warnet-tank-000005: 2024-08-07T10:18:22.305969Z Initializing databases...
warnet-tank-000006: 2024-08-07T10:18:22.306064Z Initializing chainstate Chainstate [ibd] @ height -1 (null)
warnet-tank-000005: 2024-08-07T10:18:22.306068Z Initializing chainstate Chainstate [ibd] @ height -1 (null)
warnet-tank-000008: 2024-08-07T10:18:22.441581Z Initializing databases...
warnet-tank-000008: 2024-08-07T10:18:22.441712Z Initializing chainstate Chainstate [ibd] @ height -1 (null)
warnet-tank-000007: 2024-08-07T10:18:22.455391Z Initializing databases...
warnet-tank-000007: 2024-08-07T10:18:22.455513Z Initializing chainstate Chainstate [ibd] @ height -1 (null)
warnet-tank-000009: 2024-08-07T10:18:22.485250Z Initializing databases...
warnet-tank-000009: 2024-08-07T10:18:22.485365Z Initializing chainstate Chainstate [ibd] @ height -1 (null)
warnet-tank-000010: 2024-08-07T10:18:22.547181Z Initializing databases...
warnet-tank-000010: 2024-08-07T10:18:22.547280Z Initializing chainstate Chainstate [ibd] @ height -1 (null)
warnet-tank-000011: 2024-08-07T10:18:22.671022Z Initializing databases...
warnet-tank-000011: 2024-08-07T10:18:22.671135Z Initializing chainstate Chainstate [ibd] @ height -1 (null)

This would mean that when for example searching for a txid of block hash, the results would be returned in node processing order.

@mplsgrant
Copy link
Collaborator

rebased on main

@m3dwards m3dwards merged commit 934f765 into bitcoin-dev-project:main Aug 13, 2024
@m3dwards
Copy link
Collaborator

LGTM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants