Skip to content

Trace the end-to-end time spent on handling GMessages #945

Open
@masih

Description

@masih

Add detailed time metrics to trace exactly how much time is spent on what right from sub.Next for granite topic to the end when the message is either buffered elsewhere for post processing or handed to gpbft.

Context
In passive testing at scale 50% we see "subscriber too slow" logs increase with QUALITY quorum of senders drop to ~50%. When the buffer size was doubled to 256, the log rate decreased and the quorum of senders in QUALITY phase increased to ~65%.

We need these metrics to understand what exactly is slow in processing.
We know that a fair chunk of time is spent on fetch committee ( though testes were run with power override which does significantly reduce the time spent on fetching committee )

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    Status

    Todo

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions