What did you get wrong that took longest to find? #135
akash-coded
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
War stories, specifically the ones where the system was working perfectly and the results were
wrong. Those are the expensive ones, because nothing errors and no alert fires.
Three from this repository, all real, all in the tracker:
ERR_CONN_RESETinto three terms present in every document. Query matched everything, ranked nothing. Zero errors.recall@20 = 0.00atef=64— not degraded, structurally impossibleWhat to include
The detection gap is the valuable part. Not "what broke" but "why did we find out the way we
did, and what measurement would have caught it sooner?" That is the last line of every
postmortem in the incident runbook,
and it is the one people skip.
All reactions