[poll] Which of the four verdicts is most common in your system?

[akash-coded]

Calibration poll. Guess, then go and measure, then reply with what you actually found.

Every failed answer is one of four things — see The Four Verdicts:

• A — Retrieval miss. The evidence was never in the candidate pool
• B — Packing loss. It was in the pool and did not survive into the prompt
• C — Generation failure. It was in the prompt and the answer was still wrong
• D — Right by accident. The answer was right and the evidence was never retrieved

The interesting part

On this repository's corpus the split was 84 packing loss against 27 retrieval miss — the
bottleneck was three-to-one on the stage nobody was working on.

Most people guess A. Most people are wrong, and they are wrong in a direction that costs a month
of encoder work on a problem that was k=8.

How to vote. The API cannot create a native poll widget, so vote with a reaction on this post — 👍 A · 🎉 B · 😄 C · 🚀 D — and reply if your answer needs a condition attached. The reveal is posted as a reply in about a week, never by editing this body: editing would destroy the record of what you were actually asked.