Experiment reports: paired-world tests for delegated work #428
dongkeren
started this conversation in
Experiments & Evidence
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Purpose
This thread is for runnable or manually reproducible tests of the six paired-world questions in the core runtime-semantics challenge. You may use KFD, another framework, a vendor runtime, or an independent harness.
The useful experimental shape is a pair of histories that should lead to different decisions but may collapse to the same state visible to the tested decision function.
Question IDs
You may test one pair or all six. Preserve the question ID in the report so results can be compared across runtimes.
Minimal report template
A failed or inconclusive run is useful. Passing a self-authored reference implementation is implementation evidence, not proof that every runtime has the same semantics.
Post a reply here for a small result, or open a separate Show and tell discussion for a substantial experiment. Formal counterevidence can be promoted to the KFD evidence form.
All reactions