Repository navigation
Contributing
| Role | First useful contribution |
|---|---|
| Domain annotator | Prepare source-backed propositions without seeing model outputs; record legitimate alternatives and ambiguity |
| Adjudicator | Resolve disagreements with source evidence and retain dissent |
| Technical reproducer | Run a pinned evaluator and challenge a precise consistency or reproducibility claim |
| Business participant | Join a supervised review session measuring effort, omissions and abandoned tasks |
| Corpus contributor | Propose a public source family, provenance, version and reuse terms |
| External custodian | Discuss independent commitment timing, access, conflicts and custody |
Express interest or open a public issue. An expression of interest is not appointment, enrolment or authorship.
Include the release or commit, exact command, expected and observed behaviour, and a minimal synthetic reproducer. Keep original receipts identifiable. A semantic or denominator change needs a dated correction and an explicit account of affected results.
State the source URL and rights, document family, workflow, task boundary, answerability, reference preparation, accepted alternatives and prohibited inferences. Declare whether the source or answers have been exposed to PALO development or evaluated systems. Existing development cases cannot be relabelled held out.
Use a topic branch and a focused pull request. Install the declared requirements, run relevant checks and explain changes in numerator/denominator behaviour. The wiki's reviewed source lives in wiki/; propose changes there so they can be reviewed and synced.
Do not post company documents, credentials, personal datasets or active held-out gold. Use public or synthetic evidence. Participation, data access and attribution require their own agreements.
Research pilot | Zero qualified held-out results | Versioned wiki source | Corrections