Study 001: call for two independent blinded reviewers

[aklodhi98]

Study 001: call for two independent blinded reviewers

Human Standards is preparing the independent review stage of Study 001, an
exploratory controlled comparison of nine AI-built interfaces for a fictional
community clinic appointment service.

We are looking for two independent reviewers with complementary practical
expertise in product or interaction design, usability research, human factors,
digital accessibility, or accessible front-end engineering.

What reviewers will do

Each reviewer will independently assess all nine opaque artifacts using the
same product specification, scripted tasks, fictional test data, and frozen
rubric. The work covers booking, validation, recovery, rescheduling,
cancellation, keyboard operation, and the main mobile path.

Plan for approximately 3–4 hours, which may be split across sessions.

Independence requirement

Please do not apply if you have already seen Study 001 outputs, condition
mappings, preliminary findings, prompts, transcripts, MCP logs, or automated
results. General familiarity with Human Standards or MCP is not itself
disqualifying.

Reviewers will see only V001–V009. We will not reveal condition labels, run IDs,
other reviewers' scores, or automated findings until all 18 evaluations are
locked.

Open process, private applications

The public reviewer call will be available at:

https://www.humanstandards.org/studies/study-001-independent-reviewers/

Questions about eligibility, procedure, blinding, or publication are welcome in
this discussion. Do not post email addresses, availability, or other personal
information here. If this call was shared with you directly or through a social
post, reply privately through that same channel to express interest.

The final study will report all recorded runs, reviewer disagreements,
limitations, and mixed, null, or negative findings. Publication is not
conditional on a favourable result.