Skip to content

Human Influence Telemetry v0.6.0: First Human Inter-rater Result

Choose a tag to compare

View all tags
@mj3b mj3b released this 18 Jul 22:48
v0.6.0
3819f49
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Human Influence Telemetry v0.6.0: First Human Inter-rater Result

Summary

Version 0.6.0 publishes the first completed human inter-rater exercise under locked protocol HIT-IRP-CIGNA-001.

Two eligible independent scorers applied the frozen Cigna PxDx packet under specification and schema 0.1.0. The deterministic pre-adjudication comparison produced 7 of 7 exact agreements, an exact-agreement proportion of 1.0000, and zero critical disagreements. The predeclared advancement gate passed.

HIT advances to Maturity Level 2, Applicable. Claim H3 is supported for this bounded exercise.

Version layers

  • Repository release: 0.6.0
  • Conformance engine: 0.5.0
  • Specification: 0.4.0
  • Assessment schema: 0.4.0
  • Dimension catalog: 0.4.0
  • Locked scorer contract used by this exercise: 0.1.0
  • Research maturity: Level 2, Applicable

Published result artifacts

The repository contains:

  • both verified scorer JSON submissions;
  • original and corrected receipt records;
  • manual-to-JSON transcription audit;
  • scorer transcription confirmations;
  • deterministic pre-adjudication comparison in JSON and Markdown;
  • comparison execution record;
  • preservation manifest;
  • no-disagreement adjudication record;
  • H3 and maturity decision;
  • release-asset manifest.

This release includes HIT-v0.6.0-human-inter-rater-result-assets.zip. The archive preserves the unchanged DOCX and PDF manual submissions together with the public result records.

Release asset SHA-256:

de655f5766009e8cd8a7c52652c53cc7930586f072007839877d542f4138617f

Primary result

  • Exact agreements: 7 / 7
  • Exact-agreement proportion: 1.0000
  • Required minimum: 6 / 7 and 0.8571
  • Critical disagreements: 0
  • Advancement threshold met: yes
  • Supplementary Cohen's kappa: null

Kappa is undefined because both scorers assigned the same category across all six substantive dimensions. The data contain no category variance. The predeclared primary exact-agreement measure remains defined and passed.

Research claim

The release supports this narrow proposition:

Two independent reviewers applied the published locked materials to one frozen packet and reached the predeclared agreement threshold.

The release does not establish general inter-rater reliability, causal validity, evidence truth, legal correctness, field effectiveness, certification, or independent institutional adoption.

Contract and compatibility

Version 0.6.0 does not change the current 0.4.0 specification, schema, catalog, handbook, or scoring semantics. It does not change the 0.5.0 conformance engine. Historical 0.1.0 case assessments remain immutable.

Validation

Before tagging, the exact release commit must pass:

python scripts/check_fixture_format.py
python scripts/validate.py
python -m src conformance --all
python scripts/validate_v050_cli.py

The release validator checks the preserved historical assessments, locked protocol, final scorer JSON files, declared SHA-256 digests, comparison recomputation, threshold decision, H3 wording, maturity status, and release metadata.

The Scorer A DOCX files preserve the exact submitted bytes and therefore retain their original Microsoft Office package metadata, including a lastModifiedBy value naming the packet coordinator. This metadata field records the account associated with the file’s last save operation. It does not identify the scorer or establish authorship of the findings. Submission provenance is established by the preserved receipt, scorer-authored correction confirmation, transcription verification, and SHA-256 records.

Assets 3
Loading