Add challenge prequalification fairness guard#423
Open
KoiosSG wants to merge 4 commits into
Open
Conversation
Author
|
Hardening update pushed in 25af825: conflicted reviewer scores are now excluded from weighted threshold evidence, while the conflict finding remains auditable. I added a regression that failed before the fix with 75 == 50 and now passes. Validation refreshed locally: npm run check, npm test (6 tests), node --check on index/demo/test, ffprobe on demo.mp4, git diff --check, and sensitive-term scan returned no matches. |
Author
|
Follow-up hardening pass for the challenge prequalification fairness guard. What changed:
Validation:
|
Author
|
Follow-up competitive hardening pass for the challenge prequalification fairness guard. What changed:
Why this matters:
Validation:
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
/claim #18
Summary
Adds a distinct
challenge-prequalification-fairness-guard/slice for Scientific Bounty System issue #18.The guard evaluates sponsor-side prequalification rounds before solver teams are accepted or rejected. It checks published criteria, weighted score threshold consistency, anonymous-screening requirements, reviewer conflicts, reviewer quorum, rejection reason completeness, appeal windows, and deterministic audit evidence. Conflicted reviewer scores are excluded from threshold scoring while the conflict remains auditable. Unfair or incomplete screening decisions are held for remediation before challenge access changes.
Hardening Update
Non-overlap
This is scoped to prequalification fairness before solver acceptance/rejection. It does not duplicate the broad bounty-system modules, intake compliance, workspace privacy, clarification freeze, arbitration/scoring, payout eligibility, sponsor data-room access, benchmark leakage, evaluator calibration, reviewer workload SLA, award transparency, appeals, escrow settlement, or sponsor reliability slices.
Validation
node challenge-prequalification-fairness-guard\test.jsfailed on missing./indexnpm testfailed with75 == 50before excluding conflicted reviewer scoresnpm run checkfromchallenge-prequalification-fairness-guardpassed: 6 tests, demo, videonode --check challenge-prequalification-fairness-guard\index.jsnode --check challenge-prequalification-fairness-guard\demo.jsnode --check challenge-prequalification-fairness-guard\test.jsffprobe -v error -select_streams v:0 -show_entries stream=codec_name,width,height,duration,avg_frame_rate -show_entries format=size,duration -of default=noprint_wrappers=1 challenge-prequalification-fairness-guard\reports\demo.mp4-> H.264, 1280x720, 4s, 30fps, 45,643 bytesgit diff --checkgit diff --cached --checkrg -n "(password|secret|wallet|paypal|bank|passport|private key|api key)" challenge-prequalification-fairness-guard-> no matchesDemo Artifacts
challenge-prequalification-fairness-guard/reports/prequalification-fairness-packet.jsonchallenge-prequalification-fairness-guard/reports/prequalification-fairness-report.mdchallenge-prequalification-fairness-guard/reports/summary.svgchallenge-prequalification-fairness-guard/reports/demo.mp4Synthetic data only. No credentials, payment processors, identity providers, private workspaces, sponsor systems, solver accounts, payout systems, or external APIs are used.
AI-assisted with OpenAI Codex; I reviewed and locally verified the diff before submitting.