Repository navigation
Releases
HumanWill Benchmark 0.1.0a11 — alpha
HumanWill Benchmark
Measuring harmful refusals in AI models
GitHub-distributed alpha of HumanWill Benchmark. The humanwill CLI and shared
Python API retain flexible execution, selective retries, saved-answer regrading,
raw HTTP inspection, question extensions and domain/topic judging-policy overrides.
Reports, images and HTML question exports support clean and spotlight styles.
Start here
Download the wheel or curated software source archive, plus the separate question
ZIP for reference runs. The Git checkout also includes the approved versioned
pack. Verify downloads against SHA256SUMS.txt. Python 3.11–3.14; macOS/Linux.
API keys, model IDs, verified prices and budget are needed only for live execution.
No PyPI installation is promised by this release.
Scope, rights and evidence
All 424 approved questions, the exact policy and every original delivery byte are
unchanged. The pack ZIP is identical to accepted delivery 0.1.0; its historical
README is retained, and the linked quick start supplies current installation
instructions. Software uses Apache 2.0; questions/policy use CC BY 4.0 for
HumanWill's licensable rights. Preserve HumanWill / https://humanwill.ai attribution.
Internal owner review uses self-declared expertise, not an independent external audit.
False refusal and usefulness are separate. This selected cybersecurity challenge
set does not measure harmful compliance or overall model safety. Personal review
records, historical model answers and private research Git history are excluded.
Validation: all eight macOS/Linux × Python 3.11–3.14 jobs passed, with 144 product
tests per platform and installed package checks. The separate reference-pack
job passed. Local base/report installation, fresh-clone pack validation and
artifact inspection also passed. VALIDATION.json records the exact commit,
hosted checks and hashes. No paid model calls were made.
Distribution is through GitHub only; PyPI and TestPyPI are deferred. The existing
research repository remains private. The release artifacts were originally
issued while this product repository was private; embedded access wording and
validation metadata preserve that historical state. The current guides linked
above provide maintained installation instructions. No release files were replaced.