Skip to content

Releases: CAOShurong/frontiertrials

Release list

FrontierTrials v0.3.1

FrontierTrials v0.3.1 Latest
Latest

Choose a tag to compare

View all tags
@github-actions github-actions released this 05 Aug 15:38
v0.3.1
d61c29a
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

What's Changed

  • Explain the blind reveal with a third README visual by @CAOShurong in #8
  • Prepare verified PyPI release 0.3.1 by @CAOShurong in #9

Full Changelog: v0.3.0...v0.3.1

Contributors

CAOShurong
Assets 5
Loading

FrontierTrials v0.3.0

FrontierTrials v0.3.0

Choose a tag to compare

View all tags
@github-actions github-actions released this 05 Aug 05:44
v0.3.0
8337764
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

What's Changed

  • Refine README visual explanations by @CAOShurong in #6
  • Add Personal Lab for private AI subscription comparisons by @CAOShurong in #7

New Contributors

Full Changelog: v0.2.0...v0.3.0

Contributors

CAOShurong
Loading

FrontierTrials v0.2.0

FrontierTrials v0.2.0

Choose a tag to compare

View all tags
@github-actions github-actions released this 04 Aug 17:45
v0.2.0
03e20e5

Full Changelog: v0.1.0...v0.2.0

Loading

FrontierTrials v0.1.0

FrontierTrials v0.1.0

Choose a tag to compare

View all tags
@CAOShurong CAOShurong released this 04 Aug 16:24
v0.1.0
190e1d6

FrontierTrials v0.1.0 is the first public release of the no-API, local-first blind evaluation workbench.

Included

  • Exact Markdown response capture with SHA-256 integrity records
  • Deterministic blind aliases, all-pairs comparisons, balanced left/right order, and rater allocation
  • Self-contained offline HTML judging packets with downloadable JSON ballots
  • Validated ballot import and trial state transitions
  • Bradley–Terry relative-strength estimates with task-clustered bootstrap intervals
  • Pointwise rubric summaries, task slices, reviewer agreement, position checks, and verbosity diagnostics
  • Revealed portable HTML reports, protocol and ranking exports, structural audits, and content-addressed evidence seals
  • Seven documented JSON schemas and a fully fictional 191-artifact demonstration
  • 85 automated tests across Windows and Ubuntu on Python 3.11 and 3.13

Evidence

The bundled fictional demonstration contains 8 tasks, 4 candidates, 32 captured responses, 48 pairings, 96 ballots, and 224 sealed files. Its audit reports zero errors and zero warnings.

Evidence root:

sha256:c680bd65cfd31f4a1281582a3ae6b920bb1ef5975b462d982989dff1ea7aa9f5

The demonstration does not measure any real model or provider.

Install

Download the wheel below and run:

python -m pip install frontiertrials-0.1.0-py3-none-any.whl
frontiertrials demo my-fictional-trial
frontiertrials audit --trial my-fictional-trial
frontiertrials verify --trial my-fictional-trial

See the project website, revealed demo report, and blind reviewer packet.

Loading