Nullius v0.1.0rc2

v0.1.0rc2 · Package description update

• Clearer PyPI summary. Explain what Nullius does, using the repository description followed by “Bring anything, run it, prove it.”
• Focused package overview. Simplify the feature list shown on PyPI.
• Versioned release notes. Read the reviewed release descriptions in the documentation.
• Release-matched documentation. The live docs advance after a successful PyPI publication; development branches do not deploy previews.

Application behavior is unchanged from v0.1.0rc1.

Install

Install the latest version with uv and Python 3.12+:

uv tool install nullius-eval
nullius serve

For an existing unpinned installation, run uv tool upgrade nullius-eval.
Open http://127.0.0.1:5057.

Full changelog

What's Changed

• Move reviewed release notes into documentation by @aitianshi in #7
• Prepare rc2 descriptions and release-only documentation deployments by @aitianshi in #9

Full Changelog: v0.1.0rc1...v0.1.0rc2

Installation options, downloads and validation

To pin this candidate, use uv tool install nullius-eval==0.1.0rc2.
Alternatively, install the attached wheel with
uv tool install ./nullius_eval-0.1.0rc2-py3-none-any.whl.
Add --force when replacing an existing tool installation. Settings,
catalogue additions and runs stay outside the installed package;
nullius paths shows their locations.

The downloads contain the wheel, source archive and SHA256SUMS.
After downloading all three files into one directory, verify them on Linux
with sha256sum --check SHA256SUMS.

Release validation targets Linux with Python 3.12: backend and route tests,
installed commands and resources, and user-storage preservation. It does not
establish macOS or Windows support or validate every live benchmark/provider
combination. These are Python packages with a local web UI.

Nullius v0.1.0rc1

v0.1.0rc1 · First release candidate

Bring anything. Run it. Prove it. Nullius brings AI evaluations onto your
machines and opens each score into the evidence behind it.

• Bring benchmarks, agents and capabilities. Add catalogue entries and match them by proven ports.
• Run on your machines. Review a recipe, run locally or over SSH, and merge work across hosts.
• Open every score into evidence. Inspect verifier reports, model calls, conversations and artifacts.
• Reuse and compare results. Read Harbor jobs, import ATIF or OpenTelemetry traces, and compare shared tasks.
• Check the benchmark too. Use controls and optional model judgement to investigate failures.

Install

Install the latest version with uv and Python 3.12+:

uv tool install nullius-eval
nullius serve

Open http://127.0.0.1:5057.

Full changelog

What's Changed

• Initial import of Nullius by @aitianshi, @vultkayn, @yiannislamprou, @42int42 and @opPO333 in cd08443
• Bump the python group across 3 directories with 2 updates by @dependabot[bot] in #2
• Bump actions/setup-python from 7.0.0 to 7.1.0 in the github-actions group by @dependabot[bot] in #1
• Use white transparent icons for documentation tabs by @aitianshi in #5

Full Changelog: All commits in v0.1.0rc1

Installation options, downloads and validation

Installation options

The package is nullius-eval; the application and command remain nullius.
To select this specific candidate, use uv tool install nullius-eval==0.1.0rc1.
Alternatively, download the wheel attached to this release and run
uv tool install ./nullius_eval-0.1.0rc1-py3-none-any.whl.

To replace an existing Nullius tool installation, add --force to the install
command. Settings, catalogue additions and runs
are stored outside the installed package; nullius paths shows their locations.

Reading existing results does not need a model key. Running benchmarks needs the
appropriate provider credentials and benchmark prerequisites; Docker is needed
for Harbor and the standard's docker backend.

Downloads and validation

• The .whl is the installable Python package, including the local web UI.
• nullius_eval-0.1.0rc1.tar.gz is the source distribution for building the package.
• SHA256SUMS records the checksums of both files. After downloading all three
  files into one directory, verify them on Linux with sha256sum --check SHA256SUMS.

These are Python packages, not standalone desktop installers. Release
validation targets Linux with Python 3.12 and checks the backend, web routes,
installed commands and package resources. It also checks that replacing an
installation preserves user storage. This does not establish macOS or Windows
support, or validate every benchmark against live model providers.

Feedback

Report installation problems, missing assets, incorrect results or confusing
workflows through the issue tracker.
Include the version, operating system, reproduction steps and relevant errors,
with credentials and personal data removed. GitHub downloads and issue access
follow the repository's access permissions.