Skip to content

Enterprise authorization Topaz reference experiment (SynthWorld 0.16.0)

Choose a tag to compare

@bluntmachetti bluntmachetti released this 17 Aug 13:37
· 9 commits to main since this release
Immutable release. Only release title and notes can be modified.
enterprise-authorization-topaz-0.16.0-1
2405459

Frozen enterprise authorization reference experiment

This is a frozen, unsupported record of one experiment using
idcognito-synthworld==0.16.0 and Topaz 0.33.16. It is evidence of what was run,
not a maintained adapter, product certification, vendor comparison, or general
authorization-correctness claim.

The experiment generated a deterministic enterprise identity/authorization world,
projected only public artifacts into Topaz, captured raw decisions, sealed typed
submissions before scoring, and opened evaluator truth only in a separate offline
scorer capability.

Recorded results

  • 1,699 objects and 5,879 relations loaded and read back exactly;
  • 3,209/3,209 Britannia decisions and 14/14 adversarial decisions normalized;
  • 40/40 structural, isolation, integrity, and presentation checks passed;
  • 9/9 deliberately faulty authorization controls detected;
  • 4/4 unsealed, mutated, cross-artifact, and version-mismatched submissions refused;
  • no aggregate score was calculated; unexercised and not-publicly-winnable metrics
    remain explicit in the report.

Assets

  • enterprise-authorization-topaz-reproduction-kit-0.16.0-1.zip
    (sha256:16071b56892d39542817b72401991adde38f878184c7dbb7b274662b24aa4b5f):
    source, pinned dependencies, topology, policies, adapters, documentation, and the
    one-command workflow. It contains no pre-generated evaluator artifacts.
  • enterprise-authorization-topaz-reference-run-0.16.0-1.zip
    (sha256:202d1377f1f07bed57b82fc829f56082f23ffe2af626f5a8aeb39093ed0bddbe):
    the source plus retained public artifacts, separate evaluator artifacts, raw and
    normalized Topaz responses, sealed submissions, reports, controls, and the
    public-only HTML projection.
  • ASSET-METADATA.json binds the experiment, source commit, source tree, package
    version, asset sizes, asset digests, and result counts.
  • SHA256SUMS verifies every custom asset.

Reproduce

sha256sum -c SHA256SUMS
unzip enterprise-authorization-topaz-reproduction-kit-0.16.0-1.zip
cd enterprise-authorization-topaz-reproduction-kit-0.16.0-1
bin/run_lab.sh

The reproduction ZIP was itself executed from a fresh extraction before this
release was published and passed all 40 checks. First execution requires network
access to obtain digest-pinned images and hash-pinned packages; reruns can use the
retained local cache.

Community experiments are owned and supported by their authors. They may be
listed as self-reported results in the SynthWorld
Experiment results
Discussion category. A listing is not review, reproduction, endorsement, or a
support commitment by SynthWorld maintainers.