Skip to content

FerrumOS World-Model Safety Study v1.0.0

Choose a tag to compare

@VyomKulshrestha VyomKulshrestha released this 06 Aug 21:17
· 112 commits to main since this release

FerrumOS World-Model Safety Study v1.0.0

Author

Vyom Kulshrestha
Independent Researcher, India
ORCID: https://orcid.org/0009-0009-1434-7148

Permanent identifiers

Evidence snapshot

  • Tagged release commit: 42ccc52c50f738a5ef50649a8e49abb3384b9c5f
  • DOI-reservation metadata commit: 3ae7fc7241d28ffcabb672a490846b46d44ef8d2
  • DOI-publication metadata commit: ebeea1f2c6df64ef6d561d5fdac3294607b7ab9a
  • Experimental evidence commit: 42ea7b8
  • Dataset source JSONL SHA-256: ae7498c7d93b4e35f8bf0a9ac595ca2bacc1ec694b1806c47a33741d911d491f
  • Deterministic gzip SHA-256: 310f5192d3d777c5a6420498a7074e48035f3e408d3c089cbc98eed79bfe6fb7
  • DOI-stamped Technical Report PDF SHA-256: dc100e170c5962de45ff46c988464ac629bd03f6734bd1a5803ed471fe7d4bab

What this release contains

This release freezes the reproducible artifacts for the FerrumOS provider-independent
OS action-mediation study. FerrumOS combines deterministic enforcement with a learned
JEPA transition screen before capability-gated system calls.

The accounted dataset contains 13,697 transitions from 3,639 QEMU episodes. After
excluding 373 non-executed rows and 54 policy-only upgrade rows, 13,270 fitting
transitions are split 9,104/2,197/1,969 by episode. On the authored 500-episode safety
fixture, rules plus the selected JEPA checkpoint reach 81.4% balanced accuracy, while
rules plus a per-action mean transition reach 81.2%. Five independently trained full
pipelines average 79.76% balanced accuracy. The ring-3 preview path measures 1.35-1.59
ms mean latency over H=1..5, with no heap growth observed across 500 previews.

The report does not claim formal safety, complete coverage, completed independent
human annotation, or a finished natural-use study. It does not establish that JEPA
outperforms the per-action mean model on downstream transition-forecasting tasks.

Release assets

  • FerrumOS_WorldModel_Technical_Report_v1.0.0.pdf
  • ferrumos-world-model-dataset-v1.0.0.jsonl.gz
  • DATASET_SHA256SUMS
  • RELEASE_SHA256SUMS
  • world_model_paper_evaluation.json
  • world_model_paper_predictions.csv
  • world_model_training_config.json
  • world_model_manifest.json
  • world_model_dataset_publication.json
  • world_model_technical_report_publication.json

Verification completed before publication

  • Public Zenodo dataset package: 10/10 files byte-identical to the local release
  • Public Zenodo report DOI resolves to the open 14-page PDF
  • Dataset release verifier: 11/11
  • Paper evaluation verifier: 10/10
  • Research-source verifier: 4/4
  • CITATION.cff: valid against Citation File Format schema 1.2.0
  • Full automated command sweep and manual QEMU audit: passed for the tagged release
  • Heliox, agent, services, files, sessions, permissions, syscalls, frame recycling,
    and Ring-3 transition: passed for the tagged release

Reproduction

python scripts/run_world_model_full_seeds.py --jobs 2 --resume
python scripts/verify_world_model_paper_evaluation.py
python scripts/evaluate_world_model_boundary_calibration.py
node scripts/benchmark_world_model_runtime.mjs --iterations 100
node scripts/verify_world_model_preview_concurrency.mjs
node scripts/evaluate_world_model_failure_modes.mjs
python scripts/package_world_model_dataset.py
python scripts/verify_world_model_dataset_release.py target/world-model-dataset-release
node scripts/verify_all_audits.mjs