Repository navigation
v0.4.0
Move manually added files out of data/processed/ before running validate.
Added
reportcreates a standalone HTML provenance report that recipients can read offline. It links outputs to their sources and lists integrity problems without including raw data.- An assurance case explains the trust assumptions, safeguards and limits behind integrity and provenance checks.
status,validateandrevisionsaccept--jsonfor scripts and CI. See JSON reports.- Per-source
timeout_ssets the fetch budget, including retries and waits. The default
remains 300 seconds; see download limits and retries. format = "file"keeps files unchanged and validates their bytes, provenance and
reuse metadata. Build describes them as non-tabular resources indatapackage.json;
see How build works.
Changed
-
The documentation website uses a navy and lime reading layout, responsive navigation and copyable code. A connected provenance diagram and revision comparison use an example checked against the pipeline. The full tutorial has its own page.
-
Documentation separates the quick start from the manifest and command reference, custom readers and release verification.
-
Breaking:
validatereports unclaimed non-CSV files indata/processed/, alongside
unclaimed CSV files. See validation.
Fixed
-
JSON status reports render non-text status values as text instead of crashing on TOML dates and times.
-
File validation checks each output hash once while preserving the checks of its provenance and package metadata.
-
The HTML provenance report flags missing, duplicate or no-longer-implemented outputs instead of reporting successful checks for an incomplete package.
-
The citation helper removes old Zenodo version, date and DOI overrides so each release can receive its own archive metadata. See release verification.
-
A malformed resource name in
datapackage.jsonproduces validation problems instead of an uncaught error. -
Command options can appear between the stage and its path on Python 3.12, including
revisions --json OLD_LOG. See the command reference.
Security
- Fetch follows redirects without reading their unused response bodies, avoiding an
unbounded read. See Use sourceledger safely.