Skip to content

Releases: liukejun7/DataJig

DataJig 0.9.0

Choose a tag to compare

@github-actions github-actions released this 08 Oct 00:02
d7ccdce

What's Changed

New Contributors

Full Changelog: v0.8.4...v0.9.0

DataJig 0.9 M2 testing preview

Pre-release

Choose a tag to compare

Testing-only wheels for commit 500eafc. Includes the Rust backend and Python control plane for Linux and macOS. This is not a production release and is not published to PyPI.

DataJig 0.9 M1 testing preview

Pre-release

Choose a tag to compare

Testing-only Linux x86_64 binaries for the DataJig 0.9 M1 checkpoint. This is not a production release or a PyPI publication.

Recommended for Ubuntu 22.04 and newer: datajig-0.9-m1-preview-ubuntu-22.04-x86_64.tar.gz (highest required GLIBC: 2.34).

The original datajig-0.9-m1-preview-linux-x86_64.tar.gz was built on Ubuntu 24.04 and requires GLIBC 2.39; do not use it on Ubuntu 22.04.

DataJig 0.8.4

Choose a tag to compare

@github-actions github-actions released this 07 Oct 13:33

Full Changelog: v0.8.3...v0.8.4

DataJig 0.8.3

Choose a tag to compare

@github-actions github-actions released this 07 Oct 03:36

Full Changelog: v0.8.2...v0.8.3

DataJig 0.8.2

Choose a tag to compare

@github-actions github-actions released this 06 Oct 21:30

Full Changelog: v0.8.1...v0.8.2

DataJig 0.8.1

Choose a tag to compare

@liukejun7 liukejun7 released this 06 Oct 19:54

DataJig 0.8.1 hardens the agent-native data control plane.

Highlights:

  • accepts mixed CSV line endings while preserving raw source identity and honest parser diagnostics
  • quantifies transform limits and makes preparation recipes directly discoverable
  • adds fail-closed, atomic fixed-path delivery evolution with forward-only crash recovery and retained backups
  • standardizes agent error next actions and publishes explicit artifact/CLI envelope capabilities
  • repairs public badges and expands cross-layer regression coverage

Install: python -m pip install "datajig[duckdb]==0.8.1"

Verified wheels are published on PyPI: https://pypi.org/project/datajig/0.8.1/

DataJig 0.8.0

Choose a tag to compare

@liukejun7 liukejun7 released this 06 Oct 18:21

DataJig 0.8.0

DataJig 0.8 introduces a reviewed, recoverable pipeline from local raw data to verified training delivery.

Highlights

  • One YAML contract for CSV, Parquet, or JSONL inputs, bounded DuckDB SQL, dataset revisioning, training-bundle export, and consumer plans.
  • Deterministic pipe_... authorization identities and independently verifiable piped_... success receipts.
  • Crash-safe create/update/no-op execution with durable journals, explicit --resume, OS locks, atomic no-replace delivery, and compare-and-swap workspace HEAD updates.
  • End-to-end lineage across source bytes, transform evidence, immutable revision, bundle, and consumption plans.
  • Strict YAML, path, provider, SQL, input-drift, and receipt validation designed to fail closed for agent-driven workflows.

Install the core:

python -m pip install datajig==0.8.0

Install the pinned DuckDB transform provider:

python -m pip install 'datajig[duckdb]==0.8.0'

See CHANGELOG.md for the complete release notes.

DataJig 0.7.0

Choose a tag to compare

@liukejun7 liukejun7 released this 06 Oct 16:12

DataJig 0.7.0 deepens the agent-native data control plane.

Highlights:

  • Recursive CSV, Parquet, and JSONL directory preparation with deterministic source identities and drift rejection.
  • Relative training split weights such as 7/2/1, normalized deterministically.
  • Immutable inline or file-backed SQL transform plans with explicit prerequisites.
  • Clearer lifecycle help, review-plan naming, richer status, and stronger repository hygiene.

See CHANGELOG.md for the complete release notes.

DataJig 0.6.1

Choose a tag to compare

@liukejun7 liukejun7 released this 06 Oct 15:09

DataJig 0.6.1 polishes the repository and release experience for agents and humans.

What changed

  • Added datajig --version, sourced from installed package metadata.
  • Rebuilt the GitHub overview around DataJig's agent-native data control-plane positioning.
  • Replaced the broken private-raw hero URL with a repository-relative, friendly illustrated hero.
  • Added a dedicated English-only PyPI description with no repository-relative media.
  • Upgraded GitHub Actions and generated repository workflows to immutable Node 24 action revisions.
  • Fixed the DuckDB provider source-checkout fallback so it never reports a stale release version.

Install

pip install datajig==0.6.1

For bounded DuckDB transforms:

pip install "datajig[duckdb]==0.6.1"