v1.0.2

Overview

Release v1.0.2 introduces the modular data preprocessing engine (luminamoon.data) and establishes LuminaV v1.5.3 as the default canonical optimizer baseline with dynamic versioning.

Key Changes

Data Preprocessing Engine (luminamoon.data)

• SIMD text normalization and whitespace trimming (AVX-512, AVX2, NEON).
• Dual-layout StringTensor:
  • CPU StringView: 16-byte structure with inlined short strings (<= 12 bytes) and 4-byte prefix comparison.
  • GPU Contiguous Buffers: Flat uint32 offsets and uint8 payload buffer for coalesced VRAM access.
• Zero-copy export to Apache Arrow IPC, Polars Series (to_polars()), NumPy arrays, and PyTorch GPU tensors.
• Fault-tolerant checkpointing with 128-byte dual-slot Ping-Pong metadata and CRC32 integrity validation.
• Deduplication via parallel XXH3-64, MinHash, Shannon entropy filter, and SIMD PII masking.

LuminaV Optimizer

• Standardized default optimizer algorithm version to canonical v1.5.3 reference baseline.
• Dynamic per-instance and class-level versioning via LuminaV.setVersion() and getVersion().
• On-demand version cache resolver (~/.cache/luminamoon/versions/).

Installation

pip install luminamoon==1.0.2

Full Changelog: v1.0.1...v1.0.2

Full Changelog: v1.0.1...v1.0.2