Skip to content

v0.0.15 - Atomic file writes

Choose a tag to compare

@lucasrrt lucasrrt released this 08 Apr 06:33
cd96b99

Bug Fix

  • Replaced Path.write_text() with atomic writes across all FileSystemJsonTables operations (_insert, _update, _delete, add_table, add_column, remove_column, _save_table_metadata, _remove_table_metadata, _ensure_metadata_table)
    • Writes now go to a temporary file first, then os.replace() atomically swaps it into place
    • Prevents file corruption caused by non-atomic truncate-and-write under concurrent I/O load
    • Fixes an issue where JSON data files could end up with null bytes or partial content when multiple operations write to the same file rapidly

Full Changelog: v0.0.14...v0.0.15