Skip to content

v1.8.6

Choose a tag to compare

View all tags
@davidelbert davidelbert released this 07 Apr 00:41
· 23 commits to main since this release
v1.8.6
631c457
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Addressing issues of wrong numbers of chunks #113 with

  • Implements a directional generation policy in add_chunk() using the existing file_hash field to detect generation boundaries and n_total_chunks as a recency signal
  • Prevents infinite crash-restart loop when a file is uploaded multiple times with different chunk counts
  • Handles interleaved chunks from multiple generations on multi-partition topics without thrashing

Changes

  • config.py: Added GENERATION_RESET_CODE = 11
  • download_data_file.py: Directional policy in add_chunk(), _reset_for_new_generation() with subclass overrides
  • data_file_chunk_handlers.py: Handle GENERATION_RESET_CODE
  • test_download_data_file.py: Four tests — sequential reset, interleaved generations, equal-count no-thrashing, stale-chunk skipping on disk
Assets 2
Loading