Repository navigation
fs-inventory 0.4.0
Milestone M4: resumable scans.
Added
- Checkpoints and
fs-inventory resume. Every--checkpoint-interval(10 minutes by default;0disables them), a scan pauses as each crawl thread finishes its current directory, commits every open part file, and records the directories still to read incheckpoint/inside the scan directory.fs-inventory resume SCAN_DIRcontinues a scan that was interrupted, killed, or on a machine that went down. It deletes the parts written after the last checkpoint and reads their directories again, so the finished scan matches an uninterrupted one, with every row once. After Ctrl-C, a final checkpoint makes resuming exact. Resume can change threads, writers, memory, the stall timeout, the checkpoint interval, and progress; the manifest records each resume underresumes. A lock keeps two processes from writing one scan.
Changed
- With checkpoints, the spill file and the
--detect-cyclesrecord of visited directories live incheckpoint/until the scan finishes, instead of being unlinked at once. - Each checkpoint commits the open part files, so long scans have more, smaller parts. Parts written after a resume are named
part-rN-wNN-NNNNNN.
Resuming is described in the user guide, and how it works in the architecture overview.
Full changelog: v0.3.0...v0.4.0