v2.2.0 Big Scanner Update

[Prithvi-Web]

• Version Update: v2.2.0 introduces a new turbo scan engine (gdu-turbo), which is based on the MIT-licensed gdu.

• Performance Improvement:

  • Increases TreeMap scanning speed from 70k–100k items/sec to 112k–129k items/sec.
  • Validated performance of 5,000,000 items scanned in approximately 43 seconds (~116k items/sec).

• Accuracy:

  • Maintains byte-for-byte accuracy parity with the old walker.
  • Includes exact hardlink deduplication counts, ensuring no trade-off between speed and accuracy.

• Issue Resolution:

  • Fixes the previous "can only scan 2 million files" limitation.
  • The issue was due to a V8 string-length cap on the tree payload sent to the UI, not a scanner limitation.

• Fallback Mechanism:

  • Automatically and silently falls back to the walker for:
    • Incremental rescans
    • Ignore-listed scans
    • Situations where the gdu binary is missing or fails
  • Ensures every scan returns a correct result regardless of fallback.

---

This discussion was created from the release v2.2.0 Big Scanner Update.