Repository navigation
Concurrent File Walker Optimizations
This PR includes several important optimizations and fixes to improve the reliability and performance of the concurrent file walker.
Key Changes
1. Directory Skip Handling
- Improved
SkipDirhandling in concurrent walks - Fixed race conditions in directory traversal
- Properly propagates skip signals to child directories
2. Performance Optimizations
- Optimized empty directory check using
Readdirnames(1) - Reduced unnecessary memory allocations
- Improved concurrent task distribution
3. Thread Safety Improvements
- Added mutex protection for shared data structures
- Fixed race conditions in progress reporting
- Improved synchronization in worker pool
4. Test Reliability
- Fixed flaky tests with proper synchronization
- Added better error messages for debugging
- Improved test coverage for edge cases