[refactor] - Optimize memory usage for small chunks in readInChunks

[ahrav]

Description:

This PR introduces an optimization to reduce memory usage when processing
small chunks of data in the readInChunks function. Key changes include:

1. Added a smallChunkThresholdRatio constant (set to 0.3) to define when
   a chunk is considered "small".
2. Modified chunkReaderConfig to include a pre-calculated smallChunkThreshold.
3. Updated readInChunks to create a new, optimized slice only for chunks
   smaller than the threshold.

This optimization aims to improve memory efficiency for smaller chunks
while maintaining performance for larger ones. It should reduce unnecessary
memory allocation and potentially improve the speed of downstream operations
like FindDetectorMatches for smaller data chunks.

Checklist:

• Tests passing (make test-community)?
• Lint passing (make lint this requires golangci-lint)?