Optimize memory usage by reducing buffered batches by default

[zix99]

With default settings, rare used ~50MB consistently. These tweaks and settings lower it to ~10MB while maintaining performance. For io-burst systems, you can tweak up the buffered batches via CLI.

[netlify]

✅ Deploy Preview for raredocs ready!

Name	Link
🔨 Latest commit	988d082
🔍 Latest deploy log	https://app.netlify.com/sites/raredocs/deploys/632e58482cd4220008c0d661
😎 Deploy Preview	https://deploy-preview-82--raredocs.netlify.app/
📱 Preview on mobile	Toggle QR Code... Use your smartphone camera to open QR code link.

---

To edit notification comments on pull requests, go to your Netlify site settings.

[codecov-commenter]

Codecov Report

Merging #82 (988d082) into master (1e7191b) will decrease coverage by 0.92%.
The diff coverage is 100.00%.

@@            Coverage Diff             @@
##           master      #82      +/-   ##
==========================================
- Coverage   87.53%   86.60%   -0.93%     
==========================================
  Files          93       93              
  Lines        3633     4359     +726     
==========================================
+ Hits         3180     3775     +595     
- Misses        317      448     +131     
  Partials      136      136              

Impacted Files	Coverage Δ
cmd/helpers/extractorBuilder.go	83.24% <100.00%> (-3.61%)	⬇️
pkg/extractor/batchers/fileBatcher.go	73.77% <100.00%> (-0.23%)	⬇️
pkg/extractor/batchers/readerBatcher.go	100.00% <100.00%> (ø)
pkg/extractor/batchers/tailBatcher.go	48.27% <100.00%> (+0.27%)	⬆️
cmd/helpers/summary.go	52.38% <0.00%> (-8.74%)	⬇️
pkg/expressions/stdlib/funcsType.go	70.00% <0.00%> (-5.00%)	⬇️
pkg/expressions/stdlib/funcsComparators.go	72.36% <0.00%> (-4.69%)	⬇️
pkg/followreader/poller.go	80.30% <0.00%> (-3.70%)	⬇️
pkg/expressions/stdlib/funcsCommon.go	78.94% <0.00%> (-3.28%)	⬇️
... and 78 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.