Implement pick_batchsize

[gdalle]

Fix #1542 by implementing a constant heuristic for picking chunk size.

[gdalle]

Should this be renamed to pick_batchsize? On the one hand, the type is BatchDuplicated, but on the other hand, jacobian and gradient call it chunk

[wsmoses]

Sure, batchsize sgtm.

[wsmoses]

Otherwise, this looks good to me once test pass

[gdalle]

I think test failures are unrelated? The tests I introduced pass locally

[gdalle]

is this acceptable? it's hard to know given all the failing tests

[codecov-commenter]

⚠️ Please install the to ensure uploads and comments are reliably processed by Codecov.

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 96.30%. Comparing base (4da44dd) to head (9f02369).

❗ Your organization needs to install the Codecov GitHub app to enable full functionality.

Additional details and impacted files

@@           Coverage Diff           @@
##             main    #1545   +/-   ##
=======================================
  Coverage   96.30%   96.30%           
=======================================
  Files           8        8           
  Lines         406      406           
=======================================
  Hits          391      391           
  Misses         15       15           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.