fix: optimize even if we have to make the HLG

[lgray]

@martindurant this seems like a bug to me, so I am removing it.

[codecov-commenter]

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (73c80f8) 93.06% compared to head (7aafd96) 93.06%.

❗ Your organization needs to install the Codecov GitHub app to enable full functionality.

Additional details and impacted files

@@           Coverage Diff           @@
##             main     #465   +/-   ##
=======================================
  Coverage   93.06%   93.06%           
=======================================
  Files          23       23           
  Lines        3290     3290           
=======================================
  Hits         3062     3062           
  Misses        228      228           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[martindurant]

Yes, I suppose you are right. The original thinking was, I think, "well it's not awkward/blockwise, so no opts will help"; but of course there can be elements like that further up the layer stack.