Skip to content

v0.82.3

Choose a tag to compare

View all tags
@abrichr abrichr released this 29 Mar 23:48
· 100 commits to main since this release
v0.82.3
a5f290d

v0.82.3 (2026-03-29)

Bug Fixes

  • Also patch model.generate() to inject cached pixel_values (#254, 9612019)

forward() patch handles training logprob recomputation, but TRL also calls model.generate(input_ids=...) without pixel_values. HF's generate() uses prepare_inputs_for_generation() which builds a fresh kwargs dict — cached pixel_values in forward() aren't enough because generate() needs them at the top level to pass them through.

Now patches BOTH forward() and generate() on the model instance.

Co-authored-by: Claude Opus 4.6 (1M context) noreply@anthropic.com

Detailed Changes: v0.82.2...v0.82.3

Assets 6
Loading