Skip to content

Remove padding in batched generation.#487

Merged
lvwerra merged 3 commits intomainfrom
fix-padding
Jul 5, 2023
Merged

Remove padding in batched generation.#487
lvwerra merged 3 commits intomainfrom
fix-padding

Conversation

@lvwerra
Copy link
Copy Markdown
Member

@lvwerra lvwerra commented Jul 3, 2023

Remove padding in batched generation as a post-processing step.

@lvwerra lvwerra requested review from vwxyzjn and younesbelkada July 3, 2023 15:18
Comment thread examples/sentiment/scripts/gpt2-sentiment.py Outdated
@HuggingFaceDocBuilderDev
Copy link
Copy Markdown

HuggingFaceDocBuilderDev commented Jul 3, 2023

The documentation is not available anymore as the PR was closed or merged.

@lvwerra
Copy link
Copy Markdown
Member Author

lvwerra commented Jul 3, 2023

Results across 8 seeds - no neg KL issues:

Screenshot 2023-07-03 at 18 54 47

Copy link
Copy Markdown
Collaborator

@edbeeching edbeeching left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewing this as we would like to downstream this change to H4.

LGTM.

@lvwerra lvwerra merged commit 4f7f73d into main Jul 5, 2023
@lvwerra lvwerra deleted the fix-padding branch July 5, 2023 08:41
yxliu-TAMU pushed a commit to mincheolseong/ECEN743-GRPO-Project-Proposal that referenced this pull request Apr 20, 2025
* fix padding

* Update examples/sentiment/scripts/gpt2-sentiment.py

* fix style

---------

Co-authored-by: leandro von werra <leandro@hf.co>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants