Skip to content

Commit

Permalink
Correct arg name
Browse files Browse the repository at this point in the history
  • Loading branch information
gokulavasan committed Jan 18, 2024
1 parent ab67ac6 commit 88261c6
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion torchtune/models/llama2.py
Original file line number Diff line number Diff line change
Expand Up @@ -50,7 +50,7 @@ def llama2_7b(max_batch_size: Optional[int] = None) -> TransformerDecoder:


def llama2_tokenizer(path: str) -> Tokenizer:
tokenizer = Tokenizer.from_file(path, max_len=4096)
tokenizer = Tokenizer.from_file(path, max_token_len=4096)
# Original tokenizer has no pad_id, which causes indexing errors when batch training
tokenizer.pad_id = 0
return tokenizer
Expand Down

0 comments on commit 88261c6

Please sign in to comment.