Skip to content

Commit

Permalink
fix eos_id default value to [2] (#378)
Browse files Browse the repository at this point in the history
  • Loading branch information
hiworldwzj committed Mar 26, 2024
1 parent 5667c98 commit 78047d1
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion lightllm/server/api_server.py
Original file line number Diff line number Diff line change
Expand Up @@ -322,7 +322,7 @@ def main():
default=None,
help="max tokens num for new cat batch, it control prefill batch size to Preventing OOM",
)
parser.add_argument("--eos_id", nargs='+', type=int, default=2, help="eos stop token id")
parser.add_argument("--eos_id", nargs='+', type=int, default=[2], help="eos stop token id")
parser.add_argument(
"--running_max_req_size", type=int, default=1000, help="the max size for forward requests in the same time"
)
Expand Down

0 comments on commit 78047d1

Please sign in to comment.