Skip to content

Commit

Permalink
Better default for chat output length
Browse files Browse the repository at this point in the history
Ideally, generation should stop at '\n', but this feature is brand new
on transformers (huggingface/transformers#20727)
  • Loading branch information
oobabooga committed Jan 8, 2023
1 parent b801e0d commit b871f76
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion server.py
Original file line number Diff line number Diff line change
Expand Up @@ -181,7 +181,7 @@ def clear():
with gr.Column():
with gr.Row(equal_height=True):
with gr.Column():
length_slider = gr.Slider(minimum=1, maximum=2000, step=1, label='max_length', value=200)
length_slider = gr.Slider(minimum=1, maximum=2000, step=1, label='max_length', value=100)
preset_menu = gr.Dropdown(choices=available_presets, value="NovelAI-Sphinx Moth", label='Preset')
with gr.Column():
temp_slider = gr.Slider(minimum=0.0, maximum=1.0, step=0.01, label='Temperature', value=0.7)
Expand Down

0 comments on commit b871f76

Please sign in to comment.