Skip to content

Commit

Permalink
update oobabooga request params to current as of 486ddd6
Browse files Browse the repository at this point in the history
this adds:
    "epsilon_cutoff": 0,  # In units of 1e-4
    "eta_cutoff": 0,  # In units of 1e-4
    "tfs": 1,
    "top_a": 0,
    "mirostat_mode": 0,
    "mirostat_tau": 5,
    "mirostat_eta": 0.1,

also, change the truncation length back to 2048
    "truncation_length": 2048,

People who have an existing config.yml will not see the
truncation_length change on them, only new users.  Of course
they can change it themselves if they want.
  • Loading branch information
chrisrude committed Jun 2, 2023
1 parent c91ab77 commit 9ab486a
Show file tree
Hide file tree
Showing 3 changed files with 26 additions and 17 deletions.
19 changes: 10 additions & 9 deletions docs/config.sample.yml
Original file line number Diff line number Diff line change
@@ -1,4 +1,3 @@

# Welcome to Oobabot!
#
# This is the configuration file for Oobabot. It is a YAML file, and
Expand All @@ -12,7 +11,6 @@ version: 0.1.9
# persona
# .
persona:

# Name the AI will use to refer to itself
# default: oobabot
ai_name:
Expand Down Expand Up @@ -41,10 +39,9 @@ persona:
# discord
# .
discord:

# Token to log into Discord with. For security purposes it's strongly recommended that
# you set this via the DISCORD_TOKEN environment variable instead, if possible.
discord_token: ''
discord_token: ""

# Post the entire response as a single message, rather than splitting it into separate
# messages by sentence.
Expand Down Expand Up @@ -91,7 +88,6 @@ discord:
# oobabooga
# .
oobabooga:

# Base URL for the oobabooga instance. This should be ws://hostname[:port] for plain
# websocket connections, or wss://hostname[:port] for websocket connections over TLS.
# default: ws://localhost:5005
Expand All @@ -116,6 +112,10 @@ oobabooga:
temperature: 1.3
top_p: 0.1
typical_p: 1
epsilon_cutoff: 0
eta_cutoff: 0
tfs: 1
top_a: 0
repetition_penalty: 1.18
top_k: 40
min_length: 0
Expand All @@ -124,9 +124,12 @@ oobabooga:
penalty_alpha: 0
length_penalty: 1
early_stopping: false
mirostat_mode: 0
mirostat_tau: 5
mirostat_eta: 0.1
seed: -1
add_bos_token: true
truncation_length: 730
truncation_length: 2048
ban_eos_token: false
skip_special_tokens: true
stopping_strings: []
Expand All @@ -135,7 +138,6 @@ oobabooga:
# stable_diffusion
# .
stable_diffusion:

# When one of these words is used in a message, the bot will generate an image.
# default: ['draw me', 'drawing', 'photo', 'pic', 'picture', 'image', 'sketch']
image_words:
Expand All @@ -159,7 +161,7 @@ stable_diffusion:
steps: 30
width: 512
height: 512
sampler: ''
sampler: ""

# FEATURE PREVIEW: If set, the bot will ask Oobabooga to generate image keywords from a
# user's message. It will then pass the keywords that Oobabooga produces to Stable
Expand All @@ -172,7 +174,6 @@ stable_diffusion:
# template
# .
template:

# The main prompt sent to Oobabooga to generate a response from the bot AI. The AI's
# reply to this prompt will be sent to discord as the bot's response.
# .
Expand Down
15 changes: 8 additions & 7 deletions poetry.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

9 changes: 8 additions & 1 deletion src/oobabot/settings.py
Original file line number Diff line number Diff line change
Expand Up @@ -89,6 +89,10 @@ class Settings:
"temperature": 1.3,
"top_p": 0.1,
"typical_p": 1,
"epsilon_cutoff": 0, # In units of 1e-4
"eta_cutoff": 0, # In units of 1e-4
"tfs": 1,
"top_a": 0,
"repetition_penalty": 1.18,
"top_k": 40,
"min_length": 0,
Expand All @@ -97,9 +101,12 @@ class Settings:
"penalty_alpha": 0,
"length_penalty": 1,
"early_stopping": False,
"mirostat_mode": 0,
"mirostat_tau": 5,
"mirostat_eta": 0.1,
"seed": -1,
"add_bos_token": True,
"truncation_length": 730,
"truncation_length": 2048,
"ban_eos_token": False,
"skip_special_tokens": True,
"stopping_strings": [],
Expand Down

0 comments on commit 9ab486a

Please sign in to comment.