Processing Prompt (1 / 1 tokens)
Generating (1 / 242 tokens)
(EOS token triggered! ID:2)
CtxLimit: 3768/4096, Process:0.44s (442.0ms/T = 2.26T/s), Generate:0.00s (3.0ms/T = 333.33T/s), Total:0.45s (2.25T/s)
Output:
Doesn't matter what the model, it keeps happening. After 20 or so messages the model starts outputting nothing or "::::::::::::::::::". I updated both KoboldCpp and SillyTavern to the latest version but it keeps happening. I am not that tech-savvy so any guess is as good as mine
Doesn't matter what the model, it keeps happening. After 20 or so messages the model starts outputting nothing or "::::::::::::::::::". I updated both KoboldCpp and SillyTavern to the latest version but it keeps happening. I am not that tech-savvy so any guess is as good as mine