Skip to content

stopword for translations ?? #247

@Ben749

Description

@Ben749

Hi, given I want to translate a simple sentence

python run_inference.py -m models/BitNet-b1.58-2B-4T/ggml-model-i2_s.gguf -p "Translate me this sentence into french : the white rabbit jumps over the white rainbow" -n 100 -temp 0.1

but this keeps on repeating text or annotations, word per word translation until it reaches 100 tokens ... Is there any way of saying " Stop, once the appropriate answer is given ? "

Thanks a zillion time for any clue, notice, comment, enlightenment ;)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions