Playground and API parameters dont seem to have an effect on certain completions

[auwsom]

I've tried changing temperature, top-p, presence_penalty and frequency_penalty to stop the model from repeating the same joke and other phrases with no success. I thought maybe the playground had a glitch, but this happens in the API too.

Ask for a completion on "tell me a joke" and you will likely get "why did chicken cross the road". Then variations on that "why did the duck cross the road", etc. even if the chicken tokens are removed.

The model knows other jokes.. "why don't scientists trust atoms? because they make up everything" and "why didn't the bicycle go up the hill? because it was two tired", but these only happen randomly.. once it says the chicken/road joke it cant change it (like a bad comedian ; ).

Sorry to put this here, but the GPT-3 repo is archived for new issues, but it probably also applies here.