Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Repetitiveness #26

Open
Whyyoulookin opened this issue Jan 28, 2023 · 1 comment
Open

Repetitiveness #26

Whyyoulookin opened this issue Jan 28, 2023 · 1 comment
Assignees
Labels
question Further information is requested

Comments

@Whyyoulookin
Copy link

The bot has been repeating words multiple times during a sentence, and just is repetetive in general, for example I'll get a sentence like "She laughed again, shaking her head. She replied, her voice dripping with sarcasm. She replied, her voice dripping with sarcasm. She replied, her voice dripping with scorn. She replied, her voice dripping with disdain." all in the same sentence. As well as the bot saying the exact same thing multiple times in the sentence, like saying "You're mine" 3 times in a row. My guess on where this COULD be coming from is people dumping chat logs of cai and since the cai bots are pretty repetitive sometimes I guess that could be the isuse?

@0x000011b
Copy link
Collaborator

My guess on where this COULD be coming from is people dumping chat logs of cai and since the cai bots are pretty repetitive sometimes I guess that could be the isuse?

Possibly. I do some filtering on the submitted data to try and remove those kinds of repetitions but it's not perfect, so there's a portion of that still making it through and being used to train the models unfortunately.

However, that kind of exaggerated repetition within the same message sounds unusual. Perhaps try using the default generation settings but with the repetition penalty slightly increased (~1.2)? Or if there's very few example chats or persona data, you could try filling those in with more varied stuff.

@0x000011b 0x000011b self-assigned this Jan 30, 2023
@0x000011b 0x000011b added the question Further information is requested label Jan 30, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants