Linebreaks

[An0therAnon]

For some reason agnai doesn't receive line breaks, its quite annoying when using a RPG bot with stats which are all clogged in a sole paragraph. Even with other bots, when looking at the original result in scale, it haves line breaks, but in the UI it doesn't.

[sceuick]

This might be due to the "end tokens" that Agnai looks for in a response because it expects it to be conversational in nature.
Specifically, Agnai looks for \n\n which might be causing your issue.

I'm intending to support other modes such as adventure, story, and companion modes.
Your use case might fall in to that.

[giubil]

@sceuick I took a look at the issue of the linebreaks disappearing in a message, and I think I found the the problem.

It's coming from the sanitise() function in srv/api/chat/common.ts :
https://github.com/luminai-companion/agn-ai/blob/760260e990efdd82431dcbdcf45f82ad0cf02587/srv/api/chat/common.ts#L99

In regex, \s+ will match all whitespaces, including line breaks. To exclude linebreaks from the match, you need to use this regex : /[^\S\r\n]/g (which also excludes Windows carriages returns for good measures)

I've tested it locally, and indeed, when replacing the regex with the updated one, we see line breaks in the received message :

I haven't done any more testing than this, so I have no idea if it breaks something somewhere else, but thought I would share anyways.

[sceuick]

Thanks for digging into this for me. I'll do some testing with your regex.

[An0therAnon]

Welp, it there is another issue which wasn't in the site before; ill post it here since its quite similar and maybe it haves a relation: when a message have a double linebreak it will cut the message at that, doesn't receive the full message.

[sceuick]

Literally just deployed a change that removed the \n\n end token. 🤞

[An0therAnon]

Just tested, everything in order. Good shit man, hope you can keep the good work.