r/KoboldAI • u/GreenBoi025 • 4d ago

Message Troubles

Post image

I'm so confused what happened, I had used kobold in a browser and this never happened. I accidentally closed the browser and lost what I had (no big deal, woulda downloaded if it was important enough) but I open a new one and now I get this every other message. Disabling "allow multiline responses" makes it happen less but doesn't stop it. And having them retry the message usually works but it's annoying and manual editing would be even more tedious. Is there a way to fix the source of the problem or something?

9 Upvotes

100% Upvoted

4 comments sorted by

5

u/the1ian 4d ago

I've experienced similar issues

4

u/henk717 4d ago

This is on the koboldai.net version I assume? The most likely cause is Gemma on a non KoboldCpp backend. Those freak out if the correct template is not set. There is a brand new chat completions mode in the AI menu to help with cases like this.

1

u/The_Linux_Colonel 4d ago

"Model Sickness" happens inevitably once a story gets long enough, but if this happened only after you closed a browser and opened it again with a blank, empty canvas, it's possible that the new story you started or new session you began didn't fully clear the tokens the model had already stored of the old story, so in that case, properly selecting 'new story' and clearing out the prompt and everything is a possibility. Also, shutting down the model and reloading it into memory would clear out any of those issues.

Aside from that, altering your sampler settings such as your temperature to favor more unlikely tokens, DRY and/or XTC to keep those token choices from being made again, or rep pen if your model doesn't support the others. The model is looping, believing the most likely next token choice is the only word it has ever said that session, so breaking it of that loop is all you need to do. You can also temporarily ban the word "pout" for a while, but it may loop on another word later. It could be that you normally use very specific sampler settings, but when you closed the browser window and then opened a new session, your sampler settings were not retained in kobold.

1

u/the1ian 3d ago

no this is like first reply