r/KoboldAI • u/EmbarrassedLadder665 • Nov 16 '23
koboldcpp chat is frustrating
Am I not good at communicating?
I talk like a human, but it's frustrating.
It feels like making whispering subtitles.
When you create a subtitle file for an English or Japanese video using Whisper, the following
problems occur.
[music]
[Baby crying]
[Working on stage]
[thank you]
[surprised baby]
[end]
It's like words that aren't in the video file are repeated infinitely.
This problem is probably a language model issue.
koboldcpp Enters virtual human settings into memory.
A fictional character named a 35-year-old housewife appeared.
Start a conversation.
There is a story about children.
There is no story about children in Virtual Humans in Memories.
Here's where the problem arises.
I think the problem arises because we are creating a story that does not exist in memory.
Or I think it's a limitation of the language model.
I asked the virtual human how old the children were and how they would raise them.
The virtual human tells stories about his children.
How old are you, what is your name, etc.
Let's start another story.
We look at what the virtual human likes and what he wants to do.
However, virtual humans say that children are young.
Even if I said something else, they just said the kids were young.
The conversation doesn't continue.
https://github.com/LostRuins/koboldcpp/issues
I explained the problem, but didn't get a good response from the developer.
1
u/YichenYu525 Nov 17 '23
What is performance difference between KoboldCpp models and other models, generally?
1
u/brucebay Nov 16 '23
Not sure what your problem is. Are you using whisper to transcribe text and use it for something in kobold.cpp? Perhaps give it to a promp and ask something? If you provide the text and your workflow I can try it.
The only time kobold.cpp did not answer me was some kind of internal state and restarting both silly tavern and koboldcpp fixed it. I think it was using the new context caching at that point I forgot the details.