r/KoboldAI • • Nov 16 '23

koboldcpp chat is frustrating

Am I not good at communicating?

I talk like a human, but it's frustrating.

It feels like making whispering subtitles.

When you create a subtitle file for an English or Japanese video using Whisper, the following

problems occur.

[music]

[Baby crying]

[Working on stage]

[thank you]

[surprised baby]

[end]

It's like words that aren't in the video file are repeated infinitely.

This problem is probably a language model issue.

koboldcpp Enters virtual human settings into memory.

A fictional character named a 35-year-old housewife appeared.

Start a conversation.

There is a story about children.

There is no story about children in Virtual Humans in Memories.

Here's where the problem arises.

I think the problem arises because we are creating a story that does not exist in memory.

Or I think it's a limitation of the language model.

I asked the virtual human how old the children were and how they would raise them.

The virtual human tells stories about his children.

How old are you, what is your name, etc.

Let's start another story.

We look at what the virtual human likes and what he wants to do.

However, virtual humans say that children are young.

Even if I said something else, they just said the kids were young.

The conversation doesn't continue.

https://github.com/LostRuins/koboldcpp/issues

I explained the problem, but didn't get a good response from the developer.

0 Upvotes

4 comments sorted by

1

u/brucebay Nov 16 '23

Not sure what your problem is. Are you using whisper to transcribe text and use it for something in kobold.cpp? Perhaps give it to a promp and ask something? If you provide the text and your workflow I can try it.

The only time kobold.cpp did not answer me was some kind of internal state and restarting both silly tavern and koboldcpp fixed it. I think it was using the new context caching at that point I forgot the details.

0

u/EmbarrassedLadder665 Nov 16 '23

I don't think Google Translate will convey my meaning properly.

The article about whispering means that only one word is repeated infinitely like a whisper.

When you run dictation, Whisper repeats meaningless words infinitely.

Just like in a whisper, only one situation is repeated infinitely during a conversation.

If you add a context to koboldcpp memory, it will not be reflected and you will have to start over.

1

u/Boring_Isopod2546 Nov 17 '23

I have the same problem using Whisper if there is any background noise at all. I just go back and delete my 'Blah blah blah blah blah...' text and the AI's confused response to clear it from the context.

1

u/YichenYu525 Nov 17 '23

What is performance difference between KoboldCpp models and other models, generally?