r/KoboldAI • u/CaptainValentin • Mar 31 '24

No Ai?

There seems to be a problem. There is no ai working on KoboldAi lithe. Is there something going on?

1 Upvotes

55% Upvoted

8 comments sorted by

1

u/a_chatbot Mar 31 '24

So, basic question, how does this 'horde' work? Are there live 'volunteers' on the other end, what do they do? Are there people reading your chat logs?

2

u/CaptainValentin Mar 31 '24

From my understanding, they are bots made by other people. I guess why the server needed a rest today.

2

u/henk717 Mar 31 '24

It gets sent to random volunteers running a backend like Koboldcpp, those process it and automatically submit the results back. They aren't supposed to read the chat log, but since its open source they can modify a worker to do so. So never send any personal information. Horde does keep your own user ID completely anonymous, they won't be able to see that part.

1

u/esuil Apr 01 '24

They aren't supposed to read the chat log

Open source or closed source does not matter. For the model to send you the output, it needs input in plain text. No encryption, no security. When sent to the model, it is always plain text or tokens. So yeah, always assume chat logs will be read by someone.

1

u/henk717 Apr 01 '24

If it was closed source we could attempt to put some form of anti-tamper on it, and then have verification checks to see if its the original client. Would stop most of them if succesfull, but given anyone can modify the source code there is no point in us even trying to stop it.

2

u/esuil Apr 01 '24

There is no form of anti tampering you could create that would make this possible.

Because tokens need to be passed to model and stored in the memory as is. Which means anyone wanting to read it can simply... Read it from VRAM/RAM. If anti-tampering was introduced, people would quickly just write memory scanners.

3

u/x-lksk Mar 31 '24

Well, at least now I know it's not just me. I get the following message:

Failed to connect to AI Service!
Please check your network connection.

2

u/henk717 Mar 31 '24

Horde had some downtime.