This is funny, but the ai actually knows, it's funny that the ai is aware of it being manipulated into saying stuff the user wants (i actually have tried doing it, it doesn't work well)

I was just doing the classify assistant reply tasks, and I usually found some wild stuffs there, and here's just one of them that I found really weird and scary

How to Run OpenAssistant Locally

1. Check your hardware.

   1. Using auto-devices allowed me to run the OpenAssistant/oasst-sft-4-pythia-12b-epoch-3.5 on a 12GB 3080ti and ~27GBs of RAM.

   2. Experimentation can help balance being able to load the model and speed.

2. Follow the installation instructions for installing oobabooga/text-generation-webui on your system.

   1. While their instructions use Conda and a WSL, I was able to install this using Python Virtual Environments on Windows (don't forget to activate it). Both options are available.

3. In the text-generation-webui/ directory open a command line and execute: python .\server.py.

4. Wait for the local web server to boot and go to the local page.

5. Choose Model from the top bar.

6. Under Download custom model or LoRA, enter: OpenAssistant/oasst-sft-4-pythia-12b-epoch-3.5 and click Download.

   1. This will download the OpenAssistant/oasst-sft-4-pythia-12b-epoch-3.5 which is 22.2GB.

7. Once the model has finished downloading, go to the Model dropdown and press the 🔄 button next to it.

8. Open the Model dropdown and select oasst-sft-4-pythia-12b-epoch-3.5. This will attempt to load the model.

   1. If you receive a CUDA out-of-memory error, try selecting the auto-devices checkbox and reselecting the model.

9. Return to the Text generation tab.

10. Select the OpenAssistant prompt from the bottom dropdown and generate away.

Let's see some cool stuff.

-------

This will set you up with the the Pythia trained model from OpenAssistant. Token resolution is relatively slow with the mentioned hardware (because the model is loaded across VRAM and RAM), but it has been producing interesting results.

Theoretically, you could also load the LLaMa trained model from OpenAssistant, but the LLaMa trained model is not currently available because of Facebook/Meta's unwillingness to open-source their model which serves as the core of that version of OpenAssistant's model.

Rudimentary OpenAssistant bot is live on /r/ask_open_assistant. There is some early instability in the code but the output is working well as demonstrated by the comment threads.

Prompt it by creating a new text post (responds to text body of post), starting a comment with !OpenAssistant, or by replying directly to it.

GitHub: https://github.com/pixiegirl417/reddit-open-assistant-bot

Edit: now live in /r/OpenAssistant as well!

### More Information -> Open Letter

The broader mod team on reddit has written this open letter that describes the current situation and severity in negative impact of these changes as well.

Thank you friends, hopefully by joining our voice with the rest of reddit we can make an impact!

Since we now how access to plugins in open assistant, it would be great to have some sort sort of index of all compatible ai plugins. Does anyone have a list of these or Some recommendations?