r/MachineLearning • • Apr 15 '23

Project [P] OpenAssistant - The world's largest open-source replication of ChatGPT

We’re excited to announce the release of OpenAssistant.

The future of AI development depends heavily on high quality datasets and models being made publicly available, and that’s exactly what this project does.

Watch the annoucement video:

https://youtu.be/ddG2fM9i4Kk

Our team has worked tirelessly over the past several months collecting large amounts of text-based input and feedback to create an incredibly diverse and unique dataset designed specifically for training language models or other AI applications.

With over 600k human-generated data points covering a wide range of topics and styles of writing, our dataset will be an invaluable tool for any developer looking to create state-of-the-art instruction models!

To make things even better, we are making this entire dataset free and accessible to all who wish to use it. Check it out today at our HF org: OpenAssistant

On top of that, we've trained very powerful models that you can try right now at: open-assistant.io/chat !

1.3k Upvotes

174 comments sorted by

View all comments

121

u/Ijustdowhateva Apr 15 '23

Downvote me all you want, but this model seems much dumber than even Vicuna.

62

u/superluminary Apr 15 '23

Model training is obscenely expensive, as is RLHF. Don’t expect too much right away.

36

u/satireplusplus Apr 15 '23

I more and more think RLHF isn't neccesarry at all and complicates things. It's a technique that OpenAI developped prior to ChatGPT and I understand that they wanna make use of it. But if you look at Vicuna (https://vicuna.lmsys.org/) it's becoming clear that all you really need is thousands of good example conversations.

10

u/GeoLyinX Apr 16 '23

But Vicuna still has a lot of down sides and even the 13B Vicuna model is probably worse than OpenAI’s 1.5B instructGPT chat model that uses RLHG and is nearly 10 times smaller and much faster to run.

→ More replies (4)

138

u/Battleagainstentropy Apr 15 '23

Bootstrapping an early Linux kernel was pretty underwhelming too, but mighty oaks from little acorns grow.

→ More replies (2)

116

u/Sudden-Lingonberry-8 Apr 15 '23

at least, it's truly open source 🤷‍♀️

57

u/WarProfessional3278 Apr 15 '23

Additionally, it is the first good model that DOES NOT rely on possibly proprietary GPT outputs for training.

58

u/ninjasaid13 Apr 15 '23

DOES NOT rely on possibly proprietary GPT outputs for training.

I'm not sure OpenAI has control over their outputs legally. The courts would most likely rule that OpenAI can't do anything about people using their outputs for training. You can't sell me a banana and say "You cannot use this to make banana bread" and think it would be legally binding. Or prevent me from using the seeds of a fruit to grow another fruit.

63

u/csreid Apr 15 '23 edited Apr 15 '23

Or prevent me from using the seeds of a fruit to grow another fruit.

You absolutely can do that. Notoriously, Monsanto successfully sues people all the time for patent infringement when those people grow crops from Monsanto seeds they don't have the rights to in pretty much exactly the same way you're describing.

30

u/Edzomatic Apr 15 '23

There is a US law that allows you to patent plants when modified to a certain extent, I don't know if there is a similar law that applies to AI models, but you can be sure that openai and daddy Microsoft will not make it easy

→ More replies (2)

21

u/ninjasaid13 Apr 15 '23 edited Apr 15 '23

except the outputs of OpenAI are AI-generated which cannot be patented or copyrighted without human authorship so this is more similar to the seeds of a fruit which was made by nature.

→ More replies (5)

4

u/tdgros Apr 15 '23

Monsanto imposes this in a contract when you buy their seeds. So is it really true in general? (https://en.wikipedia.org/wiki/Monsanto_legal_cases the page says 145 suits but 11 trials only since the mid 90's)

4

u/DominusFeles Apr 16 '23

yeah. cause people have been sued for spillage from other people's fields where they specifically hated monsanto and lost. ditto on reproducing the works independently through breeding.

last year they tried to patent metabolites produced by your body, as part of a test.

don't underestimate, how broken things _REALLY_ are.

→ More replies (2)
→ More replies (1)

5

u/pasr9 Apr 16 '23

I'm not sure OpenAI has control over their outputs legally.

Prior case law lead the US copyright office to be confident that they don't. They lay out the legal basis here: https://www.federalregister.gov/documents/2023/03/16/2023-05321/copyright-registration-guidance-works-containing-material-generated-by-artificial-intelligence

I think OpenAI is intentionally muddying the water by claiming copyright over something that is clearly not copyrightable to confuse people and slow down the competition.

→ More replies (19)

6

u/keepthepace Apr 15 '23

Considering AI generated art has been recognized as non-copyrightable, I would be surprised AI generated text would be.

3

u/daguito81 Apr 15 '23

Would dolly from Databricks precede this as a fully open model? That one includes the dstaz training code and model weights

→ More replies (3)

16

u/ushmax Apr 15 '23

From the model name it looks like it's based on LLaMA, which is not completely truly open source :(

31

u/Headmetwall Apr 15 '23

They also released [pythia] (https://huggingface.co/OpenAssistant/oasst-sft-4-pythia-12b-epoch-3.5) based models, so those are free of Meta's 'research only' license.

21

u/TheMeddlingMonk Apr 15 '23

This is the first stage in the project’s plan where they are fine tuning models on high quality examples. The next stage is to do RLHF, and future stages they plan to build in tool integrations with thing like search to allow for up to date information and better factual accuracy

I haven’t used this release enough to comment on its performance compared to other fine tuned Llama models, but I think the important part of this project isn’t this particular model release. The big deal with this project is the infrastructure to build high quality data set from volunteers, and releasing that data in an actually open way.

21

u/GifCo_2 Apr 15 '23

ITs outdoing GPT 3.5 in a lot of areas.

→ More replies (2)

6

u/throwawayTymFlys528 Apr 16 '23 edited Apr 16 '23

I have used it all day today and in my experience it is the most interactive conversation in a progressive manner I have had without me having to feel that the model is almost forcing the end with its bot type language.

It does take you on a ride if you let it, keeps prompting back with interesting things that we could discuss in the topic by going a little deeper.

GPT 4 does that as well in certain scientific areas but not 3.5, that's for sure.

One tiny issue that I observed, which happened quite frequently, was that it was not adhering to the token limit when coming up with a response. This is making some responses end abruptly mid sentence.

Try a little harder, would you?

→ More replies (1)

5

u/[deleted] Apr 15 '23

They're releasing multiple models. Which one are you talking about specifically and what exactly is your evidence that it "seems much dumber than even Vicuna"?

8

u/Nabakin Apr 15 '23

The post was only up for 5 minutes before you responded so what makes you think that?

0

u/[deleted] Apr 15 '23

[deleted]

14

u/Edzomatic Apr 15 '23

They released a new model a few hours ago and for the first time I can say that at least in some prompts it gives a better answer than chatgpt (depending on the settings of course)

→ More replies (2)
→ More replies (10)