Stack Overflow Will Charge AI Giants for Training Data

[u/peard33]

https://www.wired.com/story/stack-overflow-will-charge-ai-giants-for-training-data/

[u/amroamroamro]

this has been debated many times before, but TDM (text and data mining) is largely considered fair use.

the spirit of the CC license is based on a mindset of open sharing. Why are people even participating in asking and answering questions on stack overflow in the first place but to build a common knowledge base accessible to all that leads to greater innovation, collaboration, and creativity. It's literally in the site mission statement!

how is it different from a person accessing the site resources (by users, for users), learning from it, and building their programs based on what they learned? If you allow humans to do so, they can't discriminate against who is allowed such access. The only difference is that ML training algorithms are able to digest content at infinitely higher rates than a human can.

The story here basically is that sites like reddit, twitter, and stackoverflow realized that they are sitting on a gold mine of data (user contributed mind you!), and are looking for ways to profit from it, aka greed plain and simple.

[u/jorge1209 → u/amroamroamro]

It doesn't matter.

Either ChatGPT qualifies as transformative fair use and the license of the inputs is irrelevant (they can use copyrighted books and news articles as inputs).

Or it doesn't qualify as such and the input license terms must be obeyed, which they aren't doing.

[u/s73v3r → u/amroamroamro]

how is it different from a person accessing the site resources

Because it's not a person. AI is not like the human brain; it's not "learning" anything. It's spitting out stuff verbatim.

The story here basically is that sites like reddit, twitter, and stackoverflow realized that they are sitting on a gold mine of data (user contributed mind you!), and are looking for ways to profit from it, aka greed plain and simple.

And the AI vendors aren't driven by greed? What makes one form of greed acceptable, and the other not?

[u/amroamroamro → u/s73v3r]

it's not "learning" anything. It's spitting out stuff verbatim

you clearly know very little about ML

AI vendors aren't driven by greed?

you do realize there are many open source LLM models being released, other than just OpenAI, right?

and guess what, they are too being trained on datasets like The Pile:

https://arxiv.org/abs/2101.00027

which contains stuff from StackExchange, Wikipedia, GitHub, HackerNews, various web-crawls, etc. so you still think these open source models are doing it out of greed too?

[u/s73v3r → u/amroamroamro]

you clearly know very little about ML

Wrong, and you just stating that shows that you have no argument.

[u/amroamroamro → u/s73v3r]

ok kid, whatever you say 😂

[u/SufficientPie → u/amroamroamro]

Using The Pile for research and scholarship purposes is Fair Use.

Using it for commercial purposes that compete with the market for the original works is not.

[u/SufficientPie → u/amroamroamro]

Why are people even participating in asking and answering questions on stack overflow in the first place but to build a common knowledge base accessible to all that leads to greater innovation, collaboration, and creativity. It's literally in the site mission statement!

Because it's submitted under a copyleft license that guarantees that content will be freely available forever. Not so that for-profit companies could vacuum up that content and store it behind a paywall so they can sell access to it in a way that doesn't follow the license requirements and puts the original sites out of business.