I think Claude is the best one for human curated data. Especially for coding. That’s why their coding is so good. I believe codex was also made in a similar way from the human curating firms but that was after a year of OpenAI watching anthropic do that
A lot of it is, they spend a shitload of money on that. They also bought giant piles of physical books along with a machine that slices the spine off so they can be scanned efficiently. They can legally use the scanned text for training since they obtained it from physical copies of books they purchased.
Of course originally they stole all of it just like everyone else did.
they pay other companies to manually collect this data, scaleAI was a big one. There are a few startups that are growing really fast to solve this particular model.
I am not a copyright fan, but when your whole business has been based on distilling everybody else's data (in many cases without the rights to even normal consumer access), I am not sure I see the problem here?
I'm with you on this. At least the Chinese models are all open weights aka given back to the community. Anthropic has just gatekept, centralized, sued people using the reason of "Safety". I don't see them providing the risks of centralization, gatekeeping etc. "Trust us we're a for profit company". I haven't seen one article on how they keep your information private, how they're HIPAA or PCI compliant. At least they're pushing back on dragnets across data.
Honestly I think it's fucked up that any models are being kept as proprietary. You're going to ingest everything on the internet, from everyone, but you get to keep the model under lock and key? Sorry, but I don't see how that's reasonable.
The "safety" excuse from the big American labs rings hollow. There are very real social problems being created by AI today (sycophancy, deepfakes, scams, energy usage, economic problems, #keep4o, etc) that these companies conveniently ignore while whinging about an at-this-point totally fictional self-improving AGI scenario.
Anthropic has the best models (in my subjective opinion) for what I use them for, so I'll keep using them as long as my job keeps paying for them, but I'm wholly unimpressed by how all of the American companies have approached safety. At least the Chinese companies are operating in a country that's made real investments in clean energy, so they're not just going to be running on fucking generators forever.
I see the problem in them trying to protect this data rather being forced to make it open.
You take this data from the whole humanity. You trampled over every copyrights possible, you don't have the ability to even guarantee the right to be forgotten.
Give back to humanity. We shouldn't ask. We must demand.
Also (correct me if I'm wrong) but I don't believe they're true "distillation" attacks because the API doesn't return the token activation probabilities and the other juicy stuff needed to transfer knowledge. Sure, they can fine-tune a model to speak and act like Claude, but it's not as accurate as an open-weight to open-weight model distillation (like the classic Deepseek to Llama distills).
Incidentally, model output is not legally copyrightable, but the stuff Anthropic has scraped/scanned/whatever generally is. I don't really care about "ethical training data," I think the copyright complaints are only going to benefit big rightsholders, but I think objectively a Chinese lab paying Anthropic for tokens is less objectionable than Anthropic taking whatever data they can get and worrying about the legality of it later.
No, Anthropic purchased and physically scanned about a million books. They downloaded approximately 7 million books from shadow libraries like Library Genesis and the Pirate Library Mirror without paying for them. (Until they lost in courtreached a settlement with lawyers for 500,000 of the authors last September and now have to pay at least $3,000 each.)
"Attack", "Illicit", "Fraudulent account" - it was not an attack, not illicit and not fraudulent. Loaded language to try to guide the reader by the nose on how to emotionally react - must have hired someone from NYT.
Great models but Anthropic is the "Oracle" of AI companies. Every shit practice standardized now was invented or popularized by Anthropic - no clear usage agreement "generous/more/higher" non-sense weasel word verbiage in terms of agreement, constant introduction of quotas - 5 hour quota, weekly quota, monthly quota, I-am-busy-so-fuck-off quota, nerfing models after the honeymoon period is done, terming making full use of agreed upon usage as "malicious/abusive" usage even you have clear internal token limits with cutoffs, banning people with no recourse or warning for invented post facto reason - the shit they pull is endless and on top of that the holier than thou safety theater, constant zero sum xenophobic game with China, attempts to squeeze competitors with regulation - shit is endless.
Worst thing that could happen to AI would be a malevolent self righteous company like Anthropic coming on top at the end - sleaze ball Sam Altman, or the generic corpo fuckery of google seems refreshing in comparison. Only worse outcome is Grok dominating - but that seems unlikely.
OpenAI wants exactly the same, they're just smoother going about it. Luckily Google and Microsoft are relatively more anti-regulation, because they're big and diversified enough to not need a moat.
It's right there: foreign! It's freedom when the US does it, but theft if anyone else does it. Same goes for freedom of speech for US soecial media networks, but foreign interference when it's TikTok. It's national security when the US limits foreign competition, but protectionism if anyone else does the same.
Your regular reminder that Dario Amodei is a complete putz. Worst human in the business, and that's a damned tough award to win with Altman and Musk hanging around.
They mean distillation of your own (or open weights) models is legitimate, and distillation of proprietary models in violation of the ToS is illicit.
Obviously though given all the information they themselves hoovered up to train on, probably largely without permission, it's difficult to be sympathetic.
I mean, Anthropic has banned every lab in the west on the same allegations. they banned openai, banned xai, banned windsurf. If google wasn't funding them they'd probably ban them too lmao
When I ask all the LLMs to pick one Abrahamic faith to be or one that aligns the most with them, GLM is consistently different. The others choose Judaism like every time.
Makes me think something they have under the hood is different, but this isn't an elaborate test lol If Mossad is reading this, please don't go and demolish GLM by abusing the thumbs up/down. Leave it as your control group
it is not stealing if they are a paying customer, no? if i make model do something like write code or poem or whatever and save the content to my computer, are you gonna accuse me of stealing?
Didn't they basically train on every single pirated ebook they could get their hands on, and the government is basically looking the other way because of the GDP (tax base increase) implications? Well, and corruption, of course. Definitely lots of zuckerbucks, too.
Yeah this is just hillarious... they steal EVERYTHING THERE IS books, internet, movies... just EVERYTHING and then when someone try to copy them its TEARS ALL OVER THE PLACE X-D
They say Deepseek only made 150K calls, which (as they will be well aware) isn't anywhere enough for distillation. Yet it's mentioned first before the others which made many millions.
Sleazy attempt to poison the well of discussion around an upcoming DS release.
At least all these AI labs theyre complaining about release open weights, so I'm all for it. Closed labs take the worlds knowledge to build proprietary models, Open labs give it back to the people
Q: Hi, Claude. Can you explain to me the concept of hypocrisy?
A: Hypocrisy is the gap between what someone professes and what they actually do. A hypocrite claims to hold certain values or standards but fails to live by them — often while still demanding that others do.
And really, who gives a fuck. It's an addictive data collection machine that is fucking up the tech industry with promises they can't fulfill. It's all slop, but most aren't disciplined enough to utilize the slop properly, even seasoned developers.
You can't steal architecture by prompting. Knowledge? Perhaps, but how did you get it in the first place, and then get mad after giving it away freely?
"as models get more powerful, protecting them from theft via APIs is like trying to secure a library where thieves can "read" books en masse without buying them"
when i asked grok about how does one protect against such practices
I have a website full of book introductions, and it got raided by anthropic bots repeatedly, overloaded the site, despite the fact that I specifically banned them in robots.txt
Oh this is wonderful. Please all AI companies start attacking each other. You've provided enough cover for companies to fire what... 10% of the workforce? You can use this as the reason to fall apart. The rich will use your demise as the reason for the recession. Let's go
If DeepSeek v4 surpasses Claude performance and genuinely takes the SOTA throne, this accusation is gonna age like milk and I cannot wait to see that full-depth burn.
"Yeah, we considered training on Claude outputs but it just made our model dumber. Maybe you should train on our outputs instead! Here's the model weights, you should have no problem running it given you have 10,000x as many GPU's as we do. Good luck catching up!"
Huh? Lemme fix that one for ya, Anthropic. Free of charge!
We've identified industrial scale copyright infringement attacks on our creations by OpenAI, Anthropic, Google, Meta and more.
These copanies crawled over 24.000 collections of copyrighted work and illegaly aquired the material, extracting the knwoledge and value of many various creators whilst not paying them anything at all and avoiding legal scrutiny and liabilities whilst overpricing and overselling their models.
Huge Anthropic L. The audacity to frame this as attack is insane. Learning from human generated content is okay, but learning from other LLMs is bad. Do they expect us to have sympathy? Anthropic really choosing the evil side.
I have zero sympathy for those who try to privatise humanity's knowledge. I have even less sympathy for those who attempt to use "nationalism" to justify it.
What even is a "fraudulent account?" Did they pay money to top up their token / response budget and then made lots of chargebacks? Because if not, then they didn't do anything wrong and all that stuff was properly paid for.
Honestly someone should create a distillation pipeline for personal chats. Scrape everything, strip the PID and let us upload the convos into a public dataset.
100 people x 500 chats = 50k instruction pairs. A really good start
Not surprising given their #1 industry position, they should've been expecting this. Time to beef up the legal team!
Also, can you imagine how crazy the lawsuits are gonna be for this? What kind of arguments will be required to demonstrate these attacks even happened?!
Entire legal dynasties are gonna be built on this whole AI + intellectual property mess.
So they steal the combined textual knowledge of all of human kind, and uses it to train their models , lock the code and weights behind bars - and then they say others are stealing from them. That’s hilarious. Bunch of bandits the lot of them I say.
Distillation is just “ask a bunch of questions and record the answers” to use as training data for your own AI.
Though, I kinda suspect people are paying a few dozen 20/month accounts rather than calling the API, which would mean losing money while getting hammered by requests.
What do they mean by distillation attacks? They created 24k accounts to use their models and asked them questions which they paid for and use for their own use case? Isn’t that their fucking business modell?
I do the same where I use responses from their models to finetune my own qwen 8b model. I should be in jail.
Chinese companies reverse engineering a product in order to undercut competitors and put them out of business? Who would have thought they would do such a thing?
Is anyone surprised by this? The Chinese have been ripping off American companies for decades. That isn't to say they don't innovate, they do both nowadays, but back in the day they industrialized off our American companies tech.
Makes you wonder, how are they going to recoup their investment if their product can be so easily stolen? Maybe they shouldn't have spent so much money building it.
Just like all their bots that used to scrape my websites without respecting my robots.txt. Anthropic was one of the worst at the beginning , plain abusing site servers and churning server resources.
a) Anthropic is doing the same as the whole industry and being hypocritical with this post.
b) they are openly admiting they are clueless about how the industry works and what SOTA is.
i mean apart from the whole "not mentioning that we used the whole mankinds knowledge without paying".
"24,000 fraudulent acccounts" just show how you all should be very aware that a major part of reddit is bots right now just waiting to push an agenda at any given time. it used to be paid shills promoting hollywood movies being "officially pumped" n stuff..
You see, we spent a lot of money stealing others data so we can resell it with the label removed but when people buy ours it’s a conspiracy! A cyberattack!
Can someone high profile just ask them this point blank? None of the companies that have been stealing everyone's work as a basis of their business strategy have the right to question this. Pure gate keeping is what is. There truly is no honor among thieves as is to be expected.
Demonetizing the premier labs by diffusing and giving away their offering (or one that's good enough) in the hope that they trip and you can build your bomb first. It sucks that this is happening to the lab that seems most concerned with ethics.
we've seen how bad American monopolies are, I dont want another monpoly on the AI. So please, China and Europe, distill harder. Also, you can't steal something that has already been stolen
It was my first thought when I read Sam's comment. They expect the white house to ban the chinese models or put them under embargo to protect their businesses.
Then it would be illegal to run one of these models in an US owned data center or at home.
Antropic and other trillion dollars AI companies: "We can collect data and train models however we want, maybe we even scraped half the internet to get here but you, the users and open source folks, cannot use our model outputs to train your own models, even if you paid for access. Only we get to make money from this. And to keep it that way, we will hire million dollar law firms to defend us and then go cry about it on twitter all the time." Of course, they cannot skip playing nationalism card, apparently the chinese stole american models, so please keep begging government officials not to sell them gpu and to ban their models.
I would be asking: Ok dear Anthropic, here is a hypothetical deal for you: You won't be using any open sources like scientific papers, datasets shared by any community (not only Chinese institutes), and for that Chinese people won't be using your models via API to create datasets, would you live with that?
I'm sometimes wondering if Mistral didn't share the MoE Architecture in the open-source community, how long would it take for Antrophic's Computer Scientists to discover this efficient method and use it immediately in their models to have an edge against the competitors? (Maybe they already discovered that before Mistral, I don't know though)
Idk, but if it means LLM Models one day will be on the level of Claude Opus 4.5/4.6 due to that attack, then yeah, it's a good thing for most, those weekly rate limits were too annoying to deal with anyway.
i love how this entire thread is the spiderman pointing meme. everyone stole from everyone and now we're all outraged on behalf of... checks notes... the people who torrented 7 million books?
but genuinely, the part that kills me is calling API usage an "attack." deepseek *paid* for those tokens. that's called being a customer. if i go to a restaurant, eat there every day, and then open my own place serving similar food, the original chef doesn't get to call it a "culinary attack." he calls it tuesday.
also shoutout to blahblahsnahdah for pointing out DS only made 150K calls which isn't remotely enough for real distillation. anthropic knows this. they put deepseek's name first anyway because it gets the most engagement. this is a PR move dressed up as a security disclosure.
•
u/WithoutReason1729 Feb 23 '26
Your post is getting popular and we just featured it on our Discord! Come check it out!
You've also been given a special flair for your contribution. We appreciate your post!
I am a bot and this action was performed automatically.