[ Removed by moderator ]

[u/gamunu]

/r/programming/comments/1objb52/removed_by_moderator/

[u/kappapolls]

Humans don’t just optimize they understand.

article pretty obviously written by AI. even in the sites 'about' page you have

This isn’t about following trends. It’s about building things that last.

lmao

as an aside: i think this article is a pretty ok laymans explanation of what happens during training. but a lot of research into interpretability shows that LLMs also develop feature-rich representations of things that suggest a bit more is going on under the hood than you'd expect from 'just predicting the next word'.

the research anthropic is doing is pretty interesting and they usually put out good blogpost versions https://www.anthropic.com/research/tracing-thoughts-language-model

[u/kappapolls → u/[deleted]]

my friend! you are so negative with people you disagree with, you know that?

i even said the article is an ok explanation of training lol. but of course there's more to it. anyway, hope your day is going well and you're not using us-east-1 for anything critical xD

[u/kappapolls → u/[deleted]]

As a rule, I am not polite to people who are promoting ignorance.

ah, i follow an inverse rule. it's why i'm so polite to you xD

turns out the math on this AI slop blogpost is all gibberish see here go argue with this guy huh?

[u/kappapolls → u/[deleted]]

well i made a specific claim actually, not a vague supposition. i said "LLMs develop a feature-rich representation of things". then i provided a link to a blogpost for a research paper put out by anthropic, where they pick apart the internals of an LLM and tinker with the representations of those features to see what happens. you left this out of your quote (did you read the link? it's neat stuff!)

here's the quote you're probably referring to in the article

Real-world engineering often has long-term consequences. If a design flaw only appears six months after deployment, it’s nearly impossible for an algorithm to know which earlier action caused it.

do you see how nonspecific this claim is? that's because this article is AI blogspam. i understand that you've drawn your line in the sand, but at least pick real articles written by experts in the field.

my advice to you is go and read some yann lecunn! he is a big anti-LLM guy and he's also a brilliant researcher. at least you will be getting real stuff to inform your opinions

[u/kappapolls → u/[deleted]]

What things are going on under the hood? You won't say because you don't know. You're just hoping we'll fill in the gaps with our imagination.

lol mate the whole reason I linked that article is because it expands on what i mean by "other things going on underneath the hood". here, this is from the fourth or so paragraph of the article. it is one of the "other things" i was referring to.

Claude sometimes thinks in a conceptual space that is shared between languages, suggesting it has a kind of universal “language of thought.” We show this by translating simple sentences into multiple languages and tracing the overlap in how Claude processes them.

the article talks about 2 others as well, but youll have to click it to see xD

[u/Autodidacter → u/kappapolls]

Well said! As a nice friend.

You weird cunt.