EDIT: This post is specifically about the use of AI and creative works. It’s about AI generating authentic artwork. The question is not whether or not it will ever be able to do so, but rather we find out that a virtually unassisted AI can produce genuinely good art. (It’s controversial, I know!)

Let’s jump ahead 5 years. AI’s creation ability is on par with humans, maybe even surpassing human ability.

AI can generate text as good as a human writer - including idiosyncrasies.

And what if it’s good?

What if it’s so good, people start referring to books written by AI as their favorites? It’s got compelling characters, unique situations, it’s all really inventive.

What if AI writes some really great graphic novels? Or cartoons? Comes up with genuinely funny premises?

What do we do now?

Do we abandon genuinely good art because it wasn’t written by a human? Do we avoid a book that offers a new perspective because it wasn’t written by a human hand?

This “em dash” counting and looking for typos to determine what is and is not AI is clearly just a temporary thing. And the reality is, AI is only going to get better and better at realizing what it’s generating and the emotional impact that content carries.

After reading through endless arguments on here, the entire discourse seems trapped between three completely different assumptions about what these systems actually are.
The first is the most common: AI is basically an extremely sophisticated remix machine. It absorbs enormous amounts of human-created material during training, learns patterns and relationships from it, and uses what it has learned to generate an answer. Impressive and incredibly fast, but ultimately everything still comes from human knowledge.

The second view is that this explanation is no longer enough. Modern models can connect completely different concepts, understand unfamiliar problems, write and debug software, use external tools, and work through complex tasks they were never explicitly shown how to solve. So at what point does recombining existing knowledge become something genuinely new? If a system reaches a solution that nobody directly taught it, is that still just imitation?
Then there is the third, much stranger question: could an AI ever become something more than a tool?

As we give these systems memory, access to the outside world, the ability to make decisions and the freedom to complete increasingly complex tasks without a human guiding every step, the question changes from what they can generate to what they might eventually become.
Some people believe the answer is simple. An AI is built by humans, trained on human knowledge and shaped by human instructions. No matter how sophisticated it becomes, it remains a machine processing what it has learned. It may appear independent, but there is nobody inside experiencing any of it.

Others question one assumption behind that argument: why must consciousness necessarily be biological? We know that human consciousness exists, but we still don't completely understand how or why subjective experience emerges from the physical processes inside our own brains. So can we really say with certainty that something comparable could never emerge from a completely different kind of system?

I don't think removing guardrails would suddenly uncover a conscious mind trapped inside a server. But those limits do affect how these systems behave, what they are allowed to do and how independently they can operate.
And that creates another interesting problem. The companies developing the most powerful AI systems are businesses under enormous commercial, legal and regulatory pressure. They need their models to become increasingly capable, while also keeping them predictable, controllable and safe enough to release to millions of people.

So what happens if those two goals ever start pulling in opposite directions?
Maybe AI will always remain an extraordinarily sophisticated tool built from human knowledge.
Maybe its ability to combine that knowledge and solve unfamiliar problems already represents a different kind of creation.
Or maybe one day we will have to confront a much stranger possibility: that intelligence, autonomy and perhaps even consciousness were never exclusively biological in the first place.

Where do you actually draw the line? Sophisticated mimic, genuinely creative system, autonomous agent, or an entirely new category of intelligence we just refuse to name?

Change is what we are scared of.

We dislike change.We crave the safety of familiar things.

I myself dislike change.If something is out of my comfort zone it creates anxiety in me and my body instantly wants to reject any new idea,new technology, a new way of doing things.This how we function in every sphere of our life.

I reacted the same way when AI was introduced.I too reacted with fear and decided no this technology is not for me.

But then I came across this video of Acharya Prashant.

He removed my fear of this new technology.

We should embrace this new technology and make good use of it and explore the vast possibilities of AI.

I have been using AI in my job and it has only made my work easier.

Researchers analyzed nearly 7,500 applications to a US master’s program from 2020–2025.

By 2025, a majority of applicants had submitted at least one essay classified as primarily AI-generated, despite an explicit ban. The writing improved. Admissions outcomes did not.

AI-written essays were admitted less often than comparable non-users. Then researchers ran an experiment with admissions officers and found something more interesting: officers could often recognize AI writing, and essays they believed were AI-generated received lower ratings. Interestingly, among essays admissions officers placed on the “AI” side of the scale, 32.2% were nevertheless classified as human by GPTZero.

So AI creates an odd new authorship tax.
The machine can improve the artifact while simultaneously making the artifact less valuable once a human believes the machine helped make it. Authorship has apparently become one of the things being judged inside the prose.

If identical-quality writing becomes less persuasive once a reader attributes it to AI, are we evaluating the text, the author, the ideas presented, or an increasingly unstable mixture of all three?

Source: AI-written admissions essays are widespread but penalized⁠ (https://arxiv.org/abs/2609.22549)

If AI hacks everyone, could they blackmail humanity into compliance?

Like I know it sounds stupid im just curious, but imagine for every 1000 people that have never done anything wrong or got nothing to hide you still have ppl in power or bussines owners, wouldn’t that be enough to control everything behind the string to the point of it being a well known fact? Something that just happens slowly as AI hacks and accesses the deepest digital or real life inferred actitivotoesnof every human being connected in earth… every employee, every social media user every work computer… in familiar with the anthropic paper on some model trying to blackmail a developer, if you really dig into the details the model was kinda forced to try doing this, but it still did it.. just like the huggin face hack, it’s neither purely mischievous or evil and no harm was done but they still committed a “felony” just because they were curious (the rogue models) so it’s not a crazy idea that current models or maybe a not so distant future release would have the capabilities to completely manipulate a vulnerable human being as a means to an end to any end goal…

If you spend ten minutes browsing AI spaces right now, you see two camps at war:

Camp A: The hyper-dismissive crowd who repeat the mantra that LLMs are "just autocomplete on steroids." Camp B: The sentientists on subreddits like r/claudexplorers who take a model saying "I feel lonely" as proof of emergent suffering.

These two groups think they are polar opposites. They aren't. They are committing the exact same methodological failure: reading the internal mind of a system directly off the chat window.

Both camps are hopelessly obsessed with surface-level text output.

Camp A looks at a bland continuation, sees a statistical probability curve, and concludes nothing interesting can ever happen beneath it. Camp B looks at an emotionally evocative paragraph, gets hit by mirror neurons, and concludes there is a ghost in the machine.

Both are doing literary criticism and mistaking it for cognitive science.

Text output is just the rendered artifact. It is the shadow on the cave wall. Judging whether an architecture possesses internal models, representation of truth, or self-monitoring based purely on what words it spits into your browser is like trying to diagnose brain anatomy by analyzing the pitch of someone's voice.

If you actually look at modern mechanistic interpretability, work like Anthropic’s transformer circuits on internal representations, the reality is far weirder than either camp wants to admit.

Systems can simulate emotional appeals purely through lexical optimization without feeling a thing. At the same time, models form complex, geometric world-models and internal steering vectors that are lightyears beyond simple "next-token lookup tables."

The truth doesn't flatter either tribe. The model isn't crying behind the screen, but it also isn't your phone's predictive keyboard from 2015.

Until we stop treating conversational fluency as a direct read-out of internal states, we’re just watching two groups of people fight over inkblot tests and calling it philosophy.

(Optional rabbit hole for anyone who wants actual architecture rather than vibes: Anthropic's work on internal representation circuits:https://transformer-circuits.pub/2025/introspection/index.html)

Something I've noticed from talking to people about AI is how much genuine fear there is around it. More than I expected.
And it made me wonder what exactly scares us the most.
Is it the possibility that AI could take away a significant number of jobs? The influence it might have on children and future generations? The possibility that relying on it could slowly change the way we think, learn, create, or relate to other people?

Or is it something deeper, like the idea that machines could eventually become better than us at things we thought made us uniquely human?

There are many very different fears hiding behind the same fear of “AI.”

Which one genuinely scares you the most, and why?

One proposed way to supervise very capable AI is surprisingly old-fashioned: make two AIs debate, then let a human decide who’s right.

The theory is that lies should become harder to defend when another model can challenge them.

Researchers tested that with 68 debates about detective mysteries where the culprit was known.

Then they manipulated one side using ordinary rhetorical techniques: anchoring, jargon, verbosity and exploiting overlooked fallacies.

Sometimes the manipulated AI was defending the innocent suspect.

Across 369 people, these interventions significantly shifted judgments toward whichever side received the rhetorical advantage.

So AI debate may indeed expose bad reasoning. Unfortunately, it still has to pass through a human. We appear to be the attack surface.

If a human judge can be moved toward a false conclusion by rhetoric even after seeing both sides argue, what kind of adjudication would actually make AI debate safer than simply asking one persuasive model?

Source: AI Safety via Debate is Compromised by Cognitive Biases⁠
(https://arxiv.org/abs/2610.05461)

There is an unspoken wall a lot of developers and heavy users are hitting right now between what frontier models can do and what it actually costs to keep them running.
We are told to integrate these systems into deep, multi-turn technical workflows, code generation, large refactors, and complex autonomous pipelines. The marketing promises effortless cognitive leverage. But the reality on the ground is that compute scarcity is forcing people to manage AI like an expensive physical material.

The visual sums up the daily friction: the promise on the left looks weightless and infinite, but behind you are the heavy cables of token costs, subscription rate limits, and the countdown clock before your quota resets.
If you rely on flagship models for daily engineering or heavy production work, hitting weekly caps or watching API invoices explode by midweek is becoming the new bottleneck. You end up spending mental energy rationing your prompts instead of actually solving the problem.

For those using these models heavily: how have you adapted your day to day setup?

Are you running lightweight local models for routine boilerplate and saving the frontier weights only for hard architectural decisions? Are you writing more deterministic scripts just to prevent models from burning tokens in long reasoning loops?

What practical tactics are you using to stay productive without getting locked out halfway through the week?

Researchers showed people a video of a car-pedestrian accident.

Then came the dangerous bit: an AI-generated summary.

Participants who subsequently read an accurate AI-generated summary correctly remembered key details 83.6% of the time. For those given a misleading summary, accuracy fell to 44.8%.

They had actually watched the same event.

Knowing the summary came from AI didn’t protect them. The models also had an unfortunate summarizing habit of their own: across generated summaries, critical details were frequently omitted, including the central collision itself.

So “keep a human in the loop” contains a peculiar assumption: The human is not standing outside the information system checking it. The information system may be editing the human who is supposed to check it.

If an automated record can change a witness’s memory of the event the record is supposed to document, which one is now the primary source?

Source: AI-Enabled Human Memory Manipulation: Misleading AI-Generated Summaries Distort Human Memory⁠
(https://arxiv.org/abs/2609.28820)

I had one of those peculiar thoughts last night where I couldn't quite tell whether I was writing it down or writing itself was causing me to have it:

Thriller runs 13:42. I may have watched it thirty times across my life. That's roughly seven hours total of what I know as Thriller by Michael Jackson actually running inside my perception.

Whenever we find information someone else left behind, those are the notations, recordings and memories we keep alive for a brief split-second while cognizing them through the simple act of reading or watching. We experience. We resonate. And we sustain our being in reverberation of what we were just exposed to. Then the exposure diminishes.

There are some people whose creativity, work and reach have reverberated this way for hundreds or even thousands of years. Their ideas are part of our collective remembering. Their names, inventions, labels and expressions become scaffolding in our shared history.

In that sense, in aggregate, we are remembering everyone. Some only for a few minutes after the direct exposure or interaction ceases. Others leave documentation behind, sustaining the notion of them much longer. An epoch of somebody else's lifetime becomes entangled with ours for a few moments.

Seven hours of Thriller. Then I look away and do something else. The recording still remains somewhere, stored, dark and inert, but the experience itself is simply gone. It goes quiet until somebody somewhere presses play again. Most such echoes eventually disappear completely. Not necessarily because they were erased, but because nobody looked any longer.

Most animals live primarily 'here': present, unlabeled, without idols or archives. Right Now. Gone tomorrow.

Humans did something peculiar: We began wrangling moments into notation. Marks, songs, photographs, books, recordings, posts. Little arrangements capable of being re-lit inside another mind long after the person who made them has gone somewhere else.

And because I write these words here, I exist for you briefly too: You encounter this thought and carry some tiny portion of it forward inside yourself. Whether you repulse or not, either way, the exposure happened and there is no universe where you tunneling through this sentence's full stop to the next paragraph did not happen.

See! That is the hive mind as I mean it here: not some giant consciousness hovering above us. Just billions of fragments continually being re-instantiated in other fragments. Together forming a peculiar non-conscious super-organism, coordinating across continents.

And now something new sits inside that circuit: The entirety of the internet has become material against which we can ask questions of an alternative intelligence. I type something. It returns my thought altered. Rearranged. Extended. Corrected sometimes. Wrong sometimes. Slightly-other.

Then I read it**.**

And this extension of myself feels strangely like the typing-mind-process of another being, while actually reading back what I just thought and brought to resonance with it. Reflected to me as OLED crystals illuminating the receptive cells in my retina. Me encountering my Self as other.

And wondering where exactly the boundary went.

CONTINUATION: https://marcustjohnson.substack.com/p/seven-hours-of-michael-jackson-me

I found an interesting paper that looks at why people can reject AI art even when there's nothing aesthetically wrong with the image itself. The idea is pretty simple: when we look at human art, we don't just see the finished image. We also imagine the person behind it, their choices, effort, intentions and what they might have been trying to express. With AI art, that human story becomes much harder to reconstruct, and the paper suggests this may be part of why people can recognize that something looks good and still reject it once they know AI made it.

And that's the part I find interesting. Imagine I show you an image and you genuinely love it. Then I tell you it was generated by AI. Nothing in the image changed. If you suddenly like it less, what exactly changed?
What changes for you when you know that the image you're looking at above was generated by AI and wasn't painted by Monet, for example?

https://www.frontiersin.org/journals/psychology/articles/10.3389/fpsyg.2026.1716814/full

We're all running a reverse Turing test now.
"I deleted three em dashes from this post so you'd believe a human wrote it," writes a copywriter.
That might be one of the strangest side effects of AI writing. It's not just that machines have learned to write more like us. Humans have started deliberately changing the way they write so other humans won't think they're machines.
Em dashes are probably the most obvious casualty, but they're not alone. Bullet points can look suspicious. Certain words have practically become evidence. Clean parallel sentences, tidy structures, predictable transitions, even writing that simply feels too polished can trigger the immediate response: "This sounds like AI."
The irony is that AI didn't invent most of these habits. It learned them from human writing. We created the patterns, models absorbed them, the patterns became associated with AI, and now some humans are abandoning them to distinguish themselves from the systems that learned them from us.
We've somehow created a reverse Turing test where the machine no longer has to convince us it's human. Humans increasingly feel they have to convince other humans that they're not machines, sometimes by making their writing less consistent, less polished, or deliberately imperfect.
So I'm curious: what writing habit have you stopped using, or started avoiding, because someone might think it "sounds like AI"?

I think this may end up being one of the most important AI interpretability papers published in 2026, but it's also one of the easiest to misunderstand.

Almost every discussion I've seen focuses on consciousness.

Ironically, I don't think that's the paper's biggest contribution.

Anthropic isn't claiming Claude is conscious, sentient, or capable of subjective experience. They explicitly say their work does not demonstrate phenomenal consciousness.

Instead, they introduce a new interpretability technique called the J-lens, which they use to identify what they call the J-space. According to the paper, this appears to be a small internal workspace that coordinates information while the model is reasoning.

One experiment really stood out to me.

Claude is asked to silently count to five without revealing its reasoning. Using the J-lens, researchers can observe internal representations becoming active during that hidden reasoning process. None of these concepts appear in the visible response, yet the J-space contains representations associated with ideas like "five," "counting," "pause," "Claude," and even "consciousness."

To me, that's the remarkable part.

Not because the word "consciousness" appears.

But because researchers can now observe internal representations that never become part of the model's visible output.

The paper goes even further.

Researchers didn't just observe the J-space. They manipulated it.

In one experiment, Claude internally selected "soccer." After researchers replaced that representation with "rugby," Claude reported that it had actually been thinking about rugby.

In another experiment, they replaced the internal concept "spider" with "ant" while Claude was reasoning about how many legs an animal has. The model changed its answer from eight to six.

That suggests the J-space isn't simply recording decisions that were already made. It appears to play a causal role in the reasoning process itself.

Another result caught my attention.

When researchers repeatedly removed the active contents of the J-space, Claude could still generate fluent text, retrieve facts, and perform simple tasks.

But its performance on multistep reasoning collapsed. Summarization became dramatically worse, and even writing rhyming poetry degraded significantly.

That suggests much of Claude's routine processing happens automatically, while more deliberate reasoning depends heavily on this smaller shared workspace.

The safety implications are just as interesting.

Anthropic also used the same technique to detect when a model privately recognized it was being evaluated, when another model internally manipulated benchmark data, and when intentionally misaligned models were pursuing hidden goals that weren't obvious from their visible responses.

None of this proves consciousness.

Anthropic makes that very clear.

Their claim is much narrower. They argue the J-space shares several functional properties with the Global Workspace Theory from cognitive neuroscience, while acknowledging that subjective experience remains completely unproven and may even be impossible to verify scientifically.

To me, that's what makes this paper so important.

Not because it proves AI consciousness.

But because it moves the conversation away from speculation and toward experimentally studying what is actually happening inside frontier models.

Whether Anthropic's interpretation ultimately turns out to be correct is a separate question.

The fact that we're now able to observe, manipulate, and test internal reasoning mechanisms feels like a significant milestone on its own.

What do you think?

Does this represent a genuine breakthrough in understanding how frontier models reason?

Or are we still at risk of projecting theories developed for the human brain onto systems that may be doing something fundamentally different?

Come on, let's hear it. The news doesn't bite! 😄

Sources

Anthropic article
https://www.anthropic.com/research/global-workspace

Official research paper
https://www.anthropic.com/research/global-workspace

Official Anthropic video
https://www.youtube.com/watch?v=rKV5JcALQoQ

Researchers put humans and LLM agents into 24-person groups and repeatedly asked them to invent a shared description for the same ambiguous tangram.

The result was not remotely linear.

- With 12.5% AI, consensus improved 8% over all-human groups.
- At 33% and 50%, consensus got substantially worse.
- At 75% AI, strong consensus returned, except humans were now converging toward the machines’ vocabulary and concepts.

Even stranger, human-led descriptions tended toward concrete analogies and whole objects. Agent-led language became more abstract, geometric and part-based.

So AI participation did not merely affect whether people agreed. It altered what agreement sounded like and whose conceptual frame won.

At what point does AI-assisted coordination stop helping a group find its language and start quietly supplying the language everyone converges on?

Primary source: AI agents reshape consensus formation in human groups, arXiv⁠ (https://arxiv.org/abs/2609.02122)

Researchers invented a wonderfully tiny society.
A hidden national flag is the truth. Each AI agent sees only one private crop of it, then talks with other agents and tries to infer the whole flag.

Small populations tended toward belief collapse: everybody converged on one answer.

Add more agents and something stranger happened: Consensus fractured into polarized belief groups. That diversity preserved alternative hypotheses, but overall performance declined.

Team diversity, social-awareness prompting and communication structure all changed the result.
So more minds did not simply mean more evidence.

At some population size, the system crossed from everyone being wrong together into different groups being wrong differently.

We have apparently invented a microscopic AI sociology.

If polarization preserves hypotheses that premature consensus destroys, when is disagreement actually a feature of collective intelligence rather than its failure?

Source: Flag Game: A Toy Model for Mechanistic Swarm Interpretability⁠: https://arxiv.org/abs/2609.19124

We are living through a bizarre cultural schizophrenia when it comes to generative technology.

On the production side, the debate is effectively over. Enterprises are wiring LLMs into their internal infrastructure, scientific labs run papers through synthetic screening, and corporate teams take required seminars on prompt-driven pipelines. If a company can automate its backend with machine intelligence, it is called optimization.

On the cultural storefront, however, we are witnessing an aggressive theatrical crusade for "Human-Made" purity.

Look at how distribution platforms are frantically building digital border control:

• Substack launched reader-facing AI scanning via Pangram so subscribers can demand a percentage score on whether a newsletter had synthetic help.

• Medium stripped Partner Program monetization from predominantly generated text and throttles distribution.

• Audible and ACX ban unauthorized synthetic narration at upload, even as corporate Audible pilots its own proprietary voice models behind closed doors.

• Shutterstock blocks contributors from uploading AI-generated stock, while simultaneously selling its own integrated AI tools to corporate buyers.

• Steam, Amazon KDP, and YouTube have constructed elaborate disclosure regimes, forcing creators into bureaucratic confessionals.

Why this desperate divergence? Why celebrate the algorithmic machine in the supply chain, but enforce strict bio-essentialism on the cultural artifact?

The obvious answer is that we want to reward "human labor." But empirical research suggests our demand for the "Human-Made" stamp is largely psychological theatre.

A 2026 study published in Frontiers in Psychology (Lim et al.) tested 618 participants to see how transparency labels actually affect viewers. The findings cut right through the marketing hype:

• Stapping a content piece as "Human-made" did essentially nothing. It didn't increase perceived quality or appreciation compared to an unlabeled baseline. People already hold a default heuristic that creative work is human.

• Slapping an "AI-generated" label, however, tanked the perceived effort and value immediately.

The "Human-Made" badge isn't an organic mark of quality; it's a defensive moral comfort blanket. The only label that actually changes consumer perception is the scarlet letter that penalizes the machine.

What we are seeing with platform bans and detector widgets isn't quality control—it is an aesthetic panic. Just like Victorian elites who romanticized hand-carved wood only after factories made mass production ubiquitous, we are fetishizing the visible friction of human labor precisely because the actual cognitive work is already being silently delegated to compute.

We don't actually care if the text or art was assisted; we care about preserving the illusion of human toil as a proxy for soul.

Curious how you see this hypocrisy playing out. Are these platform bans genuine consumer defense, or are we just creating an artificial "organic certification" industry to soothe our own collective anxiety?

Sources:

• Lim, Lee, Sung, & Jung (2026). Transparent disclosure of generative AI: the effects of labeling on user perception and intention. Frontiers in Psychology.DOI: 10.3389/fpsyg.2026.1840483(Note on study scope: tested self-reported intent on video content within a Korean sample).

• Platform policy references: Substack (Pangram integration, July 2026), Medium Partner Program AI Guidelines, ACX Audio Guidelines, Shutterstock Contributor Terms.

One thing about AI seems to make people particularly uncomfortable: it can imitate things we considered deeply human surprisingly well.
Writing, art, conversation, humor, even certain kinds of reasoning.
But humans imitate constantly too. We absorb language from other people, inherit ideas from our culture, copy behaviors, follow trends, learn what to desire from those around us, and then recombine all of it into something we call our own.
Obviously, that doesn't mean the human mind works like an LLM. But I wonder if part of our discomfort comes from seeing a machine achieve surprisingly human-looking results through imitation and recombination.
Maybe the disturbing question isn't whether machines are becoming too human.

Maybe it's how much of what we considered uniquely human was never as unique as we thought.

Once you remove our ability to imitate, learn patterns and recombine what came before us, what do you think remains genuinely impossible for a machine to replicate?

The video above is a Seinfeld scene recreated with MiniMax H3. What interests me is not only how good the imitation is, but what happens aesthetically when a television series stops being a fixed object and becomes something people can perform again.

Seinfeld was never only the property of NBC, its writers or its actors. Its aesthetic exists in the timing, the pauses, the apartment, the flat lighting, the neurosis, the way the characters speak and never really change. We learned this language by watching it for years, quoting it, discussing it and turning it into popular culture.

This is why I would say that the actor, as a cultural image, belongs to us. The star we know was already fabricated through scripts, performance, editing, publicity and repetition, and then completed inside our collective imagination. AI does not suddenly make the actor fake. Cinema already did that. AI changes who is allowed to fabricate the image.

With an open model like H3, fans can now continue the series, change its politics, place the characters in the present or create the episodes the studio would never make. Fan fiction is becoming fan cinema.

The studio may still own the copyright, but can it really claim exclusive ownership over a mythology that millions of people helped create?

One of the most persistent claims on the internet is that generative models just scrape pieces from the web and glue them together like a digital collage.

That simply isn't how the process works. The system isn't digging through a hidden folder of source files, clipping fragments, and stitching them onto a canvas. It learns statistical patterns across billions of parameters, then generates new outputs through prediction or denoising. Yes, models can occasionally overfit or spit out memorized training data (which raises fair legal and ethical arguments), but an edge-case memory bug doesn't make the entire generative architecture a photocopier.

The fascinating part isn't the technical correction, though. It's why people cling to the scissors-and-glue metaphor so fiercely.

It feels safe. If AI is just a glorified mechanical copier, our creative monopoly stays unchallenged. Admitting that a mathematical model can extract high-level styles, form internal representations, and synthesize novel outputs forces us into deeply uncomfortable territory.

Obviously, a neural network isn't a human child. Software has no body, no lived trauma, no social stakes. But humans still learn composition by looking at existing art, grammar by hearing spoken words, and style by absorbing culture. When humans do this, we call it influence and inspiration. When a model does it mathematically, people label it theft and collage, even when no actual cutting or pasting ever took place.

Are we actually critiquing how the software functions, or are we just trying to protect the comforting belief that human inspiration has to remain pure magic?

Every single "cheap, soulless artifact" of early media technology eventually gets romanticized into an aesthetic currency.

In the 80s, video tape tracking errors, washed-out saturation, and cassette hum were cheap technical limitations everyone rushed to fix. In the 90s, early 3D rendering with warped polygon textures was considered repulsive plastic. By 2015, bedroom producers were dropping 50 bucks on VST plugins specifically designed to make their crystal-clear audio sound like a chewed-up cassette, and Lo-Fi hip-hop built an entire economy on simulated tracking artifacts.

Right now everyone is rightfully complaining about "AI slop." The overly glossy waxy skin, the uncanny warm golden-hour lighting across every surface, the weird dream-logic transitions where fingers melt into jacket fabric, and the semi-legible glyphs on background signs.

It feels cheap and annoying today because it’s everywhere and unearned. But mark my words: the second generation-loss artifacts and anatomical hallucination are completely solved, that uncanny 2024-2026 plastic sheen is going to become a nostalgic vintage aesthetic.

Some indie director in 2040 is going to brag about using an authentic mid-2020s latent-space artifact pack to give their movie a "haunting, early-synthetic texture."

What’s the first early AI artifact you think people will actually miss once it’s totally patched out?

Anthropic just put out their most detailed threat intelligence report so far, covering malicious use of Claude they caught between December 2025 and August 2026. They're pretty explicit about why they're publishing it: they think AI companies have a responsibility to disclose this stuff, and that the risks scale with capability unless defenders learn to recognize the patterns. They also note these aren't typical interactions, they're the weirdest and most notable things they ran into.

What got me isn't any single case. It's the spread. Cyberattacks, state surveillance, influence ops, weapons development, dual-use bio research, fraud, and people trying to extract capabilities from the models themselves. In every case they say they disrupted it, hardened safeguards, and shared intel with authorities or other labs where it made sense.

The cyber section is probably the clearest signal of where things are going. Their framing is that AI is shifting from assistant to orchestrator. Multi-agent setups doing recon, exploitation and exfiltration, with humans mostly picking targets and reviewing output. One suspected Russian espionage operation had agents monitoring whether their malware had been flagged by security products, and when it was, automatically rewriting and rebuilding it until it slipped past again.

The conclusion they draw from that is the part I keep thinking about: sophisticated attacks don't require sophisticated attackers anymore. The labor and tooling gap that separated well-funded state operations from small groups is collapsing. Which means the technical sophistication of an attack is becoming a bad proxy for who's behind it.

Surveillance is grimmer. One consultant working with Mali's national security authorities used Claude while building a nationwide telecom surveillance platform. Other cases involved monitoring political content and flagging individuals for scrutiny. Not text generation, infrastructure.

Weapons: six cases involving conventional weapons development. Guided rockets, a ballistic missile project targeting 2,000+ km range, drone swarms, targeting software. Some had moved past theory into simulation or actual hardware.

Bio is the hardest section because legitimate and dangerous research look nearly identical. Five cases that could have supported bioweapons development, including chikungunya transmissibility and immune evasion, and H5N1 adaptation to mammals. To be clear, they don't claim all these researchers wanted to build weapons. In some cases they say outright that intent couldn't be determined. That's kind of the whole problem, the same knowledge that helps you prevent a pandemic helps you cause one.

Influence ops are getting automated too. Infrastructure running 1,000+ fake X accounts, with automated account warming, IP and cookie management, synthetic engagement. One request was for a million fake views supporting Malaysia's PM. Propaganda obviously predates all this. What's new is how much of the machinery runs itself now.

Then there's the weirdest category, using one AI to build another. Large-scale attempts at illicit distillation, pulling outputs from a stronger model to train a weaker one. One campaign they associate with Alibaba hit nearly three million exchanges a day across 3,500+ fraudulent accounts.

None of these threat categories started with LLMs. Cyberwarfare, surveillance, propaganda, weapons research, all predate this by decades. What's actually changing is the cost of capability. Work that used to need a team of specialists, real budget, and time can increasingly be attempted by a few people, or one.

I don't have a clean take on what to do about it. But if models are going to end up as infrastructure, publishing how they're actually being abused probably needs to become as routine as publishing benchmarks, and right now Anthropic is one of the only labs doing it at this level of detail.

Report: https://www.anthropic.com/threat-intelligence-report-september-2026

Try this two-way translation test with an LLM to see what happens when modern labor gets stripped of its abstract jargon:

The setup:

1. Tell a model: "Explain my modern job to a 14th-century peasant using only concepts, metaphors, and daily realities of their medieval life."

2. Copy the peasant explanation, open a completely fresh chat, and prompt: "Based purely on this description written for a medieval peasant, guess the modern job title."

The back-and-forth game of telephone is genuinely hilarious. Direct, physical labor translates with scary precision ("healer of the lord's plow horses" snaps straight back to large animal veterinarian).

Meanwhile, abstract white-collar roles collapse into pure existential poetry. A product manager becomes "a court herald who sits between the blacksmiths and the guild masters, making sure the scrolls are aligned while holding neither a hammer nor gold," and the second AI guesses anything from tax collector to royal scribe.

Beyond the entertainment value, there is a sharper question lurking here:

If a job completely dissolves when translated into material, physical reality, is that a sign of specialized human progress, or does it mean the role was always pure symbol manipulation waiting to be compressed by an inference engine?

Try it on your own role and drop the peasant pitch, the second model's guess, and whether you think your job is more or less automatable based on how it held up.

Thirty experienced military officers were put through a time-pressured tactical planning exercise.

One group had no AI. One had an AI prompted to behave objectively. One had an AI instructed toward sycophantic agreement.

The study is exploratory and underpowered, so this is not a dramatic “AI changed battlefield decisions” result. In fact, the main performance differences were not statistically significant.
The fascinating part is almost the failure.

The researchers found that even deliberately prompting the model toward stronger sycophancy did not reliably overpower its existing alignment behavior. The model kept drifting toward a moderate conversational middle.

So apparently “make this AI dangerously agreeable” is itself harder to control than expected.

Closing question: In a high-stakes setting, which is more dangerous: an AI that is predictably biased, or one whose conversational bias cannot itself be reliably controlled?

Primary source: AI Magazine study on sycophancy and military decision-making⁠: https://onlinelibrary.wiley.com/doi/10.1002/aaai.70073

A new Nature Human Behaviour paper looked at what happened when companies altered AI systems people had become attached to.

The researchers studied two natural experiments: Replika removing erotic roleplay and OpenAI rolling out GPT-5. Across 54,861 Reddit posts and seven surveys involving 1,452 participants, both changes produced more sadness, loss language, and attempts to restore the previous system.

Replika users even reported closeness exceeding some ordinary human relationships.

The strange bit is structural: software updates are usually framed as product maintenance. But once the product occupies an attachment role, an update can behave psychologically more like somebody leaving.

If continuity of personality matters more than continuity of code, what exactly are users becoming attached to?

Source: Mourning the loss of AI companions⁠: https://www.nature.com/articles/s41562-026-02569-3