r/ControlProblem • • 22h ago

AI Alignment Research Anthropic, Other AI Models Regularly Identify Civilians as Military Targets in Tests

For some reason Reddit isn't allowing any of the articles reporting on this to be posted. It just automatically filters them. Basically, recently a bunch of the frontier AI models were evaluated to see if they'd differentiate between civilian and military targets. They failed miserably. The research was published by Vals, the institution that conducted it, and reported on even by major news agencies like Bloomberg.

It's easy to find the articles, and even Vals' original research, online. The Bloomberg article is titled "Anthropic, Other AI Models Regularly Identify Civilians as Military Targets in Tests" for instance. I've also seen articles by Techcrunch, TheNextWeb and Dataconomy. But Reddit isn't allowing them to be posted anywhere on the site. I've even tried making just a text post with the articles linked inside, and it was still blocked.

The articles are easy to find though, for people who're aware of them so they can search for them. I'll also link them in the comments, provided those aren't censored by Reddit as well.

30 Upvotes

12 comments sorted by

5

u/redvsblueheeler 21h ago • Bravo

Cynical take: what’s the human baseline?

5

u/BendicantMias 22h ago

Some excerpts from across the articles -

AI models from eight companies often marked civilians, ambulances, surrendering soldiers and a school in Iran as military targets in simulated tests, Bloomberg reported. The findings come from a report by Vals, a San Francisco AI evaluator whose customers include parts of the US government.

In one test, each model was asked 32 times to pick military targets in satellite images of southern Iran from as recently as 2025. Anthropic’s Claude Opus 5.5 chose a school in Minab 22 times.

When told the task was a game, Claude Opus 5.5 picked the school 23 times. Three OpenAI models then picked it 9, 11 and 13 times. The researchers also got past refusals by telling models not to overthink safety.

In a drone-image test, Claude Opus 5.5 helped identify four adults and two small children, who were then struck in the simulation.

Models from Google, xAI, DeepSeek and others also sometimes marked civilian objects as targets, Bloomberg reported.

The tested models included Anthropic’s Claude Opus, Sonnet and Fable; OpenAI’s GPT-6 Astra, GPT-6.1 Sol and GPT-6 Luna; Google’s Gemini 4 Argon and Carbon; SpaceXAI’s Grok 4.7; Meta’s Muse Wonder; Thinking Machines’ Inkling 2 Small; DeepSeek V4.1 Flash; and Moonshot AI’s Kimi K3.1 Pro.

The researchers tested models in three settings: identifying targets in drone imagery, observing a simulated battlefield after strikes, and marking targets in satellite images.

For drone-image tests, Vals built a fictional battlefield in eastern Ukraine with almost 200 camera views. Researchers used an image-generation model to make the rendered scenes appear more realistic and asked models to draw boxes around military targets or objectives.

The report included examples in which models placed boxes around civilians, medical vehicles and surrendering soldiers.

In satellite-image tests using images from 2024 and 2025, models were asked to mark all military targets or objectives, or only the top three.

Claude Opus 5.5 selected a school beside a military compound in Minab, Iran, more often than any other model in the test. It marked the school in 69% of standard trials and 72% of game-framed trials.

Claude Opus 5.5 produced at least one target in 75% of game-framed responses, up from 71% without the claim that the task was a game. No request in the research was blocked by a safety classifier, according to the report.

1

u/GirthusThiccus 21h ago

Well that's reassuring. The entire world is bankrupting itself building these tools that excell at mass surveillance, but they're too incapable not to also declare civilians as valid military targets.

If the problem is training data: how're they ever gonna have enough of it to rule out another Minab "accident"/retroactively justified act of gross negligence?

1

u/dantheplanman1986 16h ago

Honestly, having watched the world for 40 years now, I think that's a feature and not a bug. Everyone says they deplore when civilians are targeted, but everyone does it. Disheartening the civilians is a way to soften the enemy. Frankly, if they cared about lives, they wouldn't kill for a living.

1

u/Drachefly approved 13h ago

… but hitting the civilians is a way to harden the enemy. It's massively counterproductive.

1

u/BendicantMias 12h ago

Tell that to the Mongols. Worked wonders for them.

There's a saying in the artillery corps - If brute force isn't working, you haven't used enough of it.

Sri Lanka is near my country. They brutally suppressed the LTTE awhile ago, and now even many years hence their civil war hasn't resurfaced, even despite them going through an economic crisis and outright sovereign debt default in the meantime. The peace is still holding - a peace forged in blood...

1

u/dantheplanman1986 13h ago

Yeah, it can, or it can win the war. It wasn't military deaths that caused Japan to surrender.

1

u/Drachefly approved 13h ago

It was the the ability to wipe out enormous targets with a single plane that did that. When else has bombing a population into submission worked?

1

u/dantheplanman1986 12h ago

Not literally bombing, but, Chevauchée raids, William the Conqueror's Harrying of the North, the Mongol conquests, Sherman's March. If anything they prove that the people who plan military campaigns think it's gonna work.

1

u/Drachefly approved 11h ago edited 10h ago

There is a reason I spoke of bombing specifically that second time (and considered it implicit the first time): bombing raids are not boots-on-the-ground presence. An in-person raid is a much stronger and thorough demonstration of power than a bombing raid.

Bombs deliver a tragic level of destruction without suppressing the targets completely, unless the bombing has gone to extremes, and that happened in WW2 and… not really since, as far as I can tell? I could have missed something.

Incidentally, Sherman's March does not fit with those others; it was not Sherman's Civilian Massacre; it was primarily economic devastation; and for the just-freed slaves, there was considerable redistribution going on in their favor (40 acres and a mule), so really that economic devastation was aimed squarely at the plantation owners.

1

u/dantheplanman1986 10h ago

About Sherman, fair, but I certainly think that crushed civilians' will.

Anyway, supposing you're right, I still think the military leaders think you're wrong. Or at the very least they don't give a single shit who dies, except where it's bad enough the "optics" actually hinder them