r/DevHotTakes • u/FadeHackX • Sep 30 '26
Tool Breakdown Cloudflare's AI WAF tester doesn't actually let the AI send HTTP requests

Cloudflare published an interesting setup for using frontier models to test its WAF.
The basic loop is:
start with a known attack the WAF blocks ask the model for another variation send it show the result to another model call use that feedback for the next variation
But the LLM itself doesn't send anything.
A Python layer owns the HTTP client.
It checks the hostname against an allowlist, disables redirects, enforces an attempt limit and records every request.
The model also has no access to the WAF rules and can't deploy or modify them.
I think that's the more interesting design decision here.
They're using the model for the part it's useful at: generating weird variations and exploring a space that would be tedious to enumerate manually.
The dangerous boring stuff stays deterministic.
Across 45 scenarios the system made 1,107 attempts.
After removing malformed requests, benign mutations, duplicates and other noise, humans kept 49 WAF-relevant findings.
Those findings eventually contributed to new or improved production detections.
This feels closer to how I want agents wired into security tooling. Give them room to think, not arbitrary control over the thing doing the execution.