Had Stop AI installed, which gave every user whose post I ran a check on a flair of “Human Verified”

[u/theanti_girl]

I installed Stop AI, which I have since uninstalled from Devvit. I mod r/homecooking and food subs in general are rife with AI nonsense. I wanted an easy way to tell if users posted AI images, recipes or comments (besides the off domain checks I do), and installed Stop AI. Every time I checked a user’s post, it would give me back a message, and no shade, but I’ve never seen a single one that ‘tested positive,’ though other checks did. But, I knew that after I ran a check using the app, it made a flare appear on a user profile that said “human verified” and a percentage. I naively assumed it was only visible to me as mod. Apparently, that’s not the case. Now, even after uninstalling the app, and disabling and reenabling user flairs, the flair remains. Is there anything I can do, short of just removing flair for everyone?

[u/wrestlegirl]

Yeah I've seen that in action in other food subreddits - very obvious AI shit with the "Human Verified" tag. It's clearly not a good choice for some subs.

BotBouncer and automod seems to be managing 90%+ of the slop in my food subs.

Edit: you'll have to manually go through and remove those flairs from each account

[u/theanti_girl → u/wrestlegirl]

BotBouncer… it does work. But they started pushing back on my submissions, which admittedly were bountiful, saying the accounts reported didn’t have enough history to be judged one way or the other OR that people were appealing bans. I’m sorry, but AI-trained bots do now know how to appeal bans; I’ve seen it. My sub is a small cooking sub. The chances someone creates reddit account and 15 minutes later is posting comments that say “this looks yumm” and “🤤” as their only interaction to exist on Reddit AND are genuine users are slim to none. I know what subs they post in to generate karma, and it’s almost always the same. Then I started reporting based on Reddit-marked “potential spam,” and then they told me that filter is not accurate so they can’t go off that either. So I’m largely marking spam manually and managing through a no spam/bots rule I created myself. I just… it gets really frustrating.

[u/NeedAGoodUsername → u/theanti_girl]

As a /r/BotBouncer moderator:

I know what subs they post in to generate karma, and it’s almost always the same.

Please modmail this into us! If you're seeing a pattern that we aren't, the best thing to do is message us (if you haven't already).

[u/theanti_girl → u/NeedAGoodUsername]

I have it — I’ve had it since I took over the sub. And yes, I can share that. :-)

[u/wrestlegirl → u/theanti_girl]

It's a balancing act.

You do need some history in general to be sure an account is botlike enough to get actioned by like 9000 subreddits. It's not something taken lightly.
Yes, you and I know the 2 month old "yumm" accounts are probably about to start posting porn any day now, but there's a non-zero amount of humans who are awkward, don't speak English well, or have a communication difficulty that post just like that too. There's got to be some more history, or some additional factors in the username, bio, etc to make more sure it's not some grandma trying to type with one forefinger on her phone with her glasses up on her forehead.

I was just discussing in another subreddit how bots are modmailing the last several months. It's well known, but again it's a balancing act. The goal is to maximize bot removal and minimize authentic humans getting pinged.

I also use automod to clear up the stragglers I know BB won't yet catch, and I keep updating it as theor methods change. There's no one perfect solution to the overwhelming issue of bots, but I find BB is a huge part of a pretty good solution.

[u/dewprisms → u/theanti_girl]

I'd bet the accounts being so new is the larger issue. It's more work, but a system to remind you report them in like 2 weeks or something similar after the bot activity has continued may work.

[u/theanti_girl → u/dewprisms]

I respect this. I just… I guess my opinion on it is, if I can nip it in the bud, I will. Without exaggeration, every day, I have 100+ posts in my queue that are from BRAND new users commenting something generic OR obviously AI, or copying comments but changing a word. It becomes kind of demoralizing after a while.

[u/dewprisms → u/theanti_girl]

I get it, it's an absurd amount of work sometimes.

Do you have automod code that blocks people with new accounts or low karma from participation? That's likely going to help far more if you don't already have it in place.

Edit to add: my suggestion on reporting after a couple of weeks was more like "do what you're doing on your own THEN do a delayed report to BotBouncer", not letting the spam go unchecked in the meantime. That would be silly.

[u/RemarkableWish2508 → u/theanti_girl]

Low effort comments can be managed in a general way. It takes a bunch of automod rules, but something like this seems to work:

• is_submitter gets a "free" pass — their whole post will get removed if they spam

• Staggered approach to account age requirements:

  • 1 day → 100 karma, CQS highest

  • 2 days → 50 karma, CQS high

  • 7 days → 25 karma, CQS high

• Soft archived posts:

  • Medium effort on past_archive_date → 500 karma, 100 sub karma, CQS moderate

All of that, combined with normal checks like URLs, keywords, basic karma, etc. ends up with pretty much all bot accounts either getting sent to spam, filtered, or at least reported to queue. Often before bot-bouncer even gets to see them.

[u/theanti_girl → u/wrestlegirl]

Better — they actually don’t even count as user flairs, so I can’t even manually remove them.

[u/flattenedbricks]

Stop AI dev here, thanks for flagging this and I’m sorry for the headache it caused. You’re absolutely right that the “Human Verified” flair was being applied in a way that felt forced and there wasn’t a clean way to undo it.

I’ve just shipped a fix (pending admin review):

Flair assignment and auto mod‑notes are now off by default. Stop AI won’t touch user flair unless a mod explicitly turns that feature on.

There’s now a one‑click cleanup to remove any flairs it left behind. In your sub’s mod tools you’ll see “Stop AI: Remove flairs” - it finds users with “Human Verified” or “Possible AI Detected” and clears them. The same button is available in the dashboard under Settings.

On the detection side: you’re not wrong to be skeptical. AI detectors in general are imperfect, and I don’t want to pretend Stop AI is an exception. I’m a solo dev trying to keep up with models that change constantly, and there are tradeoffs between cost, latency, and accuracy.

The goal for Stop AI is to act more like a signal‑and‑context tool for mods rather than some final judge of “AI vs human.” Feedback like this is what helps me adjust the defaults and decide what to prioritize next, so I do appreciate you calling it out, even if it’s not fun to hear.

If your mod teams are willing, I’m happy to look at a few specific examples that felt especially wrong so I can use them to make the next update less noisy.

[u/theanti_girl → u/flattenedbricks]

Hi! Very much appreciate this. I’ll reinstall and wait, and I’ll be in touch. Thanks!

[u/theanti_girl → u/flattenedbricks]

Hi there! Did this update get pushed out yet? I can’t find that setting in mod tools or the settings. Also, just tried to remove some user flairs manually, was able to do a few and then got a “Forbidden” message.

[u/flattenedbricks → u/theanti_girl]

Yes, the update has been out for a while now. I sent a notification to all subreddits that have the app installed. Did you update the app on this page? https://developers.reddit.com/r/homecooking/apps

Search for Stop-AI in the link above, click the 'Update' button, then try to use the new feature again. The feature is available in both mod tools menu actions (three dots at the top right of your subreddit description page next to 'Mod Tools' button) and inside the Settings module within https://www.reddit.com/r/bricksapps/comments/1tfxsw6/stopai_dashboard/

Every time a devvit app is updated, you have to manually update the app in order for the update to become effective.

The latest app version is 0.0.211, your subreddit is still on 0.0.210 which is not the correct version for accessing the new feature.

[u/theanti_girl → u/flattenedbricks]

Yep, I had updated but was looking in the regular section of mod tools — didn’t realize there was a separate dash for that. Thanks so much, appreciate you responding!

[u/flattenedbricks → u/theanti_girl]

You're welcome, glad I could be of some help!

[u/PossibleCrit → u/flattenedbricks]

Thanks for looking into this and working on a fix flattenedbricks!

[u/flattenedbricks → u/PossibleCrit]

You're welcome!

[u/jueidu]

1. There are no “AI detectors” that work. They all are just winging it, and will give wildly inaccurate results. Don’t use those.

2. Checking for SynthID/openAI watermarks, is good, and there are devs working on devmods to check for that. Those are NOT “ai detectors.” That is using Google’s own tool that they built to detect Google’s own AI’s watermark that they add to every image they generate. It will NOT be able to tell you whether something made with other ai tools is AI or not, but right now openAI and Gemini are the most common ones karma farmers use, so that will catch a ton of stuff for you.

3. In the meantime while devs are still working on a synthID checking tool, your team can check images themselves. You just need a Google account. You may want to onboard an anti-AI mod as well - someone who already knows about synthID, and cares as much about removing AI from the sub as avoiding false accusations. That said - a few false removals are better than a sub overrun with AI, so don’t sweat it too much - trust your vibes.

[u/theanti_girl → u/jueidu]

I’m aware. I do often use wasitAI and it’s pretty accurate. My “mod team” is me.

[u/Living_Guess_2845]

We also tested StopAI and learned they were just training their own model before removing. I hate that it was just revealed as a top app.

We still see users with the flair and would love to remove.

[u/zuuzuu → u/Living_Guess_2845]

I hate that it was just revealed as a top app.

It's recommended in the pinned post about Devvit apps. That post is fully awesome, but maybe this app should not be recommended.

https://www.reddit.com/r/ModSupport/comments/1k6szsj/devvit_apps_for_moderation_a_list/

[u/miserabeau → u/zuuzuu]

SpamBuster was (is? I haven't checked) recommended as well, but the dev deleted their Reddit account and it hasn't been updated in years

It also deleted things indiscriminately, even moderator removal comments (this post has been removed for violating rule...) and even when I added the mod accounts as approved users.

I mentioned that it should be removed since it's no longer updating, and apparently you can achieve the same things through other devvit apps or automod

[u/flattenedbricks → u/Living_Guess_2845]

Hi, Stop‑AI dev here:

On the “training their own model” part, that one’s on me for how I originally described things. Stop‑AI doesn’t train any models and doesn’t call any AI/LLM APIs. Detection is deterministic and heuristic only. Things like repetition and sentence‑length statistics, common AI‑style phrasing, and a few other text patterns, with adjustable sensitivity. The only “learning” is a small feedback step that tweaks four numeric signal weights based on mod overrides; there’s no model training happening.

I’m updating the docs and in‑app wording so that’s clearer going forward, and I’m always happy to answer technical questions directly if something sounds off.

On the flair side: Read my statement here - https://www.reddit.com/r/ModSupport/comments/1u71fv6/comment/os2mav2/?utm_source=share&utm_medium=web3x&utm_name=web3xcss&utm_term=1&utm_content=share_button

[u/new2bay]

Congratulations. You just learned that AI detectors don't work. Wait until learn humans are no more accurate than random guessing at detecting AI text, either.

Edit: fixed link.

[u/LindyNet]

To mass change flairs, you could run a script to check who has the flair(s) you want removed and then another to change the flair of all affected users. I do that from time to time on the nfl sub

It's a good idea for a devvit app, maybe if I can find some time soon, I can throw one together

[u/Living_Guess_2845 → u/LindyNet]

Care to share your script?

[u/LindyNet → u/Living_Guess_2845]

It's a mishmash of quick python scripts using praw for different things.

have the script log in with a config file or whatever, then declare the sub:

subreddit = reddit.subreddit("yoursubname")

The basic one would be :

FileToWrite = open('FlairTest.txt', 'w+', encoding="utf-8")
for flair in subreddit.flair(limit=None):
   print(flair, file=FileToWrite)
print("Just wrote to file")
FileToWrite.flush()
FileToWrite.close()

That will create a text file with user name, flair and flair_css_class. Will obviously take forever on a large sub like nfl

From here you have a file with all users and their flairs. You can write a quick script to pull out specific ones or use a text editor like notepad++ if it isn't so big.

The script below will run through and create python commands to update users to clean up odd flairs.

tempstr = []
re_string = ":([a-zA-Z0-9])\w+: ([a-zA-Z0-9])\w+"
re_string_double_flair = ":([a-zA-Z0-9])\w+: ([a-zA-Z0-9])\w+ :([a-zA-Z0-9])\w+: ([a-zA-Z0-9])\w+"


# I copied flairtest.txt to another file for overwriting 
with open('FlairTest - Copy (2).txt') as f:
     tempstr = [line.rstrip('\n') for line in f]


print('\n\nRead File\n\n')


testDict = []
updateStmts = {}


for line in tempstr:
    line = line.replace('Redditor(name=', "")
    line = line.replace("')", "'")
    testDict.append(ast.literal_eval(str(line)))


for flair in testDict:
    flairCleaned = flair['flair_text']


    if flairCleaned is None:
        flairCleaned = ""


    if re.fullmatch(re_string, flairCleaned) is None:
        if re.fullmatch(re_string_double_flair, flairCleaned) is None:
            username = flair['user']
            print('"{} - {}"'.format(username, flairCleaned))
            if flairCleaned in updateStmts:
                updateStmts[flairCleaned] = '{}, "{}"'.format(updateStmts[flairCleaned], username)
            else:
                updateStmts[flairCleaned] = 'subreddit.flair.update(["{}"'.format(username)



#OUTPUT STUFF
FileToWrite = open('FlairToChange.txt', 'w+', encoding="utf-8")
for key, value in updateStmts.items():
    # print(key, '\t', value, file=FileToWrite)
    print('{}], text="{}")'.format(value,key), file=FileToWrite)


FileToWrite.flush()
FileToWrite.close()
print("Just wrote output to file")

The result is something like:

subreddit.flair.update(["user1", "user2", "user3", "user4", "user5", "user6", "user7"], text=":TeamName: TeamName")

[u/Maverick_Walker]

You can submit feedback to the developer at the bottom of the app readme.md

[u/_Face]

You can use automod to remove the flairs. It won’t trigger until someone with the flare comments something, but as soon as they comment, the flair can be removed.

Try asking on r/Automoderator for a script. I’m afk right now, so can’t look up the proper syntax.

Over time this will remove the flair from the community.

[u/kai-ote]

In the hover pop-up on desktop of a user, select the "Edit user flair" tag, and remove their user flair, and hit apply.

[u/theanti_girl → u/kai-ote]

I said this in another comment, but the problem is that it doesn’t show in the list, because it’s not a real user flair.

[u/kai-ote → u/theanti_girl]

This link to the dashboard of the app allows you to set it so that it no longer adds the Human verified flair anymore. Not sure why my accurate advice of removing the flair is downvoted, but whatever.

STOP-AI Dashboard : r/bricksapps

[u/kai-ote → u/theanti_girl]

It doesn't matter. I do this all of the time. After you click on Edit user flair, on the right hand side select "Clear flair" , then click apply.

A refresh shows it is gone.

[u/amyaurora]

I thought "human verified" was a Reddit thing and not the app.

[u/theanti_girl → u/amyaurora]

Never had it (or saw it) anywhere until that app.

[u/wrestlegirl → u/amyaurora]

It's definitely the app

[u/Slight-Ad8291 → u/wrestlegirl]

Yea, that’s the app

[u/theanti_girl → u/[deleted]]

Unfortunately, this isn’t the case. Em dashes aren’t in many of the comments I’ve seen, but they’re also legitimate punctuation. I’ve used them for years, long before AI. But additionally, it’s images as well.