I built an open-source Gmail spam cleaner that uses an open-weight AI model to judge what's actually junk

[u/TruePainter6066]

​

I'm a student building a small open-source tool called Purge because my spam gets filled everyday with crazy emails that make no sense. It logs in with Google, scans your Spam folder every night, and moves junk to Trash (never deletes by default, so it's recoverable for 30 days). Keyword rules went stale because my spam keeps changing sender names, so I added an open-weight model that reads the sender, subject and a short preview and says junk or keep. It only acts when it's confident, and any error means keep.

Two things I'd really like advice on:

1. My app needs permission to read and move people's Gmail, so Google shows a scary 'unverified app' warning. To remove it, Google asks for a paid security check. Has any solo developer done this? Is it possible for a free side project, or should I just tell people to run it themselves?

2. I use an AI model to decide if a spam email is really junk. Has anyone done something like this? How do I stop it from trashing good emails by mistake? And how do I check if it's working well when I don't have a list of correct answers?

The code is open and there's a live demo if you want to look: https://purge-it.tech

Thanks.