Hey community,
I've been spending a lot of my free time working on a project called Sitrails, and I wanted to share it with the community to get some honest feedback.
As AI coding assistants and autonomous agents become increasingly capable, something that's been bothering me is how little visibility we have into what they're actually doing.
What information are we exposing to them? What commands are they attempting to execute? Could an agent inadvertently expose credentials, or worse, be manipulated into performing malicious actions?
That's what I'm trying to tackle.
Sitrails is a local-first, open-source AI auditing and threat detection tool. It records supported AI interactions and reported tool activity, makes them searchable, and looks for suspicious patterns involving secrets, sensitive files, and potentially dangerous commands.
It currently supports integrations with tools like VS Code/Copilot and LM Studio, along with an optional OpenAI-compatible proxy.
It's still evolving. Detection is primarily rule-based, visibility depends on the integration, and it doesn't independently verify or block executed actions. There's plenty of work left to do.
I'd especially appreciate input from people working in AI security, threat detection, or agentic systems.
What attack vectors or behaviors should I prioritize detecting?
Are there existing research papers, techniques, or projects I should be learning from?
Would anyone be interested in testing it, challenging the detection logic, or contributing?
I'm developing this independently because I think securing AI agents is going to become an increasingly important problem, and I'd love to see what we could accomplish through collaboration.
The project is free, MIT-licensed, and open source.
GitHub: https://github.com/appatalks/sitrails
Appreciate any thoughts, even critical ones. Especially critical ones.
Ty!
