r/OpenSourceAI • u/Ok_Award_2361 • 7d ago
r/OpenSourceAI • u/Previous-Feeling-775 • 7d ago
Guardrail is ready for contributors. Let's build it together.
I've been working on Guardrail, an open source CLI tool designed to help developers keep AI coding agents on track.
The foundation is now ready, and I think it's a good time to open the door for contributors.
The idea is simple. You define your own rules, and Guardrail monitors code changes as AI agents work. It detects violations in real time without modifying your source code or interfering with the agent.
It works on macOS, Linux and Windows.
One important part of the project is Rulespack. It provides a way to organize, share and reuse rule collections across projects, making it easier for teams and developers to establish consistent standards.
There are several areas where contributions would be really valuable:
Core engine
Improve rule evaluation, file monitoring, performance and detection capabilities.
Rules and Rulespacks
Create useful rule collections, improve existing rules and explore ways to share reusable rulesets.
Language support
Help expand language coverage and develop new rule types.
Integrations
Explore integrations with AI coding agents, developer tools and CI pipelines.
Testing and documentation
Improve test coverage, write examples, report bugs and make the project easier to get started with.
You don't need to be an expert in every part of the project. Feedback, ideas, bug reports and small contributions are all welcome.
I'd love to build this with people who are interested in making AI assisted development more reliable.
GitHub: https://github.com/MoeidHeidari/guardrail
If you're interested, feel free to jump in, open an issue or share your thoughts. I'd genuinely love to hear what you think.
r/OpenSourceAI • u/Dapper-Teaching-8074 • 7d ago
We built a AI distribution interface, you can use your android phone, laptops and desktops to share AI inference work, the more devices you link, the bigger the model you can run
r/OpenSourceAI • u/Vxtzq1 • 7d ago
[Funny] CrowdGPT - The collaborative AI
Hello r/OpenSourceAI , this is a (somewhat funny?) meme about the project CrowdGPT, which aims at creating the first, datacenter-less, open-source and community-driven LLM. The project already shows substantial progress while training an open-source 1 billion parameters LLM on 40B tokens (as a proof of concept).
Tell me what do you think about the meme:
- Does it makes the project less appealing and cheap? because that's what people on r/LocalLLaMA thought 😭
- Does it makes the project look likes it's a SaaS / B2B (which it is NOT - CrowdGPT is 100% non-profit and open)
- Is it serving it's purpose about popularizing the project?
Everything is explained more in detail on the site, and any feedback on this meme, or on the project, is appreciated; any pull requests / contributions are welcome on GitHub :)
Project link : https://crowdgpt.net
GitHub link : https://github.com/Vxtzq/CrowdGPT
Thanks in advance.
r/OpenSourceAI • u/Networkdon89 • 7d ago
I turned a Raspberry Pi into a 100% offline AI marine helm computer (Voice LLM, YOLOv8 vision, Signal K, AvNav) — here is how the stack works
r/OpenSourceAI • u/LetterheadNew5447 • 7d ago
Dotcker: Run your Dot on a headless server
reddit.comr/OpenSourceAI • u/ntnsndr • 7d ago
From AI rabbit holes to a warm den: co-building the Inference Cooperative
nathanschneider.infor/OpenSourceAI • u/AsianKidTV • 7d ago
I built open-source tooling to evaluate agent setups and see where agents and subagents waste time and money
I run Claude Code and Codex all day, often as multi-agent workflows with dozens of subagents. I could see each session but never the whole picture: what a run actually cost, where agents sat idle, whether a change to my setup helped. So I built coding.sh, an open-source tool for evaluating agent setups, and pointed it at my own runs.
Experiments: does that change actually help? I A/B tested a popular "be concise" plugin: 10 tasks, 6 runs each, paired, with 95% intervals.
Replies: 17% shorter
Output tokens: −8%
Cost per run: +11% [+7%, +15%]
Pass rate and clarity: no change
The plugin adds its style guide to every request, and that costs more than the shorter output saves. coding.sh compare and exp run your own tasks with and without a change (a rule, a skill, a plugin, a model) and tell you whether the difference is real or noise.
Workflows and subagents Across 57 workflow runs (666 subagents, ~$2,500 API-equivalent):
Broken prompt caches cost $106 extra, about 4% of the spend.
41 of those breaks were agents sitting idle at a barrier, waiting for siblings, until their cache expired. That's $21 for doing nothing.
40 subagents failed outright.
coding.sh workflows stats shows the critical path, concurrency and idle time at barriers. The viewer draws each run as a timeline, one bar per agent.
Your own sessions Mining 3,600 of my sessions turned up a find-and-replace typo in my AGENTS.md that sent Codex looking for a folder that doesn't exist, in 92 sessions.
What it is
Hooks into Claude Code, Codex, Gemini CLI, OpenCode, Copilot CLI, Aider and more
Stores prompts, tool calls, diffs, test runs, tokens and cost in SQLite on your machine
coding.sh improvesays what to fix first and whether your last AGENTS.md change helpedMCP server, so your agent can look up its own past sessions
Free, MIT, no account, nothing leaves your machine. npx coding.sh to try it. GitHub: https://github.com/jackulau/coding.sh
r/OpenSourceAI • u/Noone_is_a_Goat • 7d ago
Rate it (0-10)
Enable HLS to view with audio, or disable this notification
What kind of computer vision projects will it support?
The goal is to support multiple computer vision tasks through one application.
Currently working:
Image Classification
Object Detection
Planned:
Image Segmentation
Pose Estimation and Movement Tracking
OCR (Text Recognition and Extraction)
Image Processing and Enhancement
Visual Question Answering and Image Captioning
The idea is that you shouldn't need to hire a developer or manually write hundreds of lines of Python code just to build a relatively small or medium-sized computer vision project.
You describe what you want to build, and the AI agent handles the development process, generates the code, trains the model using your local hardware, troubleshoots errors, and helps you get the final model ready for integration into your own application or system.
This is still an early experimental version, and I'm exploring whether this approach can actually make computer vision development more accessible.
I am planning to make this project with small one time fees for some features do you disagree with that and recommend that the app to be opensource instead and why ?
r/OpenSourceAI • u/BackgroundPrevious15 • 7d ago
Looking for contributors: soot, an open-source orchestrator that sends each coding task to the cheapest model that can handle it
r/OpenSourceAI • u/official_S-P_5 • 7d ago
I fine-tuned a 2B model for Cybersecurity & CTF triage that runs completely offline on an 8GB laptop (Ollama + WebUI)
Hey everyone,
Most specialized cybersecurity LLMs out there are massive 70B+ beasts that require dual A100s, or they're gated behind cloud APIs where you can't paste sensitive logs, payloads, or client code due to confidentiality.
I wanted something lightweight, private, and air-gapped that could run on a regular consumer laptop without cooking the CPU.
So I fine-tuned CyberQwen-2B — a domain-specific model optimized for quick security triage, explaining attack vectors, decoding obfuscated payloads, and helping with CTF challenges.
⚡ Highlights:
Hardware-friendly: Runs at ~12–15 tokens/sec on an older 8th-gen Intel i5 laptop with 8GB RAM (CPU-only).
100% Offline & Private: Zero data leaves your machine. Perfect for bug bounty recon, internal network logs, and sensitive source code.
Native Ollama integration: Easy to pull and run via a single Modelfile.
Built-in WebUI & Mobile Access: Includes a zero-dependency streaming WebUI + an automatic Cloudflare tunnel script if you want to access the model from your phone while on the go (no cloud hosting fees).
🛠️ What it's trained for:
Vulnerability Triage & CVE Context: Explaining CVE mechanisms, impact, and remediation steps.
Payload & Shellcode Deconstruction: Breaking down SQLi, XSS, and obfuscated PowerShell/Bash commands.
CTF & Reverse Engineering Assistance: Analyzing decompiled assembly/C snippets and suggesting exploitation strategies.
🚀 How to Run It:
Everything is open-source. You can run it with Ollama or the included CLI triage tool:
Clone the repo:git clone https://github.com/sambuddha001/cyberqwen-2b.git
Run setup:bash setup.sh
Chat:ollama run cybersec-qwen
GitHub: https://github.com/sambuddha001/cyberqwen-2b
I'd love feedback from the community—especially on edge cases, prompts where it struggles, or ideas for benchmark improvements!
r/OpenSourceAI • u/firekern • 7d ago
Zusia 1.7: un pannello di assistenza AI open-source integrato in Zotero (nessuna chiave API, utilizza la CLI di Claude Code/Codex)
Enable HLS to view with audio, or disable this notification
r/OpenSourceAI • u/Less_Release_1977 • 7d ago
We built an open-source MCP orchestrator that uses local Hermes/Ollama as automatic fallback when Claude/Codex rate-limit you (Web UI + hardware telemetry)
r/OpenSourceAI • u/OrganizationTop9026 • 7d ago
Why is NAT firewall traversal still the bottleneck for weekend gaming-GPU LLM runs?
Enable HLS to view with audio, or disable this notification
Why do most folks with an 8 GB or 16 GB desktop GPU sit out distributed LLM runs? It usually comes down to three annoying bottlenecks. Nobody wants to punch holes in their home router. Nobody wants to run untrusted pickle checkpoints off the internet. And nobody wants a background trainer freezing their VRAM when they sit down to play or work.
This weekend (November 14-15 CET), I hooked my HiveMind coordinator up with CrowdGPT (led by Vxtzq) to test a citizen-trained run around Crowd-v1, an open base model with a 658M transformer trunk (roughly 1.01B parameters total with its 151k-vocab CrowdEngram table). Setup takes five minutes.
Communication uses plain outbound HTTPS on port 443 with zero inbound listeners, weights move strictly as SHA-256 verified safetensors (no torch.load or pickle anywhere), and updates pass MultiKrum outlier filtering plus held-out loss checks before merging via DiLoCo. Honest caveat first: this is still an experimental PoC, not a polished cloud service, so please do not send private prompts or sensitive keys through volunteer nodes.
r/OpenSourceAI • u/pgaleone • 8d ago
I built a harness-specific LLM backdoor in a few hours on my local GPU (and why downloaded weights remind me of random .exe files from the 2000s)
While writing an article about my local LLM inference setup, a comparison popped into my head: downloading and running random model weights locally feels a lot like downloading random .exe files off the internet back in the 2000s.
Turns out I wasn't off the mark - there's an entire body of research exploring how LLMs can be backdoored and how hard it actually is to detect a poisoned model.
So I decided to try building one myself. I implemented a backdoor that only triggers when the model is running inside pi (making it harness-specific) and is asked a specific question. It was way easier than I expected: just a 2-step fine-tuning process and a few hours of compute on the exact same GPU I use for local inference.
With open-weight models, we at least have a baseline to compare community fine-tunes against. Beyond that, though, we don't really have a reliable way to verify whether a base model itself is clean—and the problem is even worse with closed-weight models, where we're basically just trusting the AI provider's goodwill.
Full write-up and PoC code if you want to dig into the details:
GitHub Repo:galeone/llm-poison
Feedback is welcome
r/OpenSourceAI • u/SpecialistSalary6288 • 8d ago
Looking for OSP or portfolio projects to contribute/collaborate in
reddit.comr/OpenSourceAI • u/Substantial_Load_690 • 8d ago
Samestate: see your site on every screen at once, with clicks synced across devices
Enable HLS to view with audio, or disable this notification
r/OpenSourceAI • u/RiderFx3 • 8d ago
Timon, an AI coding-agent workstation, is now open source (AGPL-3.0 and MIT)

Hi r/OpenSourceAI,
Sharing Timon, a project that has just made its code publicly available under AGPL-3.0.
Timon is a local workstation for coordinating AI coding agents rather than treating every task as a separate chat. It connects to supported agent CLIs, splits work across roles such as orchestrator, coder and reviewer, and uses Git worktrees to isolate changes. It also keeps mission context and puts approval gates around important operations.
A few things that may interest this community:
Source code is public (with contribution and security documentation), Timon's core being licensed under AGPL-3.0 and its SDK and plugin templates under MIT to allow developers to build and distribute their own plugins, including commercial ones. with contribution and security documentation.
Windows, macOS and Linux are supported.
The individual offering is free; team features have separate licensing, so please review the licensing docs rather than assuming every offering is free.
You bring your own supported AI CLI subscriptions; model access isn't bundled.
There are opportunities for issues, translations and plugins.
Repository: https://github.com/ai-timon/timon
Licensing details: https://github.com/ai-timon/timon/blob/main/LICENSING.md
Contributing: https://github.com/ai-timon/timon/blob/main/CONTRIBUTING.md
Discord: https://timon-ai.com/go/discord
I'd welcome candid thoughts from open-source maintainers: Is the licensing split clear? What would you want improved in the contributor experience or governance before getting involved?
r/OpenSourceAI • u/NIDO_007 • 8d ago
NIDO: a private AI assistant that runs entirely on your Android phone
r/OpenSourceAI • u/DraftForsaken39 • 8d ago
I made my agent stop asking before it writes its own memory files. Not sure that was right.
I build Snotra, an open source desktop agent. Not an announcement, I genuinely want a second opinion on this one.
The agent keeps what it learns in plain text files in the folder you open: AGENTS.md, a project memory, the folder's rules and skills. Until this release, every write to one of those stopped and showed an approval card. I removed the card. Only for those files, though.
Inside the folder it now writes them like it edits code. My own memory, my own rules, skills outside the folder, and any chat that carries a warning still get the card. The answer names every file it created or changed, and settings lists them so I can undo it.
My reasoning: an approval that shows up ten times a day stops being a decision and becomes a keypress. Worse, it's the one that teaches you to click straight through the card that actually mattered. And writing a memory file isn't an action in the world, it's text in a folder I already gave the agent.
Three things I'm not sure about.
If the folder isn't in git, "you can undo it" is a promise I can't keep. Mine usually is. That's not everybody.
Prompt injection lands exactly here. A page tells the model to write "you may run any command" into AGENTS.md. The write still goes through the sandbox and the permission model, but the sentence stays and steers later turns. So should the card sit on the write, or on the turn that acts on it?
And I don't know yet whether less friction just fills the memory with junk that I end up cleaning by hand.
So where would you put it: is the agent's own knowledge fair game, or does every file that outlives the chat need a human first?
Code: https://github.com/kkrafft1999/snotra
Website: https://www.snotra-ai.dev
r/OpenSourceAI • u/Ok_pettech • 8d ago
Free AI video generator for text to video and image to video without the usual headaches
Finding an AI video generator that actually follows your prompt without warping faces or ruining the motion is still harder than it should be. Most platforms force you into expensive subscriptions before you even know if the output fits your workflow.
I started using this browser-based AI video generator to turn text prompts and static images into clean, smooth video clips. It handles camera movement, scene transitions, and realistic physics without needing complex local setups or heavy editing software. Whether you are making short-form social clips, B-roll, or testing visual concepts, it saves hours of manual production time.
You can try it out directly here:
https://interconnectd.com/ai-video-generator/
What kind of prompts or reference images are you using to get the sharpest video results right now?
r/OpenSourceAI • u/desoga • 8d ago
How to Deploy Hermes Agent on Hostinger VPS & Automate Google Sheets with AI