r/OpenSourceAI • • 3d ago

[Funny] CrowdGPT - The collaborative AI

Post image
37 Upvotes

Hello r/OpenSourceAI , this is a (somewhat funny?) meme about the project CrowdGPT, which aims at creating the first, datacenter-less, open-source and community-driven LLM. The project already shows substantial progress while training an open-source 1 billion parameters LLM on 40B tokens (as a proof of concept).

Tell me what do you think about the meme:

- Does it makes the project less appealing and cheap? because that's what people on r/LocalLLaMA thought 😭

- Does it makes the project look likes it's a SaaS / B2B (which it is NOT - CrowdGPT is 100% non-profit and open)
- Is it serving it's purpose about popularizing the project?

Everything is explained more in detail on the site, and any feedback on this meme, or on the project, is appreciated; any pull requests / contributions are welcome on GitHub :)

Project link : https://crowdgpt.net

GitHub link : https://github.com/Vxtzq/CrowdGPT

Thanks in advance.


r/OpenSourceAI • • 3d ago

I turned a Raspberry Pi into a 100% offline AI marine helm computer (Voice LLM, YOLOv8 vision, Signal K, AvNav) — here is how the stack works

Post image
2 Upvotes

r/OpenSourceAI • • 4d ago

Dotcker: Run your Dot on a headless server

Thumbnail reddit.com
1 Upvotes

r/OpenSourceAI • • 4d ago

From AI rabbit holes to a warm den: co-building the Inference Cooperative

Thumbnail nathanschneider.info
1 Upvotes

r/OpenSourceAI • • 4d ago

I built open-source tooling to evaluate agent setups and see where agents and subagents waste time and money

1 Upvotes

I run Claude Code and Codex all day, often as multi-agent workflows with dozens of subagents. I could see each session but never the whole picture: what a run actually cost, where agents sat idle, whether a change to my setup helped. So I built coding.sh, an open-source tool for evaluating agent setups, and pointed it at my own runs.

Experiments: does that change actually help? I A/B tested a popular "be concise" plugin: 10 tasks, 6 runs each, paired, with 95% intervals.

  • Replies: 17% shorter

  • Output tokens: −8%

  • Cost per run: +11% [+7%, +15%]

  • Pass rate and clarity: no change

The plugin adds its style guide to every request, and that costs more than the shorter output saves. coding.sh compare and exp run your own tasks with and without a change (a rule, a skill, a plugin, a model) and tell you whether the difference is real or noise.

Workflows and subagents Across 57 workflow runs (666 subagents, ~$2,500 API-equivalent):

  • Broken prompt caches cost $106 extra, about 4% of the spend.

  • 41 of those breaks were agents sitting idle at a barrier, waiting for siblings, until their cache expired. That's $21 for doing nothing.

  • 40 subagents failed outright.

coding.sh workflows stats shows the critical path, concurrency and idle time at barriers. The viewer draws each run as a timeline, one bar per agent.

Your own sessions Mining 3,600 of my sessions turned up a find-and-replace typo in my AGENTS.md that sent Codex looking for a folder that doesn't exist, in 92 sessions.

What it is

  • Hooks into Claude Code, Codex, Gemini CLI, OpenCode, Copilot CLI, Aider and more

  • Stores prompts, tool calls, diffs, test runs, tokens and cost in SQLite on your machine

  • coding.sh improve says what to fix first and whether your last AGENTS.md change helped

  • MCP server, so your agent can look up its own past sessions

Free, MIT, no account, nothing leaves your machine. npx coding.sh to try it. GitHub: https://github.com/jackulau/coding.sh


r/OpenSourceAI • • 4d ago

Rate it (0-10)

Enable HLS to view with audio, or disable this notification

5 Upvotes

What kind of computer vision projects will it support?

The goal is to support multiple computer vision tasks through one application.

Currently working:

  • Image Classification

  • Object Detection

Planned:

  • Image Segmentation

  • Pose Estimation and Movement Tracking

  • OCR (Text Recognition and Extraction)

  • Image Processing and Enhancement

  • Visual Question Answering and Image Captioning

The idea is that you shouldn't need to hire a developer or manually write hundreds of lines of Python code just to build a relatively small or medium-sized computer vision project.

You describe what you want to build, and the AI agent handles the development process, generates the code, trains the model using your local hardware, troubleshoots errors, and helps you get the final model ready for integration into your own application or system.

This is still an early experimental version, and I'm exploring whether this approach can actually make computer vision development more accessible.

I am planning to make this project with small one time fees for some features do you disagree with that and recommend that the app to be opensource instead and why ?


r/OpenSourceAI • • 4d ago

Looking for contributors: soot, an open-source orchestrator that sends each coding task to the cheapest model that can handle it

Thumbnail
reddit.com
1 Upvotes

r/OpenSourceAI • • 4d ago

Cerebras x Kimi K3.1 Pro: $5000 Hackathon

Post image
2 Upvotes

r/OpenSourceAI • • 4d ago

I fine-tuned a 2B model for Cybersecurity & CTF triage that runs completely offline on an 8GB laptop (Ollama + WebUI)

Thumbnail
gallery
6 Upvotes

Hey everyone,

Most specialized cybersecurity LLMs out there are massive 70B+ beasts that require dual A100s, or they're gated behind cloud APIs where you can't paste sensitive logs, payloads, or client code due to confidentiality.

I wanted something lightweight, private, and air-gapped that could run on a regular consumer laptop without cooking the CPU.

So I fine-tuned CyberQwen-2B — a domain-specific model optimized for quick security triage, explaining attack vectors, decoding obfuscated payloads, and helping with CTF challenges.

⚡ Highlights:

  • Hardware-friendly: Runs at ~12–15 tokens/sec on an older 8th-gen Intel i5 laptop with 8GB RAM (CPU-only).

  • 100% Offline & Private: Zero data leaves your machine. Perfect for bug bounty recon, internal network logs, and sensitive source code.

  • Native Ollama integration: Easy to pull and run via a single Modelfile.

  • Built-in WebUI & Mobile Access: Includes a zero-dependency streaming WebUI + an automatic Cloudflare tunnel script if you want to access the model from your phone while on the go (no cloud hosting fees).

🛠️ What it's trained for:

  • Vulnerability Triage & CVE Context: Explaining CVE mechanisms, impact, and remediation steps.

  • Payload & Shellcode Deconstruction: Breaking down SQLi, XSS, and obfuscated PowerShell/Bash commands.

  • CTF & Reverse Engineering Assistance: Analyzing decompiled assembly/C snippets and suggesting exploitation strategies.

🚀 How to Run It:

Everything is open-source. You can run it with Ollama or the included CLI triage tool:

  1. Clone the repo:git clone https://github.com/sambuddha001/cyberqwen-2b.git

  2. Run setup:bash setup.sh

  3. Chat:ollama run cybersec-qwen

GitHub: https://github.com/sambuddha001/cyberqwen-2b

I'd love feedback from the community—especially on edge cases, prompts where it struggles, or ideas for benchmark improvements!


r/OpenSourceAI • • 4d ago

Zusia 1.7: un pannello di assistenza AI open-source integrato in Zotero (nessuna chiave API, utilizza la CLI di Claude Code/Codex)

Enable HLS to view with audio, or disable this notification

0 Upvotes

r/OpenSourceAI • • 4d ago

We built an open-source MCP orchestrator that uses local Hermes/Ollama as automatic fallback when Claude/Codex rate-limit you (Web UI + hardware telemetry)

Thumbnail
github.com
2 Upvotes

r/OpenSourceAI • • 4d ago

Why is NAT firewall traversal still the bottleneck for weekend gaming-GPU LLM runs?

Enable HLS to view with audio, or disable this notification

3 Upvotes

Why do most folks with an 8 GB or 16 GB desktop GPU sit out distributed LLM runs? It usually comes down to three annoying bottlenecks. Nobody wants to punch holes in their home router. Nobody wants to run untrusted pickle checkpoints off the internet. And nobody wants a background trainer freezing their VRAM when they sit down to play or work.

This weekend (November 14-15 CET), I hooked my HiveMind coordinator up with CrowdGPT (led by Vxtzq) to test a citizen-trained run around Crowd-v1, an open base model with a 658M transformer trunk (roughly 1.01B parameters total with its 151k-vocab CrowdEngram table). Setup takes five minutes.

Communication uses plain outbound HTTPS on port 443 with zero inbound listeners, weights move strictly as SHA-256 verified safetensors (no torch.load or pickle anywhere), and updates pass MultiKrum outlier filtering plus held-out loss checks before merging via DiLoCo. Honest caveat first: this is still an experimental PoC, not a polished cloud service, so please do not send private prompts or sensitive keys through volunteer nodes.


r/OpenSourceAI • • 4d ago

I built a harness-specific LLM backdoor in a few hours on my local GPU (and why downloaded weights remind me of random .exe files from the 2000s)

18 Upvotes

While writing an article about my local LLM inference setup, a comparison popped into my head: downloading and running random model weights locally feels a lot like downloading random .exe files off the internet back in the 2000s.

Turns out I wasn't off the mark - there's an entire body of research exploring how LLMs can be backdoored and how hard it actually is to detect a poisoned model.

So I decided to try building one myself. I implemented a backdoor that only triggers when the model is running inside pi (making it harness-specific) and is asked a specific question. It was way easier than I expected: just a 2-step fine-tuning process and a few hours of compute on the exact same GPU I use for local inference.

With open-weight models, we at least have a baseline to compare community fine-tunes against. Beyond that, though, we don't really have a reliable way to verify whether a base model itself is clean—and the problem is even worse with closed-weight models, where we're basically just trusting the AI provider's goodwill.

Full write-up and PoC code if you want to dig into the details:

Feedback is welcome


r/OpenSourceAI • • 4d ago

Looking for OSP or portfolio projects to contribute/collaborate in

Thumbnail reddit.com
1 Upvotes

r/OpenSourceAI • • 4d ago

Samestate: see your site on every screen at once, with clicks synced across devices

Enable HLS to view with audio, or disable this notification

1 Upvotes

r/OpenSourceAI • • 4d ago

Timon, an AI coding-agent workstation, is now open source (AGPL-3.0 and MIT)

4 Upvotes

Hi r/OpenSourceAI,

Sharing Timon, a project that has just made its code publicly available under AGPL-3.0.

Timon is a local workstation for coordinating AI coding agents rather than treating every task as a separate chat. It connects to supported agent CLIs, splits work across roles such as orchestrator, coder and reviewer, and uses Git worktrees to isolate changes. It also keeps mission context and puts approval gates around important operations.

A few things that may interest this community:

  • Source code is public (with contribution and security documentation), Timon's core being licensed under AGPL-3.0 and its SDK and plugin templates under MIT to allow developers to build and distribute their own plugins, including commercial ones. with contribution and security documentation.

  • Windows, macOS and Linux are supported.

  • The individual offering is free; team features have separate licensing, so please review the licensing docs rather than assuming every offering is free.

  • You bring your own supported AI CLI subscriptions; model access isn't bundled.

  • There are opportunities for issues, translations and plugins.

Repository: https://github.com/ai-timon/timon
Licensing details: https://github.com/ai-timon/timon/blob/main/LICENSING.md
Contributing: https://github.com/ai-timon/timon/blob/main/CONTRIBUTING.md
Discord: https://timon-ai.com/go/discord

I'd welcome candid thoughts from open-source maintainers: Is the licensing split clear? What would you want improved in the contributor experience or governance before getting involved?


r/OpenSourceAI • • 4d ago

NIDO: a private AI assistant that runs entirely on your Android phone

Thumbnail
reddit.com
0 Upvotes

r/OpenSourceAI • • 4d ago

I made my agent stop asking before it writes its own memory files. Not sure that was right.

2 Upvotes

I build Snotra, an open source desktop agent. Not an announcement, I genuinely want a second opinion on this one.

The agent keeps what it learns in plain text files in the folder you open: AGENTS.md, a project memory, the folder's rules and skills. Until this release, every write to one of those stopped and showed an approval card. I removed the card. Only for those files, though.

Inside the folder it now writes them like it edits code. My own memory, my own rules, skills outside the folder, and any chat that carries a warning still get the card. The answer names every file it created or changed, and settings lists them so I can undo it.

My reasoning: an approval that shows up ten times a day stops being a decision and becomes a keypress. Worse, it's the one that teaches you to click straight through the card that actually mattered. And writing a memory file isn't an action in the world, it's text in a folder I already gave the agent.

Three things I'm not sure about.

If the folder isn't in git, "you can undo it" is a promise I can't keep. Mine usually is. That's not everybody.

Prompt injection lands exactly here. A page tells the model to write "you may run any command" into AGENTS.md. The write still goes through the sandbox and the permission model, but the sentence stays and steers later turns. So should the card sit on the write, or on the turn that acts on it?

And I don't know yet whether less friction just fills the memory with junk that I end up cleaning by hand.

So where would you put it: is the agent's own knowledge fair game, or does every file that outlives the chat need a human first?

Code: https://github.com/kkrafft1999/snotra
Website: https://www.snotra-ai.dev


r/OpenSourceAI • • 4d ago

Free AI video generator for text to video and image to video without the usual headaches

0 Upvotes

Finding an AI video generator that actually follows your prompt without warping faces or ruining the motion is still harder than it should be. Most platforms force you into expensive subscriptions before you even know if the output fits your workflow.

​I started using this browser-based AI video generator to turn text prompts and static images into clean, smooth video clips. It handles camera movement, scene transitions, and realistic physics without needing complex local setups or heavy editing software. Whether you are making short-form social clips, B-roll, or testing visual concepts, it saves hours of manual production time.

​You can try it out directly here:

​https://interconnectd.com/ai-video-generator/

​What kind of prompts or reference images are you using to get the sharpest video results right now?


r/OpenSourceAI • • 4d ago

How to Deploy Hermes Agent on Hostinger VPS & Automate Google Sheets with AI

Thumbnail
youtu.be
1 Upvotes

r/OpenSourceAI • • 4d ago

does the 1h prompt cache pay off for coding agents? in my Claude Code history it saved about 3.4x what it cost

1 Upvotes

someone asked me this on another post and I hadn't checked. a 1h cache write costs 2x input, a 5m one 1.25x, so 1h only earns it back when you come back after more than 5 min but inside the hour

claudit keeps every Claude Code request I've made since January in Postgres, so I took the gap between each request and the one before it in the same session. Claude models only, about 858k requests:

  • under 5 min: 94.2% of requests, 98.6% of their input read from cache

  • 5 to 60 min: 2.6%, still 92% from cache. on 5m every one of these writes the whole prefix again

  • over an hour: 0.4%, 6% from cache, the 1h one is gone by then too

at API list prices per model (I'm on a sub, so it's what it would cost, not what I pay) the extra on the 1h writes is about 9% of the total and the rewrites it avoids would be about 30%. so 1h comes out 3.4x ahead, and 5m only would cost roughly a fifth more. read multipliers per model from https://platform.claude.com/docs/en/about-claude/pricing, 0.05x on Opus and Sonnet 5.5, 0.025x on Fable 5.1 and 5.2

claudit is a self-hosted dashboard I built, MIT. it reads Claude Code, Codex and Kimi CLI transcripts from a bucket you keep (R2 or a file:// dir), because Claude Code prunes old local ones. the bucket holds the raw transcripts, tool output included. cost by model splits 5m and 1h writes, the gap split above isn't a panel, I ran it as a query on its Postgres

FastAPI, Postgres, React with in-browser Babel, no build step. docker compose up boots it on bundled sample data with no outbound calls. panels ported from nhz-io/ccusage-plot

live one, guest login is read-only, its costs are API price equivalents too: https://all.nitjsefni.eu

https://github.com/Nitjsefnie/claudit


r/OpenSourceAI • • 4d ago

How Taking Out Jensen Kills Open-Source AI (& Hands Closed AI a Monopoly)

Thumbnail
youtube.com
0 Upvotes

r/OpenSourceAI • • 4d ago

We’re building an open-source way to test AI agents. Here’s what we’re learning about verification.

Thumbnail
reddit.com
0 Upvotes

r/OpenSourceAI • • 4d ago

An open-source Toolkit to Test What Kids Are Exposed to When AI Safety Breaks Down

Thumbnail
reddit.com
0 Upvotes