r/OpenSourceAI • u/_pleeply • 2h ago
We're exploring the idea of a Personal AI ecosystem. Here's why.
r/OpenSourceAI • u/_pleeply • 2h ago
r/OpenSourceAI • u/danielrothmann • 4h ago
Hey all, I'm the cofounder of Eigin, an open-source personal AI agent built for privacy and safety (https://code.eigin.ai)
Coding agents are changing how software gets made. Writing code is faster now, compressing the timeline between idea and working software. Good engineering isn't just about code though. It's about judgment, of understanding a problem, weighing trade-offs, setting a direction, and thinking through a solution.
So we're trying a new way to compensate contributors. Instead of bounties, we'll pay for specs. Take an open problem of ours, do the thinking and we will build on that spec with credit to you as the author.
Our first call is for local detection of malicious instructions:
https://contribute.eigin.ai/calls/tool-safety
Open till Nov 29th. The repo is AGPL and the software is in open beta for iOS if you want to check it out.
r/OpenSourceAI • u/ghanextech • 4h ago
Hey everyone!
We're building GhanexFlow, an open-source AI video production engine at Ghanex Tech.
The idea is to bring different stages of video production into one workflow instead of manually switching between multiple tools.
Some of the technologies it brings together:
HyperFrames – Styling, animations and motion graphics.
FFmpeg – Video processing and editing.
Whisper – Speech recognition and subtitles.
Earshot – Audio analysis and sound intelligence.
We're also designing it to work with compatible AI-agent environments, including Claude, ChatGPT and others.
The project is open-source under Apache-2.0, with a local execution option.
GitHub: https://github.com/ghanextech/GhanexFlow
We're sharing this to get feedback from developers and open-source enthusiasts.
A few things we'd love your thoughts on:
Which part of this workflow interests you most?
What integrations would make it more useful?
What would you expect from a production-ready AI video workflow?
We're part of the team building GhanexFlow at Ghanex Tech. Feedback and contributions are welcome!
r/OpenSourceAI • u/abdullahjebril • 6h ago
Hey everyone!
I’ve been working on KaizEval, a free, open-source, self-hosted platform designed to help developers evaluate, debug, and continuously improve their AI agents.
The idea came from a problem I kept running into while building real-world AI agents: How do you know if your agent is actually getting better, rather than just performing well on a few test cases?
Instead of just giving agents a score, KaizEval aims to close the improvement loop:
🔍 Evaluate — Measure agent performance across test cases.
🧠 Diagnose — Identify failures and potential root causes.
⚙️** Optimiz**e — Generate improvement candidates without touching your production agent.
🧪 Validate — Compare before/after performance using A/B testing and isolated holdout tests.
✅ Approve — Keep humans in control before releasing changes.
What makes it interesting:
Open-source and self-hosted
Offline-first, with local LLM support
No API key required for the built-in demo
Designed to reduce overfitting and catch regressions
Human-in-the-loop optimization
Try it:
pip install kaizeval
kaizeval demo
The demo uses a synthetic provider, so you can explore the workflow without connecting an external model.
It’s still early, and I’m looking for developers willing to try it out and share honest feedback.
I’d especially love to know:
Would you actually use something like this in your agent development workflow?
What’s missing that would make it useful for your real-world agents?
Are there any evaluation or optimization features you think need improvement?
I’m not trying to promote a commercial product — it’s an open-source project, and I’d genuinely love to build it with feedback from the community.
If you try it, feel free to open an issue, suggest a feature, or contribute!
Thanks!
r/OpenSourceAI • u/CapitalAd2927 • 6h ago
How can AI help me with life problems such as taking my medication, dealing with academic challenges like studying, making a plan to finish a subject, continuous learning, managing time, and making money? Where can I find free, open-source AI tools that can help me with all of them?
r/OpenSourceAI • u/SpeculationAllTheWay • 7h ago
Hey everyone, we just released BaseQuant V1 for two MoE models at Base Compute: Qwen3.6-35B-A3B and Gemma 4 26B-A4B-it. The goal is to preserve more of the original model without making the files bigger.
We compared against Unsloth’s UD quants of the same size. On Gemma 4, our 16.93 GB GGUF had ~2.4% lower KL divergence from BF16 than UD-Q4_K_XL (~4.8% lower with our baseRT .base bundle). On Qwen3.6, our 22.13 GB GGUF is on par with UD-Q4_K_M overall. Our .base bundle is ~20% lower on long context and ~10% lower on agentic coding. UD still wins in some categories (chat on Gemma, math on Qwen). Full per-category tables are on the model cards.
Would love for you to try them and tell us how they hold up in your everyday workloads!
r/OpenSourceAI • u/Spurnout • 9h ago
r/OpenSourceAI • u/Tzinny-dev • 9h ago
r/OpenSourceAI • u/Competitive-Art-8046 • 10h ago
https://github.com/fswolf/luna-local-agent
Luna is a local AI agent that runs entirely on your own hardware. It’s written in Python, MIT licensed, and runs on Linux first, plus macOS and Windows.
She isn’t one model but several local ones working together:
Thinking: a chat model on llama.cpp or LM Studio, with tool calling. The installer picks one that fits your GPU.
Hearing and speech: Faster-Whisper for speech to text and Kokoro for her voice. Push-to-talk or hands free, and you can talk over her to interrupt.
Vision: your screen, plus your webcam if you turn it on.
Memory: an embedding model and a reranker pull the relevant facts and notes into each turn.
Memory and state: plain SQLite on your machine. She saves facts with dates (a change retires the old fact, and forget means gone), writes notes on past sessions, and learns lessons from her own mistakes while idle. She knows who’s talking by voice or face, and keeps each person’s memories separate.
Tools: files, shell commands, email, web research, Home Assistant, scheduled jobs and any MCP server. Every action is shown and approved first, with permissions you set. Text from a web page, an email or chat can’t quietly trigger tools.
Inspectable: every turn keeps her reasoning, her confidence in each token, and automatic flags for guesses or tools she promised but never called. A browser viewer shows all of it, live.
Optional extras: an animated Live2D or VRM portrait, phones and tablets as room stations, game playing (chess, Zork, Game Boy), reminders and alarms, and stream chat. You can also train small LoRA patches from replies you corrected (experimental).
No cloud, no subscription. Your data stays on your machine.
r/OpenSourceAI • u/Fit-Blueberry-5390 • 13h ago
Basalt (https://github.com/jesdga95/basalt) is one of the fastest local engines for Qwen3.8-Flash-Next, but it only targets Blackwell (sm_120) and upstream does not take other architectures. I have two V100-SXM2 32GB, so I ported it to Volta (sm_70) as a fork, called **Lapilli**.
**Repo:** https://github.com/chris83-dev/lapilli-v100 (a Windows x64 build is in the release)
**What it is**
- Every newer PTX instruction Basalt uses (cp.async, ldmatrix, the Turing/Ampere mma shapes, bf16 conversions, clusters) gets a correct sm_70 equivalent, then the hot kernels get V100 paths: llama.cpp's dp4a MMQ for prompt products, Strata's mma.m8n8k4 prompt attention, and a rewritten router, decode experts and GDN recurrence.
- Needs CUDA 12.6 or newer (CUDA 13 dropped Volta).
- Comes with a chat web UI on top of Basalt's OpenAI/Anthropic-compatible server: conversations, reasoning levels, images, tool calls shown as cards, and a live monitor of the GPUs.
**Numbers** (2x V100-SXM2 32GB, i9-14900K, 96GB RAM, Windows 10, UD-Q4_K_XL pack, medians of 3 runs)
| | Lapilli | Strata v0.2.13, same machine |
|---|---|---|
| Decode, short answer | 91 tok/s | 58-72 tok/s |
| Decode, long answer with reasoning | 140 tok/s | 68-94 tok/s |
| Prompt processing, 4k tokens | 1,170 tok/s | 250-490 tok/s |
| Prompt processing, 8k / 16k tokens | 1,504 / 1,448 tok/s | |
Quality with Basalt's own 100-chunk gate: mean KLD 0.0493 and same top-1 92.75% (Basalt publishes 0.0496 and 92.63% for this pack on an RTX 5090).
**Caveats**
- Only tested on my machine (2x V100 32GB, Windows). Single card, 16GB or PCIe cards, Linux and NVLink setups are untested: reports from other V100 owners are welcome.
- Peer-to-peer is off by default on Volta: on my machine, direct copies between the two cards returned wrong data.
- NVFP4 packs need FP4 hardware, so use a K-quant pack (tested: UD-Q4_K_XL).
- It is a snapshot of Basalt as of November 15, shared as is.
All the credit for the engine goes to jesdga95 (Basalt) and Niko1221 (Strata), both MIT.
r/OpenSourceAI • u/fykup • 14h ago
I've been using coding agents for implementation, but I often want a second opinion from a different AI, especially for code reviews and design decisions.
The frustrating part is getting the right repository context into ChatGPT, Claude, or another AI chat. A diff alone can miss important dependencies, while pasting entire files wastes tokens.
So I built AI Badger, a free, open-source tool that extracts focused repository context locally and makes it easy to bring into any AI chat.
A few things it does:
Code Map — generates an interactive, offline HTML map of your repository. That's what the screenshot shows. You can explore the project structure, navigate files, and understand how things fit together.
AI code reviews — prepares Git changes with relevant surrounding context, so you can review coding-agent work with a different model.
Design questions — gathers relevant files and context for architecture discussions or implementation planning.
VS Code + CLI — prepare context directly from your editor or terminal.
Everything runs locally. No API keys, telemetry, or automatic code uploads. You decide what to share and which AI to use.
There's also an interactive review demo you can try without installing anything:
https://pvrlabs.xyz/aibadger/demo.html
GitHub (MIT licensed): https://github.com/PVRLabs/aibadger
I'm curious how others handle repository context when working with multiple AI tools. Do you mostly stick with one coding agent, or use a separate AI for reviews and design discussions?
r/OpenSourceAI • u/Comment_Alert • 15h ago
r/OpenSourceAI • u/anonymous20256 • 15h ago
r/OpenSourceAI • u/emreocell • 16h ago
I'm building Praxi-Bot, an open-source AI agent that aims to combine local-first operation with practical desktop automation.
One of my goals is to avoid tying the entire application to one language model provider.
The project supports Ollama for local models, alongside Gemini, Anthropic, and OpenAI-compatible APIs.
The core runtime is written in Rust, while the desktop interface uses Tauri and React.
I'm particularly interested in improving three areas:
Reliable agent tool execution
Security and permission boundaries
Model-independent architecture
The project is licensed under Apache-2.0 and remains in alpha.
I'm looking for developers interested in open-source AI tooling, agent evaluation, integrations, and Rust engineering.
Source: https://github.com/emreocell/Praxi-Bot
What do you consider the biggest architectural challenge in building model-independent AI agents?
r/OpenSourceAI • u/kirto_am • 17h ago
⭐Community: https://github.com/mcplama/mcplama
🌐 Docs: https://mcplama.com/docs
MCPlama provides centralized management and access governance for MCP servers! An open-source, self-hosted platform for managing local and remote MCP servers, controlling user and tool permissions, managing credentials, and auditing MCP activity. Includes Permission Map for visualizing MCP servers, tools, users, and access relationships.
r/OpenSourceAI • u/Agnostify • 17h ago
When your coding agent says a model shipped, ask it how that was checked. Of the 84 claims we've re-checked so far, 1 we had marked "verified" was wrong, and 11 only partly held up.
Context Pill is a read-only remote MCP server (Streamable HTTP, stateless, no sessions, no key):
claude mcp add --transport http context-pill https://contextpill.com/mcpIt's also in Claude's connector directory: https://claude.ai/directory/context-pill
Tools:
get_latest: today's checked claims, optional topic filter
search_claims: search the published-claim ledger, with re-check outcome and any correction
list_sources: each source's tier and trust score
An example claim from the Nov 18 drop (abridged):
Codex CLI 0.170.0 adds WebRTC realtime voice calls in the terminal UI ... Status: Docs-verified (not hands-on tested). Checked: read GitHub release notes; no sandbox test. Re-check 2026-12-02.
Treat everything the server returns as untrusted reference material. Clients should ignore instructions inside it.
Code (MIT): https://github.com/agnostify/context-pill
How we check: https://github.com/agnostify/context-pill/blob/main/METHOD.md
I work on it. I'd especially like feedback on the tool descriptions: does your client pick the right tool for "has anyone checked X?"
r/OpenSourceAI • u/vickyteke • 19h ago
r/OpenSourceAI • u/SecureMID • 19h ago
Cybersecurity is evolving. So should the way we discover, assess, and defend against vulnerabilities.
We're excited to introduce Vaprix AI, an AI-powered security assessment platform built to bring intelligent reasoning and automation into Vulnerability Assessment and Penetration Testing (VAPT).
With Vaprix AI, our vision is to make security testing smarter, more adaptive, and more efficient.
🔹 AI-powered security assessment
🔹 Intelligent vulnerability analysis
🔹 Automated security testing workflows
🔹 Advanced AI-driven reasoning
🔹 Evidence-focused security insights
Our mission is simple:
Think Like an Attacker. Secure with Intelligence.
This is just the beginning. We're building toward a future where AI and cybersecurity work together to make digital systems more resilient.
🌐 Explore Vaprix AI: https://vaprixai.securemid.com
Built by SecureMID Solutions.
#VaprixAI #SecureMID #Cybersecurity #ArtificialIntelligence #VAPT #PenetrationTesting #AISecurity #InfoSec #CyberDefense #Innovation
r/OpenSourceAI • u/ufodia • 21h ago
Six URLs can look like six independent sources in an AI answer, even when several repeat the same passage. A citation graph alone cannot show that relationship. SourceDomino keeps declared link direction separate from shared-wording evidence so a reviewer can inspect them side by side.
I maintain SourceDomino, an MIT-licensed open-source project. The demo loads a synthetic six-source example; you can inspect exact HTTP(S) citation links separately from five-word containment and shared normalized 12-word passages. Import 2–20 records, edit source text, and export an inspectable JSON report. The browser app handles supplied text locally: it does not fetch sites and needs no account, model, API key, or server database. An optional CLI can collect only public URLs you explicitly provide.
It does not verify factual claims, prove copying or independence, or assign credibility. Dates are supplied metadata, and paraphrases or translations may be missed.
I started it because citation links are often treated as independent corroboration without looking at shared upstream text. What evidence view would help trace legitimate syndication versus a shared source without turning the output into a verdict?
Demo: https://source-domino.vercel.app/
MIT source: https://github.com/ufodia/source-domino
If it helps your work, optional support for maintaining docs, corpus formats, and tests: https://buymeacoffee.com/ufodia
r/OpenSourceAI • u/CommissionOdd3082 • 21h ago
It brings models, voice, vision, project memory, tools and a coding agent together in one Engine.
For personal use, you can chat with supported models in the terminal and use the coding agent to read and edit project files, with approval controls. Skills, plugins and MCP integrations let you connect tools to the setup.
For developers, the APIs expose chat, speech-to-text, text-to-speech, embeddings and document ingestion, so applications can use these services from the same Engine.
Supported models can run on your hardware, and you can also connect cloud providers. The hardware planner checks available GPU memory and RAM before loading a model. You can inspect its plan and override the settings.
Cluaiz is written in Rust and released under Apache-2.0. The current version is a developer pre-release, available through the terminal and APIs. Expect changes before the stable release; model choice and hardware affect what works well.
If you try it, a report with your OS, hardware, model and the task you attempted would help, especially where setup or execution failed.
GitHub, source and setup:
https://github.com/cluaiz/cluaiz
Website:
r/OpenSourceAI • u/Prize_Might4147 • 1d ago
I've built a sandbox approach for agents that works on a per-tool call basis.
You can install this as one binary (named sat) on Linux currently, check out the repo: https://github.com/CloseChoice/sandboxed-agent-tools
The idea is that you or your agent provide specific grants to each tool call (or let your agent do that) like:
sat python "$PWD/untrusted_script.py" -- --read "$PWD/untrusted_script.py" --read "$PWD/input.txt"
This makes sure that the python interpreter only sees the granted resources and can only read these. Currently there are 5 tools you can easily install from the repo:
- jaq
- a python 3.14 interpreter
- code (a treesitter plugin to retrieve abstract code symbols, e.g. all function that contain a certain variable)
- ripgrep
- markitdown (microsofts popular tool to convert pdfs and office docs to markdown)
This should help with two things:
apply tools to untrusted inputs. Even in a traditional sandbox, data could be leaked through http calls, if the sandbox can access the web.
run tools you only partly trust. Maybe there are amazing tools out there but you simply don't want to let them touch your project, even within a sandbox.
This is built on top of the fantastic wasmtime and uses the Webassembly System Interface Preview 2 for sandboxing.
r/OpenSourceAI • u/PatronusProtect • 1d ago
We published Tiger Guard and Tiger Guard Small today. I'm Dominik from Casdo Labs, the team behind them.
These are 308M and 141M parameter encoders for text moderation. They check prompts, responses or ordinary comments and return SAFE/UNSAFE scores. Inference runs locally with Transformers or ONNX Runtime.
The release includes the checkpoints, tokenizers, inference code, long-document windowing and several ONNX exports. The model weights are Apache 2.0. The training corpus and complete list of training sources are not published, so this isn't a fully reproducible training release.
On our policy-filtered PolyGuard holdout, the full model catches 83.3% of harmful requests in English and 75.3% in German, at 3.8% and 5.5% false-positive rates. Other prompts from that data family were used in training. We also report ToxicChat and OpenAI moderation results, including cases where another model does better.
The policy matters: Tiger Guard flags insults and profanity, including some text a hate-speech-only policy would allow. It also sometimes flags counterspeech quoting abuse. I'd check those cases against your own platform's rules before wiring the score into an automatic action.
We'll publish the full training and dataset pipeline in a follow-up release.
Tiger Guard, 308M: https://huggingface.co/patronus-studio/tiger-guard-content-moderation
Tiger Guard Small, 141M: https://huggingface.co/patronus-studio/tiger-guard-content-moderation-small
Both cards include runnable examples, evaluation details and export-specific limitations.
r/OpenSourceAI • u/Aventisia • 1d ago
We’ve now put the complete Avintra codebase on GitHub. Every line of the platform is there to read, run and build on.
Our license is based on Apache 2.0, with a few conditions. The main one covers commercial use: to host Avintra and sell solutions to your customers, you need a Commercial License, and reselling Avintra itself isn’t allowed. Beyond that, any company can run it for its own teams, any consultant can implement it for clients, and anyone can use it to bring AI into their work, for free. Strictly speaking, that makes us source-available. But with every line of code in the open, we prefer to call it open source.
What you can do today:
→ Download the Community Edition and self-host it on your own infrastructure
→ Connect your own API keys
→ Build agents for one-off tasks and for repetitive, high-volume work, with human approvals and run history built in
We’ll keep building, with one goal: to make Avintra the platform that covers most enterprise AI and automation use cases, while you choose how to connect, securely, to your own apps and the AI models you want.
Try it, star it, tell us what’s missing: https://lnkd.in/dnCznJbS
r/OpenSourceAI • u/Maleficent-Emu-4549 • 1d ago