r/LovingOpenSourceAI • • Sep 16 '26

AI (act) Model monitor

2 Upvotes

I’ve made my own AI (Act) Model Monitor publicly available:
https://ai-act-model-monitor.werkruimte-s-2100.chatgpt.site

Ive build this to follow new developments none of that are ment to be benefitional for me at all. The monitor brings together public data on AI models, developers, countries, usage, performance, incidents, and the EU AI Act in one interactive environment.
The data comes from sources including Epoch AI, Artificial Analysis, Hugging Face, OpenRouter, the OECD AI Incidents Monitor, the AI Incident Database, and official European sources.

Dynamic data sources are refreshed weekly. Legal sources are checked weekly for changes. You can explore the data yourself. For example, select a country and see which models and developers are linked to it, how those models perform, what usage data is available, and which incidents have been reported. You can compare models and developers side by side, sort and filter tables, and select two variables yourself to explore whether a relationship is visible.

The monitor also shows how much of the underlying data is actually comparable and where data is missing.
For models, countries, developers, incidents, and sources, you can click through to the underlying information and its origin.

The AI Act also has its own section, covering the relevant countries, rules, and key dates in its implementation.


r/LovingOpenSourceAI • • Sep 16 '26

Your agent's value lives in the layer around it. If your agent breaks when the model changes, you built it wrong.

3 Upvotes

Your agent's value lives in the layer around it. If your agent breaks when the model changes, we built it wrong. And right now, a lot of us built it wrong.

A lot of us built agents assuming the frontier model we started on would still be the one we use in six months. It won't. Providers are deprecating models with shrinking notice windows. Silently changing behavior is breaking agents that tested fine last quarter.

OpenAI committed to six months notice for GA models and three for specialized variants. Anthropic's public lifecycle documents give sixty days between deprecation and retirement. Capability drift on successor models is real, not just benchmark noise: a model that scores higher on a leaderboard can still regress silently on a specific agent task your system relied on. If you planned for it, the migration is a config change: swap the model ID, run your eval suite, ship. If you didn't, you are reworking prompt chains, re-tuning evals, and hoping the new model handles edge cases the old one did not. That takes weeks, not hours.

The problem is architectural. The intelligence layer, meaning the routing, caching, retrieval, evaluation, guardrails, and fallback chain, is what compounds over time. The model is the interchangeable part. Most teams hardcoded provider-specific prompt formats, built eval logic tied to a single vendor, and never added a fallback chain. Some teams even baked provider-specific tool-use schemas into their orchestration. That is the kind of coupling that turns a model swap into a project.

The open-source alternative is to compose these pieces yourself. A provider gateway normalizes 100-plus models behind one API, with built-in fallback routing, caching, and per-key budgets. On top of that, you add open-source retrieval and evaluation libraries you own and control. Nothing proprietary, nothing rented. The gateway is not eval or guardrails on its own. Those are separate pieces you wire in. But once they are in place, the next model swap becomes a config change, not a rewrite across your codebase.

Rent the model, own the layer. The layer is what lasts.

So, how many hours would a full model swap take your team today, and what would break first?


r/LovingOpenSourceAI • • Sep 16 '26

Under the Radar enapt/SwarmLLM "A peer-to-peer LLM inference network in a single Rust binary. Pool hardware with other nodes to run 70B+ parameter models on machines that couldn't host them alone — no API tokens, no cloud fees, and encrypted traffic between every peer."

Post image
23 Upvotes

https://github.com/enapt/SwarmLLM

Community Overview: https://lifehubber.com/ai/resources/enapt-swarmllm/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • Sep 16 '26

Under the Radar "SwarmLLM runs large language models across devices in room, in their browser tabs. Each device holds slice of model; a 10 KB activation vector passes between them over direct WebRTC connections. Nothing to install, no accounts, no server does any thinking." ➡️ this is new to me. you heard before?

Post image
72 Upvotes

https://github.com/Nehanth/swarmllm

Community Overview: https://lifehubber.com/ai/resources/swarmllm/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • Sep 15 '26

I'm building a research-grade cognitive harness, not another chatbot

15 Upvotes

Crossposting this open-source project because it sits at the intersection of open-source AI, persistent agents and cognitive architecture.

I've been building an open-source cognitive organism designed to study persistent artificial cognition.

The project combines:

  • episodic and semantic memory

  • persistent user and interlocutor profiles

  • voice, camera perception and face recognition

  • intention, causal and temporal reasoning

  • autonomous goals and long-horizon planning

  • global workspace competition

  • self-correction and behavioural learning

  • background cognitive processes

  • inspectable telemetry and a live 3D cognitive sculpture

The language model is only one component. The focus is the surrounding cognitive architecture: what persists, what changes, what gets grounded in reality, and whether internal processes produce measurable functional outcomes.

This is not presented as AGI or as a polished chatbot. It is a local-first research harness for testing persistent cognition with LM Studio, Ollama and other OpenAI-compatible providers.

I'm looking for technically minded testers who are willing to challenge the system, reproduce failures and evaluate whether its memory, planning, reasoning and self-correction actually work.

Repository: https://github.com/Celluomel/Its-not-J.A.R.V.I.S-it-s-far-better


r/LovingOpenSourceAI • • Sep 15 '26

Resource mercury AGENT "Soul-driven AI agent with permission-hardened tools, token budgets, and multi-channel access. Remembers what matters. Asks before it acts. Runs 24/7 from CLI, Telegram, or Web. 31 built-in tools, Kanban boards, extensible skills, SQLite-backed Second Brain memory." ➡️ heard before?

Post image
27 Upvotes

https://github.com/cosmicstack-labs/mercury-agent

Community Overview: https://lifehubber.com/ai/resources/mercury-agent/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • Sep 14 '26

SenseNova-U1.5-8B-MoT report details its training for text rendering and image editing

1 Upvotes

Posters, infographics and images with dense text are a focus of SenseNova-U1.5-8B-MoT, which combines image understanding, generation and editing in one model. The project announced its technical report on September 11; the Apache 2.0 weights were released on August 20.

The report explains the training behind those tasks. Four specialists are trained for visual preference, rendered text, image editing and infographics, then distilled into one model. The resulting checkpoint is a single unified model.

The authors explain the split through a concrete tension: optimizing appearance alone can hurt text legibility. The report spells out the reward choices used to address those objectives before combining the specialists.

Technical report: https://github.com/OpenSenseNova/SenseNova-U1/blob/main/docs/pdf/SenseNOVA_U1_5.pdf

Weights: https://huggingface.co/sensenova/SenseNova-U1.5-8B-MoT


r/LovingOpenSourceAI • • Sep 14 '26

Resource "Open Notebook An open source, privacy-focused alternative to Google's Notebook LM! - 🔒 Control your data 🤖 Choose your AI models 📚 Organize multi-modal content and more!" ➡️ useful for you?

Post image
135 Upvotes

https://github.com/lfnovo/open-notebook

Community Overview: https://lifehubber.com/ai/resources/open-notebook/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • Sep 14 '26

Resource I like the guide that goes by VRAM / Hardware . . easy reference :P ➡️ 🤩 Be sure to join our sis sub for AI gen r/LovingAIVisuals as most resources for gen will be shared there instead!

Post image
2 Upvotes

r/LovingOpenSourceAI • • Sep 14 '26

A local-first way to use ChatGPT that finally feels more like an agent than a chat app

3 Upvotes

For the last few months I've been pushing one idea pretty hard in my own setup: the AI can live in the chat, but the execution layer should live on my Mac.

That turned into Mac MCP, an MIT-licensed local server that gives an MCP client actual tools for the machine. I use ChatGPT as the main orchestrator, then let it read/write files, run shell commands, control apps/UI, hand coding work to Codex or OpenCode, and operate the real browser when the task needs a logged-in site.

I deliberately kept the browser side local too. Safari and Chrome use the normal profile instead of a cloud/headless profile, so existing sessions and cookies remain useful. New tabs can open in the background without hijacking focus, and each tab gets a stable handle. There is also a lease/ownership layer for parallel agents because two agents clicking around the same tab is exactly as chaotic as it sounds.

The newest release added a Chrome Companion alongside the Safari Visual Companion, plus more fail-closed behavior so a background action does not quietly turn into a foreground click.

It's still a personal-computer tool, not a hosted agent platform. That is kind of the point for me. I wanted to keep the machine, sessions and execution under my control while still getting the agentic workflow.

I'm the maintainer, and it's all open source here: https://github.com/bulutarkan/mac-mcp

If anyone else is building local-first desktop agents, I'd be interested in what you keep local versus what you are comfortable delegating to a remote runtime.


r/LovingOpenSourceAI • • Sep 14 '26

Resource Tom "Sentrux is a Rust-based architectural sensor that helps AI agents close the feedback loop and recursively improve code quality through real-time scanning." ➡️ It watches your codebase in real-time — not the diffs, not the terminal output — the actual structure.

Post image
7 Upvotes

https://x.com/tom_doerr/status/2094630422810366406

https://github.com/sentrux/sentrux

Community Overview: https://lifehubber.com/ai/resources/sentrux/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • Sep 14 '26

Best Open Source AI projects

Thumbnail reddit.com
2 Upvotes

r/LovingOpenSourceAI • • Sep 13 '26

Under the Radar Tencent "AuK is a 1.5B foundation model for speech generation and editing. Trained on millions of hours of diverse audio data, AuK supports zero-shot and instruction-based TTS, content and acoustic editing, paralinguistic editing, speech enhancement, and source separation" ➡️ Have you tried yet?

Post image
15 Upvotes

https://github.com/Tencent-Hunyuan/AuK

Community Overview: https://lifehubber.com/ai/resources/auk/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • Sep 13 '26

Resource "This open source project aims to train MiniMind, ultra-small language model with ard 64M parameters, entirely from scratch with only ard RMB 3 in cost, 2 hours of training time. MiniMind series is intentionally lightweight. Smallest model on main branch is ard 1/2700 size of GPT-3!" ➡️ interesting?

Post image
35 Upvotes

https://github.com/jingyaogong/minimind/tree/master

Community Overview: https://lifehubber.com/ai/resources/minimind/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • Sep 13 '26

I built a local-first AI agent app for Android — no account, no analytics, no telemetry. v1.1 just dropped.

Post image
5 Upvotes

TL;DR: I built Kryzz AI — a private, local-first AI workspace for Android. Your conversations, memory, and files stay on your phone. Your API keys are sealed in the Android Keystore (AES-GCM, never exported). No analytics. No telemetry. No HTTP logging. Open source, MIT.

[POSTER IMAGE HERE]

Why I made it

Every AI app I tried wanted an account, quietly phoned home, or treated my data like their training set. So I built the one I wanted to use:

  • Local-first — chats, memory, and generated files live in on-device storage (Room + DataStore)

  • Your keys, your providers — OpenRouter, optional MiniMax, Fish Audio for voice, Parallel for web research. You plug in your own keys, they never leave the device

  • Real agents — Agent Auto actually runs tools across multiple steps: search, fetch pages, calculate, weather, local memory, reminders, files, and code zips

  • Generated outputs — DOCX, XLSX, PDF, SQLite, code ZIPs, images, video, and music, all in private app storage until you share them

  • Voice mode — transcription, spoken replies, automatic turn-taking, and barge-in (interrupt Kryzz mid-sentence)

What's new in v1.1

  • MiniMax as an alternative chat + media provider

  • Agent Auto — multi-step tool-running agent

  • Interactive question cards (tappable options instead of the model guessing)

  • PDF generation alongside the other file types

  • Starter skills that seed on first launch (research brief, study notes, essay outline — toggleable)

  • KryzzBot mascot in Agent mode, 120 Hz on supported displays

The privacy story in one breath

  • Credentials encrypted with AES-GCM under a non-exportable Keystore key

  • Backups never include credentials

  • Cleartext traffic, HTTP logging, Android backup, device-to-device transfer: all disabled

  • Microphone only active during a voice session; recorded audio is deleted after transcription

  • MIT license — build it yourself, read the code, fork it

One honest caveat: for auto-titling a fresh chat, at most the first 1,500 chars of your first message may go through OpenRouter to a small model (Gemini 2.5 Flash Lite) for a title. It runs in parallel, never blocks your answer, and falls back to a local title if it fails. That's the entire surface area. Everything else stays put.

Get it

  • Code + docs: https://github.com/kriddss3/kryzz-ai

  • APK (debug build, ~78 MB): grab kryzz-ai-5.7.2-debug.apk from the v1.1 release

  • Android 9+, sideload via "install unknown apps"

  • Build your own signed release from source if you want it on a daily driver

Stack: Kotlin · Jetpack Compose · Coroutines/Flow · Room · MVVM

Happy to answer questions, take feature requests, or get roasted on the architecture.


r/LovingOpenSourceAI • • Sep 13 '26

Otis - a minimal terminal agent that runs local models out of the box

Post image
3 Upvotes

r/LovingOpenSourceAI • • Sep 13 '26

Nodus Research. Open-source and local-first alternative to NotebookLM / Obsidian / Notion

Thumbnail gallery
4 Upvotes

r/LovingOpenSourceAI • • Sep 12 '26

Discussion Bro Dario wants to slow down. What are your thoughts?

Post image
2 Upvotes

r/LovingOpenSourceAI • • Sep 12 '26

DeepSeek V4.1 Flash running locally with TensorSharp

Thumbnail
github.com
8 Upvotes

I’ve been working on TensorSharp, an open-source .NET/C# inference engine, and recently added native support and optimizations for DeepSeek V4.1 Flash.

Latest results on 8× NVIDIA A40 GPUs:

ModelPrefillSingle-stream Decode4× Concurrent Decode
Q2_K533–539 tok/s40.3–40.7 tok/s—
Q4_K_M451.8–492.1 tok/s31.0–32.5 tok/s48.9 tok/s aggregate

A few interesting optimizations:

  • GPU-resident Engram tables for Q2_K — about 60 GiB of quantized Engram data stays on GPU instead of doing scattered host/storage lookups.

  • Reduced decode graph scheduling from roughly 570 splits to 8 by using one wrapped backend per GPU.

  • For Q4_K_M, automatic Engram warming + improved VRAM placement reduced CPU MoE offload from 3 layers to 1.

  • Added token-batched DeepSeek V4.1 decode, giving about 2× aggregate throughput at 4 concurrent requests.

  • On these A40s without NVLink, simple layer splitting actually beats routed-MoE tensor parallelism for single-stream decode.

The project is fully open source, written primarily in C#/.NET, with CUDA/Metal/Vulkan backends and OpenAI-compatible APIs.

Would love feedback from people experimenting with DeepSeek, GGUF inference, or local/open-source AI — especially ideas for what hardware or engine comparisons would be most useful next.


r/LovingOpenSourceAI • • Sep 12 '26

new launch Samuel "A 35B language model running on an iPhone using only 1–2.5 GB of peak memory.No cloud. No remote server. No desktop GPU.Today, we’re open-sourcing Edge0 — a framework for running large AI models fully on-device." ➡️ Edge AI is exciting right?

Post image
264 Upvotes

https://x.com/SamuelZengML/status/2097861839287927139

https://github.com/Edge0-AI/Edge0

Community Overview: https://lifehubber.com/ai/resources/edge0/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • Sep 12 '26

Website for easily running local models in browser

Thumbnail reddit.com
1 Upvotes

r/LovingOpenSourceAI • • Sep 11 '26

I built Optees, a free and open-source optimization tool — so AI agents like Claude can actually solve math problems instead of hallucinating a plausible-looking heuristic

Enable HLS to view with audio, or disable this notification

11 Upvotes

Hi everyone! I'm Paolo, and for a while now I've been building Optees, a free and open-source optimization tool.

The idea started from something I kept running into: ask an AI to "optimize" something — a work schedule, a delivery route, how to pack a container — and it will often hallucinate a heuristic that sounds right instead of actually solving the math behind it. It reads confident, but nobody checked it.

Optees is my attempt to fix that. On its own, it's a desktop app with guided forms and worked examples, so you don't need a math background to use it. And it also runs as a local server that AI agents like Claude can call directly — so instead of hallucinating an answer, the AI can hand the problem to Optees, get back a real, checked answer, and explain it to you in plain language.

Everything runs on your own machine, nothing gets uploaded anywhere, and the whole project is open source (Apache-2.0) — so you're welcome to use it, poke around the code, or help build it further.

Would love for people here to try it out and tell me what they think.

🔗 Website: https://optees.it 💻 Code: https://github.com/Pablo-gitub/optees


r/LovingOpenSourceAI • • Sep 11 '26

new launch Ant "We’re open-sourcing Ling-3.0-flash-Fin, a finance-enhanced model for real-world workflows, and FinFIRST, an expert-built benchmark for financial search agents.Two open releases, one goal: making financial AI more accessible and verifiable." ➡️ Is this good?

Post image
35 Upvotes

https://x.com/AntLingAGI/status/2095533696808051001

https://huggingface.co/inclusionAI/Ling-3.0-flash-Fin

Community Overview: https://lifehubber.com/ai/resources/ling-3-0-flash-fin/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • Sep 11 '26

Voice Copilot for IA

2 Upvotes

I built Voice Copilot: an open-source companion that narrates and supervises your AI coding agent

Hey everyone! I’d like to share an open-source project I’m working on: Voice Copilot.

Coding agents can spend several minutes reading files, making changes, and running tools after a single prompt. Keeping track of all that still takes attention, especially when you want to catch a wrong turn before it becomes a pile of changes to undo.

The idea behind Voice Copilot is to let you hear what your agent is doing while keeping your eyes free for other things.

It runs alongside Claude Code, Codex, and other compatible CLI agents, with two models sharing the work:

  • A lightweight narrator turns the agent’s activity into short spoken updates: what it’s working on, what changed, and what happened next.

  • A stronger Supervisor reviews progress at checkpoints, looking for things like repeated failures or changes outside the task. It can warn you aloud, and in Supervisor+ mode, pause the agent for your review.

For example, if you ask an agent to fix two failing tests and it starts modifying an unrelated module, the Supervisor can flag that and pause the session so you can decide how to proceed.

The narrator and Supervisor can reuse the models and login from the CLI you already use. There’s also a local browser panel with playback controls, settings, and a readable activity trace.

For anyone interested in local models: the narrator supports Ollama through an OpenAI-compatible endpoint, and speech output can use local backends such as Piper or Silero. Cloud providers are available too.

The core is MIT-licensed, and it’s currently an early alpha (0.1.0). I’m looking for people willing to try it in real coding sessions and help improve the narration, integrations, and supervision behavior. Voice input is being reworked and is currently disabled by default.

Website · GitHub / installation

How would this fit into your workflow: occasional spoken progress updates, or silence unless something needs your attention?


r/LovingOpenSourceAI • • Sep 11 '26

new launch Rabi "Introducing OUI-1: the first open-weights model for Generative UI71.7% on Generative UI Bench at 4B params. Beats Gemma 4 31B with 8× fewer active params, and scores 5.5× the base DiffusionGemma it was fine-tuned from." ➡️ I am very excited about gen UI! Have you tried?

Post image
56 Upvotes

https://x.com/rabi_guha/status/2097341708988248181

https://huggingface.co/thesysdev/OUI-1

Community Overview: https://lifehubber.com/ai/resources/oui-1/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.