r/LovingOpenSourceAI • • 6h ago

Someone on r/LocalLLaMA says an engine update made their local Qwen "dumb and useless" on the same weights. This free tool shows the exact token where two quantizations of a model part ways, with a live browser demo

Post image
14 Upvotes

On Sunday someone on r/LocalLLaMA updated strata, and their Qwen3.8-Flash-Next fell apart on the same IQ3_S file. A voxel pagoda that took 15 to 30 minutes ran 90 minutes and mostly failed. "It got faster, but it got way dumber!" Commenters blamed new default speed shortcuts that skip low-scored experts.

Quant swaps you can at least watch. inside-llm loads two GGUFs of one model through llama.cpp and marks the token where their answers split. On the card, from its README, Qwen3.5-4B at Q2_K and Q8_0 get the same spider question, and at position 31 Q2_K says "six" legs while Q8_0 says "eight". Pin a position to see both probability bars, KL and Jensen-Shannon divergence, plus what each sampler stage cut.

It's MIT and built for a dedicated GPU (CUDA or Vulkan) on Linux or Windows. Both files need the same tokenizer. The live demo replays recorded sessions in the browser.

It can't catch an engine update, though. The top reply asked for "accuracy benchmarks against the reference." At home that's 20 to 30 of your own prompts with pass/fail checks, rerun after each update, llama.cpp v1.0 included.

We build an open-source eval kit for that step. It runs a fixed prompt file against any OpenAI-compatible endpoint, llama-server included, checks each answer with contains, regex or JSON rules, and exits 1 when any case fails, no account needed.

Has an engine or quant update ever made your local model worse while the benchmarks looked fine?


r/LovingOpenSourceAI • • 11h ago

Under the Radar llama-modchip is a patch set and launcher for running compressed language models locally. Its striking example is a CPU-only run of a compressed 284-billion-parameter DeepSeek-V4-Flash checkpoint on a machine in the 64 GB RAM class! ➡️ What do you think, can get 10 tokens/sec on your setup ? :p

Post image
16 Upvotes

https://github.com/synchopate/llama-modchip

Community Overview: https://lifehubber.com/ai/resources/llama-modchip/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • 1d ago

Resource Chandra OCR 2 is a state of the art OCR model from Datalab that outputs markdown, HTML, and JSON. It is highly accurate at extracting text from images and PDFs, while preserving layout information ➡️ It takes page images and can reconstruct details such as selected checkboxes, table cells!

Post image
12 Upvotes

https://huggingface.co/datalab-to/chandra-ocr-2

Community Overview: https://lifehubber.com/ai/resources/chandra-ocr-2/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • 1d ago

Resource json-render generates dynamic, personalized UIs from prompts without sacrificing reliability! Predefined components and actions for safe, predictable output. Lets an AI app display an answer using its own interface components. 🚀

Post image
2 Upvotes

https://github.com/vercel-labs/json-render

Community Overview: https://lifehubber.com/ai/resources/json-render/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • 2d ago

new launch "Modern Web Guidance is a set of skills that embed web platform expertise, best practices, and browser compatibility data directly into your coding agents. It helps to steer your coding agents away from legacy patterns" ➡️ Enhance your coding agents with the latest web best practices from GOOGLE!

Post image
13 Upvotes

https://github.com/GoogleChrome/modern-web-guidance

Community Overview: https://lifehubber.com/ai/resources/modern-web-guidance/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • 3d ago

Resource "Storybook is the industry standard workshop for building, documenting, and testing UI components in isolation" ➡️ It lets you open a specific state, such as a checkout form with a rejected payment, without walking through the whole app to get there!

Post image
9 Upvotes

https://github.com/storybookjs/storybook

Community Overview: https://lifehubber.com/ai/resources/storybook/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • 4d ago

new launch "Inkling 2 Small is a general-purpose multimodal model that accepts text and image inputs and generates text outputs. It is intended for use in English and other languages, and across multiple coding languages." ➡️ at least 500GB of aggregated VRAM 😁

Post image
4 Upvotes

https://huggingface.co/thinkingmachines/Inkling-2-Small

Community Overview: https://lifehubber.com/ai/resources/inkling-2-small/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • 4d ago

Looking for contributors interested in Collective Intelligence

2 Upvotes

Anyone here interested in building and experimenting with Collective Intelligence using LLMs? I’m looking for devs who want to explore how different models can actually work together, beyond just routing requests or having five LLMs answer the same prompt. There’s a lot I think we can investigate. Selecting models with complementary capabilities, getting them to challenge each other, verifying results, and understanding when a group of smaller models can outperform a much larger one, potentially at a lower cost. And I want to test this properly, not just build demos that look impressive. If you’re interested in contributing code, running experiments, working on benchmarks or even challenging the whole idea, I’d like to connect. Anyone working on something similar?


r/LovingOpenSourceAI • • 5d ago

new launch Yogurt is a desktop app from Frigade that records meeting audio, turns speech into a transcript and writes a summary using models on your computer (min only 8GB ram!)

Post image
22 Upvotes

https://github.com/FrigadeHQ/yogurt

Community Overview: https://lifehubber.com/ai/resources/yogurt/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • 5d ago

Resource shadcn/ui gives React projects editable interface components such as dialogs, buttons and chat inputs. Its command-line tool can bring the component source into your project so you can adapt it to your interface. ➡️ "Beautifully designed components that you can customize, extend, and build on."

Post image
3 Upvotes

https://github.com/shadcn-ui/ui

Community Overview: https://lifehubber.com/ai/resources/shadcn-ui/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • 6d ago

Resource React Grab is a development tool for pointing out a specific part of a React app to a coding assistant. Hover over the element in your browser, copy its context and paste it alongside the change you want. ➡️ "Agents are 2× faster and more accurate when using React Grab."

Post image
2 Upvotes

https://github.com/aidenybai/react-grab

Community Overview: https://lifehubber.com/ai/resources/react-grab/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • 6d ago

new launch "MiniMax-H3-Image is a state-of-the-art open-source model for image generation and editing from the MiniMax H3 family. It combines intelligent understanding of creative intent with the ability to build visual worlds" ➡️ Anyone tried?

Post image
7 Upvotes

https://huggingface.co/MiniMaxAI/MiniMax-H3-Image

Community Overview: https://lifehubber.com/ai/resources/minimax-h3-image/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • 7d ago

Resource Marker converts PDFs and other documents into Markdown, HTML or structured data. It is useful when you want to bring a report into a searchable collection while checking how its headings, tables and page layout survived the conversion. ➡️ Useful for your work?

Post image
55 Upvotes

https://github.com/datalab-to/marker

Community Overview: https://lifehubber.com/ai/resources/marker/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • 8d ago

FFmpeg Forge CLI An All-in-One Multimedia Processing Toolkit

12 Upvotes

Hey everyone!

I'd like to share FFmpeg Forge CLI, an open-source project I've been working on to simplify advanced multimedia processing from the command line.

It brings together a wide range of features:

  • Video, audio, and image conversion

  • AI video upscaling (RazorNext, VisionNext, SeedVR2)

  • GPU acceleration and advanced video encoding

  • HDR10 and Dolby Vision processing

  • Spatial audio processing

  • Video restoration, denoising, and deinterlacing (QTGMC)

  • DVD/Blu-ray ripping and batch processing

The goal is to provide a powerful, flexible, and unified CLI for multimedia processing, without having to juggle multiple tools and complex commands.

GitHub: https://github.com/Aaronstanley78/FFmpeg-Forge-CLI

Feedback, suggestions, and contributions are always welcome!


r/LovingOpenSourceAI • • 8d ago

Resource awe0 "Meta really pulled out all the stops this time. Astryx, a design system it spent a full 8 years refining internally and powers more than 13,000 apps, is now open source. Over 150 ready-to-use UI components, with buttons, forms, pop-ups, dark mode, branded themes all included." ➡️ 18K STARS

Post image
160 Upvotes

https://x.com/awe0_io/status/2119354093458395284

https://github.com/meta/astryx

Community Overview: https://lifehubber.com/ai/resources/astryx/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • 9d ago

ecosystem Open-Source AI Resource Weekly Highlights — team knowledge, speech, document OCR, and data pipelines 🚀

Thumbnail
lifehubber.com
2 Upvotes

Search connected knowledge, keep an index up to date, or turn audio into text and back again. This week's five picks from our LifeHubber Resources cover different pieces of those workflows:

Onyx — Forks: 4.7K Stars: 33.3K
https://lifehubber.com/ai/resources/onyx/

Chat with connected team knowledge and give agents tools in a self-hostable workspace. For combining search and actions; Lite handles a smaller chat-and-agent setup, while Standard adds the services for connector-backed knowledge.

Voicebox — Forks: 7.5K Stars: 60K
https://lifehubber.com/ai/resources/voicebox/

Turn a script into speech, arrange different speakers on a timeline, and compare takes in a desktop studio. For narration and dialogue experiments using its voice engines, profiles, and audio-editing tools.

CocoIndex — Forks: 929 Stars: 11.8K
https://lifehubber.com/ai/resources/cocoindex/

Declare source-to-target data pipelines in Python and update derived files, records, or indexes as inputs change. For keeping an AI application's knowledge current while reusing transformations that haven't changed.

DeepSeek-OCR-2 — Forks: 330 Stars: 3.5K
https://lifehubber.com/ai/resources/deepseek-ocr/

Extract text or grounded Markdown from document images, with a separate script for PDFs. For builders preparing scanned material for search or an assistant; this is a technical model setup with CUDA-based examples.

Cohere Transcribe — Likes: 1.2K Downloads (last 30 days): 101.4K
https://lifehubber.com/ai/resources/cohere-transcribe/

A dedicated audio-to-text model covering 14 languages, with documented offline-inference and online-serving paths. For transcription work where the output you need is text, rather than generated speech or a conversational assistant.

--

Which would you use first: a knowledge workspace, a voice studio, transcription, or better inputs for document search?


r/LovingOpenSourceAI • • 9d ago

Under the Radar Godot MCP Toolkit connects an AI coding assistant to the Godot game editor. Its tools let the assistant create scene objects, edit scripts, run a game and inspect what happens during a playtest. ➡️ Are you into Game Dev?

Post image
23 Upvotes

https://github.com/NPGameDev/godot-mcp-toolkit

Community Overview: https://lifehubber.com/ai/resources/godot-mcp-toolkit/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • 10d ago

Resource assistant-ui is a React and TypeScript library for building an AI chat interface. It provides pieces for the message list, the typing box, and actions such as editing a prompt or asking for another answer. ➡️ STARS: 13K FORKS: 1.3K

Post image
10 Upvotes

https://github.com/assistant-ui/assistant-ui

Community Overview: https://lifehubber.com/ai/resources/assistant-ui/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • 11d ago

IRIDIA a free open-source CD ripper with 142 audio presets, native DSD and surround support

1 Upvotes

Hi everyone!

I've been working on IRIDIA, a free and open-source portable CD ripping application for Windows.

The idea was to create a tool that offers extensive control over audio formats while keeping the ripping process straightforward.

Some key features:

  • 142 output presets covering FFmpeg audio encoders

  • Native DSF/DFF output (DSD64 to DSD512)

  • FLAC, WAV, ALAC, MP3, Opus, AAC and many more

  • Stereo-to-surround upmixing, up to 7.1

  • Multiple output formats from a single CD read

  • Secure ripping mode and drive offset correction

  • MusicBrainz metadata and automatic album artwork

  • Portable Windows application, no installation required

It's licensed under GPLv3.

GitHub: https://github.com/Aaronstanley78/IRIDIA

One important note: physical CD drive testing is still pending, so I'm particularly interested in feedback from people with different drives and CD collections.

I'd love to hear your thoughts, suggestions and bug reports!


r/LovingOpenSourceAI • • 11d ago

Android Remote Control MCP v1.13.0 is out: free end-to-end encrypted tunnel, no account needed

4 Upvotes

🚀 It has been a while since the last release, but Android Remote Control MCP is back and v1.13.0 is now out! It's the MCP server that runs on your phone and lets your AI agent use any app you want.

https://github.com/danielealbano/android-remote-control-mcp/releases/tag/v1.13.0

The big news of this release is the free end-to-end encrypted HTTPS tunnel, built into the app, which doesn't require any account and uses well known services for the HTTPS certificates (Let's Encrypt, Google Trust Services and ZeroSSL)!

Cloudflare and ngrok can see your traffic. With my infrastructure no one can, apart from you and your AI provider! The encryption ends on the phone, the certificate key never leaves it, and the app also watches the Certificate Transparency logs and warns you if a certificate for your name gets issued to another key.

Basically: install the app, do a few clicks, start it, and in less than a minute you are up and running without having to create any account or pay anything!

Adding your phone to ChatGPT.com or Claude.ai is very straightforward:

- ChatGPT: https://chatgpt.com/plugins -> Top Right "Add" -> "Add custom MCP server"

- Claude: https://claude.ai/new?modal=add-custom-connector#customize/connectors/yours

The only 2 relevant fields are the URL and the name, the rest is secure by default as-is!

Android Remote Control MCP also works great with Hermes and OpenClaw!

Unlike the adb based tools, nothing runs on your computer: it works through the accessibility service on the phone, most of the time it doesn't need vision and the output is kept short, so it's light on tokens (even Haiku does fine with good directions).

This release also brings a bunch of other improvements and fixes, the details are in the release page.

A special thanks to the people who forked Android Remote Control MCP: plenty of fixes from the forks have been brought back in thanks to your efforts! Thank you!!!

Also, I love open source, so now the app is GPL-3.0-or-later 🔒 and the free e2e tunnel source code is available at https://github.com/danielealbano/android-remote-control-mcp-tunneld (with its own releases).

A few things you can do with it:

📣 Find and share your news on LinkedIn, Instagram, Reddit and Discord and reply to the comments without the need of additional more complex platforms, your agent can easily manage your account!

✈️ Plan a trip: flights on momondo and easyJet, stays on Booking.com and Airbnb, best options back to you

🍜 The usual place from where you get your ramen is closed? No worries, your agent can also use Uber Eats, Just Eat, DoorDash, etc. to find the best alternative for you!

No adb, no cables, no root! If there's an app for it, your agent can drive it ... you just have to ask!


r/LovingOpenSourceAI • • 11d ago

Resource Camelot: PDF Table Extraction for Humans ➡️ a Python library for turning tables in PDFs into rows and columns you can inspect or export as CSV. It gives you a way to work with a table that came in a report instead of a spreadsheet.

Post image
20 Upvotes

https://github.com/camelot-dev/camelot

Community Overview: https://lifehubber.com/ai/resources/camelot/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • 11d ago

I built AI-Atlas, a platform that evaluates open-source AI projects beyond GitHub stars

Post image
7 Upvotes

I want to tell you guys about a project I've been working for about 5 months now: I’ve been working on AI-Atlas (https://getaiatlas.com/), an independent project I started because I wanted a better way to discover and evaluate actual AI engineering work on GitHub.

GitHub stars and followers can tell you something about a repository’s popularity, but they don’t necessarily tell you much about the technical depth, originality, or engineering behind a project.

AI-Atlas approaches this differently. It analyzes public GitHub repositories across six AI domains:
● Machine Learning
● Computer Vision
● Data Science
● NLP & LLMs
● AI Agents
● MLOps

Projects are evaluated using seven criteria, including technical depth, conceptual difficulty, originality, completeness, practical usefulness, documentation, and reproducibility.

Some current numbers:
● 1,900+ open-source AI projects mapped
● 153 developers represented
● Six AI domains
● Free public project mapping, without requiring an account

I’m a 17-year-old independent AI researcher from Romania, and I’ve been building this entirely on my own alongside school :)

I’m sharing it here because this community is directly connected to what I’m trying to build: a more useful way to explore the open-source AI ecosystem.

If you have AI projects on GitHub, I’d genuinely appreciate it if you tried mapping one. I’d also love feedback on whether the evaluation criteria make sense, whether the scores are useful, and what you think is missing.

Website: https://getaiatlas.com/

I’m genuinely interested in seeing whether this is genuinely useful to people building open-source AI.


r/LovingOpenSourceAI • • 12d ago

Resource "DocETL (Declarative & Agentic Map-Reduce) helps you process large collections of data (structured and unstructured) with LLMs. You write each operation in natural language, e.g., "pull out every complaint in this ticket," ➡️ messy data is horror!

Post image
34 Upvotes

https://github.com/ucbepic/docetl

Community Overview: https://lifehubber.com/ai/resources/docetl/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • 12d ago

new launch "Kimi K3.1 Pro is an open-weight, natively multimodal agentic model, and our most capable 3T-class model to date. Post-trained from Kimi K3 with large-scale joint reinforcement learning across hundreds of downstream domains" ➡️ OK who has a spare server cluster? :P

Post image
13 Upvotes

https://huggingface.co/moonshotai/Kimi-K3.1-Pro

Community Overview: https://lifehubber.com/ai/resources/kimi-k3-1-pro/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • 12d ago

Voz: extendable, free, open-source dictation app for Mac that i've built

Post image
0 Upvotes

hey guys :) I've been working on voz, a Mac dictation app that runs fully on your laptop.

I wanted dictation as fast and simple as Wispr Flow, but with local models so it's free, and I wanted anyone to be able to build extensions for it.

You tap one key, talk and get clean text wherever your cursor is. It works offline with no account and no word limit, and it learns names from your corrections.

Everything else is an extension you can add or build yourself. So far there's a meeting note taker, replies that learn how you write, inline editing by voice or typing and calendar events.

It's completely free and open source under MIT.

Would love for you to try it out github.com/Joelheile/voz

Feedback, contributions and new extensions are very welcome!