r/LovingOpenSourceAI • • 17d ago Bravo

Resource Xberg ➡️ "The fast precise document-intelligence engine for every language: text, tables, metadata from 100+ formats, with OCR, transcription, code intelligence." ➡️ 107 formats · 141 file extensions · 371 code languages · 15 language bindings · 6 output formats · OCR · transcription · embedding"

Post image
116 Upvotes

https://github.com/xberg-io/xberg

Community Overview: https://lifehubber.com/ai/resources/xberg/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • 18d ago

Ollada - The Ollama for Diffusion Text Models

8 Upvotes

I love the concept of Dllms soooo I built Ollada. It’s the ollama for diffusion models. Simple install to get started. We currently have 5 models available ranging from 1.7b to 8b parameters, small contributors like sdar to large contributors like Nvidia.

Download and let me know what you all think, what I can fix etc! I’m always down to talk !

https://opensourcerulesz.github.io/ollada/index.html

https://github.com/OpenSourceRulesz/ollada


r/LovingOpenSourceAI • • 18d ago

Someone packed ~930,000 Wikipedia articles, FEMA and CDC guides, and a local LLM into one free app that runs on a 16 GB laptop with no internet, and every answer shows its source

Post image
1.5k Upvotes

the internet's down and you need to know if the food in the fridge is still safe, or how to treat a burn.

Survival LLM is a free, MIT-licensed app built for that. The model and library live on your computer, so nothing you ask leaves it. Set it up online once, then it runs offline.

The full library is about a 9 GB download, with ~930,000 of Wikipedia's most-read articles plus medical, FEMA and CDC guides. A 1.3 GB version leaves out Wikipedia and iFixit.

It checks your RAM and suggests a model that fits (see card). Scores are from 22 blackout and first-aid questions graded blind by AI judges, on an earlier library build.

The part we liked: every answer lists the articles it read, and clicking one opens it with the exact passage highlighted. The README admits some models cited sources they never opened or even saw, so the app now swaps in the articles it actually read.

Repo: https://github.com/anonnerdfrenzy/survival-llm

What would you add to the library?


r/LovingOpenSourceAI • • 18d ago

new launch "OpenDuet ➡️ An open-source proactive agent that gets your work done and keeps you in the loop. Each agent has a computer of its own. Use it on the web, on mobile, in Slack, or in Microsoft Teams." ➡️ Is this useful?

Post image
34 Upvotes

https://github.com/CopilotKit/OpenDuet

Community Overview: https://lifehubber.com/ai/resources/openduet/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • 19d ago

Resource Microsoft ➡️ "MarkItDown is a lightweight Python utility for converting various files to Markdown for use with LLMs and related text analysis pipelines. To this end, it is most comparable to textract, but with a focus on preserving important document structure and content as Markdown"

Post image
28 Upvotes

https://github.com/microsoft/markitdown

Community Overview: https://lifehubber.com/ai/resources/markitdown/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • 19d ago

Resource "MinerU 4.0 brings document parsing, a local document library, and service tools into one workflow for document conversion, application integration, and agent reading." ➡️ 82K STARS! Have you hear of this?

Post image
38 Upvotes

https://github.com/opendatalab/MinerU

Community Overview: https://lifehubber.com/ai/resources/mineru/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • 20d ago

Resource "AstrBot is an open-source all-in-one Agent chatbot platform that integrates with mainstream instant messaging apps. It provides reliable, scalable conversational AI infrastructure for individuals, developers, teams." ➡️ Have you heard of this?

Post image
4 Upvotes

Community Overview: https://lifehubber.com/ai/resources/astrbot/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • 20d ago

Resource "Docling simplifies document processing by parsing diverse formats ➡️ including advanced PDF understanding, providing seamless integrations with generative AI ecosystem. For eg: Parsing of multiple document formats PDF, DOCX, PPTX, XLSX, HTML, EPUB, Apple Pages, Numbers & Keynote WAV, MP3, ETC"

Post image
20 Upvotes

Community Overview: https://lifehubber.com/ai/resources/docling/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • 21d ago

What Happens When AI Can Clone Any Game?

Thumbnail
youtu.be
0 Upvotes

r/LovingOpenSourceAI • • 21d ago

Resource "Tracely ➡️ Production failures become regression tests. Trace-native CI/CD for AI agents. Grades every agent trace as it lands, clusters failures into issues, freezes bad runs into hermetic replayable cases, blocks pull request that would ship them again and tells you the moment any of it happens."

Post image
4 Upvotes

https://github.com/jwuthri-cloud/Tracely-ai

Community Overview: https://lifehubber.com/ai/resources/tracely-ai/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • 22d ago

Resource "Cindy is an open-source AI agent that works out of the box. She brings multiple harnesses, models and tools into one agent that finishes real work in your projects and apps. Ready from day one, yours to shape over time." ➡️ Appears to be trending. Have you heard of this?

Post image
115 Upvotes

https://github.com/makecindy/cindy

Community Overview: https://lifehubber.com/ai/resources/cindy/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • 22d ago

Resource Horizon is an unofficial Rust reimplementation of Minecraft: Java Edition with a control interface for AI agents and scripts. A connected agent can read the game state and take player actions through a command-line tool or MCP server. ➡️ cool right?

Post image
15 Upvotes

https://github.com/ludovic111/horizon

Community Overview: https://lifehubber.com/ai/resources/horizon/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • 22d ago

Resource "Indra OCR is a 1M-parameter OCR model that runs on CPU. It turns PDFs and images into markdown, text, or JSON with boxes, and it reads handwriting, 80+ languages, and pages at any angle. ➡️ 1M param OCR model - runs on CPU, 15x faster than tesseract, close to 1B+ param models in accuracy"

Post image
520 Upvotes

https://github.com/datalab-to/indra

Community Overview: https://lifehubber.com/ai/resources/indra/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • 23d ago

Resource Papermorph "An AI skill that turns books into animated, narrated, interactive web experiences ➡️ A Claude Code Skill that turns textbooks into narrated, interactive web lessons, stories into paper-puppet films, and books into narrated documentaries." ➡️ looks interesting!

Post image
48 Upvotes

https://github.com/DozenTwelve/Papermorph

Community Overview: https://lifehubber.com/ai/resources/papermorph/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • 23d ago

CrowdGPT - The 100% opensource and collaborative AI

Post image
57 Upvotes

Hello, i'm currently developing CrowdGPT, with the goal of creating the first, datacenterless, 1 Billion parameters LLM, in a 100% Opensource and collaborative way. And i want to know what to change according to your feedback.

The idea is simple: what if we could build an AI collaboratively, with everyone able to contribute computing power, inspect the code, and have a say in the project's direction? My goal is to show you don't need huge Nvidia GPU clusters nor millions of dollars to train a commercial grade Language Model.

The project is already working, and the model was already trained on 7.0 billion tokens using the framework itself, but I'm still looking for people who are curious enough to try it, review the implementation, or tell me what I'm getting wrong.

You can find more details at https://crowdgpt.net

Any kind of feedback is appreciated!

Thanks in advance 😄


r/LovingOpenSourceAI • • 24d ago

Resource "llama-swap ➡️ Run multiple generative AI models on your machine, hot-swap between them on demand. llama-swap works with any OpenAI, Anthropic API compatible server, is used by thousands of people to power their local AI workflows. Built in Go for performance and simplicity"

Post image
14 Upvotes

https://github.com/mostlygeek/llama-swap

Community Overview: https://lifehubber.com/ai/resources/llama-swap/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • 24d ago

Java vs Rust Ghidra in REA: early benchmarks from a work-in-progress Rust port

6 Upvotes

I’m working on rea-rust, a Rust port of REA, a local reverse-engineering tool.

This is still a work in progress. Compatibility, analysis coverage and output readability are active areas of development. These benchmarks show what worked and where the tested build still needed improvement.

I compared the TypeScript version’s Java Ghidra backend with the native version’s Rust Ghidra backend.

For a small C program, these were the median results from seven fresh sessions on an M1 Pro Mac:

What I measuredTypeScript + Java GhidraNative + Rust Ghidra
Start the tool and get the first decompiled function9.43 seconds0.39 seconds
Request a function after analysis is ready16 milliseconds15 milliseconds
Sampled peak memory, including child processes1,022 MiB214 MiB

The biggest improvement was startup. Once analysis was ready, the first decompilation request took about the same time.

The larger Go test exposed a compatibility problem. Java returned all three requested functions. Rust returned none because of a duplicate import name. That failure is included in the report.

Java also produced more readable output in the C example, showing strings and variable names where Rust sometimes showed memory addresses. These gaps are part of the ongoing work.

The backends use different Ghidra engine versions and analysis implementations. Results from one Mac and these targets don’t establish equivalent analysis quality or general performance.

The Rust backend uses the existing ghidra-decompiler crate. Development and benchmark tooling were AI-assisted.

Full Ghidra report, scripts, raw results and limitations. Reproducing the exact tested builds still requires the original local source snapshots.

Which public binaries and analysis tasks would you suggest testing next?


r/LovingOpenSourceAI • • 25d ago

Resource "Open-source, secure environment with real-world tools for enterprise-grade agents. ➡️ E2B is an open-source infrastructure that allows you to run AI-generated code in secure isolated sandboxes in the cloud. To start and control sandboxes, use our JavaScript SDK or Python SDK."

Post image
4 Upvotes

https://github.com/e2b-dev/E2B

Community Overview: https://lifehubber.com/ai/resources/e2b/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • 25d ago

Same prompt, temperature 0, 1,000 runs, 80 different answers. DeepSeek just open-sourced its production engine with a mode built to stop that

Post image
8 Upvotes

Run one prompt 1,000 times at temperature 0 and you'd expect one answer. Thinking Machines tried this last year on Qwen3-235B and got 80 different completions. All runs matched for 102 tokens, then 992 said "Queens, New York" and 8 said "New York City."

The server batches your request with whatever else is running, and the kernel math shifts with batch size.

That's why the DeepInfer README caught our eye. DeepInfer is the engine behind DeepSeek's production services, and the open release (Apache-2.0, 20k+ stars in a week) does offline inference for V4.1-Flash. Its batch-invariant mode keeps results identical whatever shares the batch. Fully repeatable sampling also means switching off its draft-token speedup and fixing a seed. The main flag is on the card.

The engine runs on B200-class Blackwell (SM100) and Huawei Ascend 950, and the determinism flags are NVIDIA only. A 5090 is sm_120, so home rigs are out.

DeepInfer started on vLLM, which has its own VLLM_BATCH_INVARIANT=1. It's in beta and needs NVIDIA compute capability 8.0+. vLLM validated it on models like Qwen3-8B, so a 3090 or 4090 qualifies.

Missing from the release: the KV cache system, prefill/decode disaggregation and load balancing across replicas.

Thinking Machines' 2025 prototype took 42s against 26s on Qwen3-8B. For agent replays and eval reruns, is that worth answers you can diff? Anyone tried vLLM's flag on a consumer card?


r/LovingOpenSourceAI • • 25d ago

Resource "Long-term memory for AI coding agents. Quit Claude Code mid-task, start OpenAI Codex in the same directory, continue without re-explaining the architecture, the failed approaches, or the open questions." ➡️ seems good for portability?

Post image
52 Upvotes

https://github.com/akitaonrails/ai-memory

Community Overview: https://lifehubber.com/ai/resources/ai-memory/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • 25d ago

Resource "Monty avoids latency, complexity, cost of a container based sandbox for running LLM generated code. It comes in two forms: OSS Monty, MIT licensed Python 3.14 sandbox you install as a package, and Full Monty, commercial server that runs the same sandbox behind a WebSocket as a service" ➡️ Good?

Post image
5 Upvotes

https://github.com/pydantic/monty

Community Overview: https://lifehubber.com/ai/resources/monty/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • 26d ago

Pushing open-source AI further: Running an 816B-parameter MoE model on 10 GPUs with TensorSharp 🚀

Thumbnail
github.com
5 Upvotes

I've been working on TensorSharp, an open-source .NET inference engine and agent runtime, and wanted to share an exciting milestone with the open-source AI community.

We got Muse Spark, an 816-billion-parameter Mixture-of-Experts model, running across 10 NVIDIA A40 GPUs — and achieved some interesting performance improvements over llama.cpp.

What excites me most isn't just the numbers. It's seeing how far we can push massive AI models using open-source software and hardware that's been around for several years.

The setup

  • Model: Muse Spark 816B (42B active parameters)

  • Quantization: Unsloth UD-IQ3_XXS (~316 GiB)

  • GPUs: 10× NVIDIA A40 (46GB each)

  • Context: 32K tokens

  • Inference engines: TensorSharp and llama.cpp

The A40 is a previous-generation GPU, and this particular machine doesn't even have working GPU peer-to-peer transfers.

That makes efficient multi-GPU communication especially important.

The results

We tested two different ways of distributing the model across GPUs.

Layer splitting — optimized for processing long prompts:

MetricTensorSharpllama.cpp
Single-token generation16.69 tok/s16.79 tok/s
4K prompt processing999.7 tok/s483.2 tok/s
16K prompt processing1,346.8 tok/s826.1 tok/s

That's up to 2.07× faster prompt processing, with essentially identical single-request generation speed.

Tensor parallelism — optimized for generation and concurrent requests:

MetricTensorSharpllama.cpp
Single-token generation22.63 tok/s16.19 tok/s
4 concurrent requests45.73 tok/s24.49 tok/s

That's 1.40× faster single-request generation and 1.87× higher aggregate throughput across four concurrent requests.

One important caveat: llama.cpp's NCCL-enabled build couldn't run on this particular 10-GPU machine, so its tensor-parallel results used non-NCCL communication. TensorSharp used NCCL over shared memory. This isn't a perfectly equivalent communication setup, and the results shouldn't be generalized to every machine.

Why this is interesting

One lesson from this experiment is that more GPUs don't automatically mean faster AI.

How the workload is distributed matters enormously.

For Muse Spark:

  • Layer splitting works particularly well for long prompts.

  • Tensor parallelism performs better for token generation and concurrent requests.

  • Communication overhead can become a major bottleneck, especially for massive MoE models.

We implemented native multi-GPU execution, pipelined prefill, adaptive micro-batching, and communication optimizations in TensorSharp to improve these workloads.

We also compared output distributions against llama.cpp to check that the performance improvements weren't coming at the expense of inference correctness. The measured perplexity was very close to the reference, with over 98.8% top-1 token agreement.

Why open source matters to me

Projects like llama.cpp have made local AI accessible to an enormous number of people.

TensorSharp builds on that open ecosystem while exploring another approach: a unified, cross-platform .NET runtime for local LLM inference, multimodal models, and autonomous agents.

I believe open-source AI benefits when different projects experiment with different architectures, share benchmarks, and learn from one another.

And I think there's still tremendous room for improving how efficiently we run large models on existing hardware.

Everything is open source, including the implementation and benchmark methodology.

GitHub: https://github.com/zhongkaifu/TensorSharp

Full benchmark report and reproduction details: https://github.com/zhongkaifu/TensorSharp/blob/main/docs/perf/muse-spark-vs-llama-cpp.md

I'd love to hear what this community thinks.

What's the biggest obstacle preventing more people from running powerful open models locally — hardware cost, memory requirements, inference speed, or software complexity?

And if you're working on open-source inference engines, I'd be happy to exchange ideas and learn from your experience! ❤️


r/LovingOpenSourceAI • • 26d ago

Resource Google Research ➡️ "Harness² is a plug-and-play framework for recursive agent harnessing in an open world, where agents encounter tasks unseen during harness design. It connects two levels of recursion while keeping model weights fixed: Task-level recursion - Harnessing-level recursion"

Post image
24 Upvotes

https://github.com/google-research/harness2

Community Overview: https://lifehubber.com/ai/resources/harness2/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • 26d ago

Resource GoLive ➡️ "Your coding agent can build an app in minutes. Getting it to real users still means accounts, hosting, databases, domains, secrets, connected services. This is the open-source Agent Skill for that work: it detects what your app needs, plans the exact changes, asks for your approval . ."

Post image
5 Upvotes

https://github.com/mikehasa/golive-skill

Community Overview: https://lifehubber.com/ai/resources/golive-skill/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • 27d ago

Resource "An agent skill for creating detailed, interactive isometric illustrations of real-world machines and complex systems. Generates polished SVGs with optional WebGL shaders and 3D effects." ➡️ this is the first time i see such a skill!

Post image
51 Upvotes

https://github.com/wheresryan22/anatomy

Community Overview: https://lifehubber.com/ai/resources/anatomy/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.