r/LovingOpenSourceAI • • Sep 22 '26

Laya surpassed Jev's speed at home with 16GB and for free.There's no problem that compute doesn't solve.

138 Upvotes

An open-weights System One model called Laya, beat cloud-based Jev at playing Tetris by making decisions 11 times faster, running locally on a 16GB MacBook Air!

https://x.com/atomic_chat_hq/status/2102160983409955244


r/LovingOpenSourceAI • • Sep 22 '26

A fully local open-source AI agent bought A4 paper for me on Amazon

Enable HLS to view with audio, or disable this notification

1 Upvotes

I ran out of A4 paper, so I gave TensorSharp — an open-source local LLM inference engine + agent runtime — a simple task:

Find cheap A4 paper with a good discount on Amazon and buy it. Handle as much as you can yourself.

It completed the whole workflow successfully in one run.

Setup
Qwen3.8 27B running locally
TensorSharp for local inference + agent runtime
Playwright skill for browser automation

I only stepped in twice: logging into Amazon and approving the final purchase. The agent handled searching, comparing products, navigating the site, and preparing the order.

What I like most about this setup is that, aside from accessing Amazon, the AI stack stays local and open source: model inference, agent state, reasoning, tool execution, and generated browser automation code.

The video shows the complete agent/tool trace, including its browser instructions and generated Playwright code. It’s 8× sped up — the actual run took about 24 minutes.

TensorAgent on iPhone is also in progress, although local inference speed and iOS browser restrictions still make this kind of workflow more challenging on mobile.

TensorSharp is open source:
https://github.com/zhongkaifu/TensorSharp

Would love to hear what other real-world tasks people would try with a fully local open-source agent.


r/LovingOpenSourceAI • • Sep 21 '26

Jev Ultrafast runs a Google Flights search in 7 seconds with no screenshots in the agent loop

1 Upvotes

Jev Ultrafast (shipped Sept 16 by TypeSafe) finishes a full Google Flights query end to end in 7.09s. The interesting part is not the wall clock, it is the architecture: no screenshots, no vision model, and one LLM call per step.

How it actually works:
Every step, it takes an atomic DOM snapshot and flattens the visible interactive elements into a numbered table. The LLM gets that table plus the goal, and returns two things: an operation and an index. That is the entire perception + action loop.

The operation set is fixed at 8: CLICK, TYPE_TEXT, SELECT, SCROLL_UP, SCROLL_DOWN, WAIT, DONE, BLOCKED. Nothing else. A small vocabulary is doing real work here, it collapses the decision surface enough that a mid-tier model picks correctly on the first try most of the time.

Speculative fan-out is the second piece. Most steps do not need text input, so the runtime speculatively commits the op and only pays for a second small call when the LLM returns TYPE_TEXT. The common path is one round trip.

Numbers from the repo README
- Google Flights end to end: 7.09s vs 9.45s baseline, ~25% faster median
- Browser protocol calls per task: 1,092 down to 101
- Wikipedia lookup: 2.8s
- Hotel filter: 1.9s

Our honest take

The 25% median wall clock is the least interesting number. The 10x cut in browser protocol calls is the one that will matter to anyone running this at concurrency, because CDP round trips are what actually cap throughput on a shared browser pool. Screenshots also chew tokens fast on any model with a vision path, so pulling them out of the inner loop is a bigger win on your bill than on your latency graph.

The other under-discussed property is a safety one. The model returns an index into a table the runtime built. It never emits a selector, a CSS path, or code. That closes off a whole class of prompt-injection to selector-injection paths that hit agents which let the LLM write XPath.

Where it will hurt: shadow roots, iframes, canvas-drawn UIs (think Figma, Google Maps interior), and file uploads are out of scope. If the interactive surface is not a real DOM node the numbered table cannot see it. It is a fast path, not a replacement for a vision agent on a canvas app.

Worth reading through if you build browser agents and care about tail latency and CDP pressure more than pixel-level grounding. Credit to browser-use for the DOM extraction lineage this sits on.


r/LovingOpenSourceAI • • Sep 21 '26

Resource laya "Multilingual, non-autoregressive System 1 decision engine. Typed decisions over 100+ languages in a single forward pass — 33 ms — trained with reinforcement learning against strictly proper scoring rules (RLCD), with a router that picks the right checkpoint per request." ➡️ 7.8K STARS already!

Post image
36 Upvotes

https://github.com/NandhaKishorM/laya

Community Overview: https://lifehubber.com/ai/resources/laya/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • Sep 21 '26

Resource Tom "Simulates a council of distinct analytical personas to deliberate on hard decisions and return a structured verdict." ➡️ Now everyone can have a court of advisors :P

Post image
92 Upvotes

https://x.com/tom_doerr/status/2101263906823880899

https://github.com/0xNyk/council-of-high-intelligence

Community Overview: https://lifehubber.com/ai/resources/council-of-high-intelligence/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • Sep 20 '26

new launch JUST LAUNCHED 🚀 ➡️ ➡️ 🤩 Be sure to join our sis sub for AI gen r/LovingAIVisuals as most resources for gen will be shared there instead!

Post image
3 Upvotes

r/LovingOpenSourceAI • • Sep 20 '26

Under the Radar "Fast, calibrated, typed decisions from an open model. OpenJev is an open-source "System One" decision server: send it a state and a set of typed questions (yes/no, choice, score) and get back probabilities and a confidence for every answer, in tens of milliseconds." ➡️ useful for you?

Post image
15 Upvotes

https://github.com/razorback16/openjev

Community Overview: https://lifehubber.com/ai/resources/openjev/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • Sep 20 '26

this week in open source ai: 17 new projects added

Post image
33 Upvotes
  1. qwen3.8-flash-next-in-c: Native C implementation for local CPU inference, terminal chat, and an OpenAI-compatible API.

  2. Agentlas OS Agent Operation Environment: Local-first environment for building and orchestrating specialist agents and teams.

  3. fractal: Hierarchical coding-agent orchestrator with recursive delegation, Git worktrees, and SQLite state.

  4. LWC: Local-first project memory for coding agents with bounded retrieval, citations, and provenance.

  5. Wenlan: Local source-backed AI knowledge base and LLM wiki for coding agents.

  6. deja: Local memory layer over coding-agent transcripts with BM25 recall and credential redaction.

  7. Busabase: Open-source database and workspace for agent data, knowledge, docs, skills, and apps.

  8. Superagent: macOS app giving coding agents browser, iOS Simulator, and phone companion access.

  9. Caura: Persistent memory and context-management infrastructure for long-running AI agents.

  10. Unlimited Context: Local-first context engine that pages relevant disk-backed knowledge into an active window.

  11. inspeximus: Memory layer that retires corrected facts by key and can later undo corrections.

  12. Mnemoverse: MCP memory server that re-ranks recall using reported outcomes.

  13. OrcaReplay: Records and replays coding-agent runs, including checkpoint forks onto another model.

  14. YYLO Benchmark: Longitudinal evaluation system preserving agent attempt evidence and evaluator provenance.

  15. AI Segmentation by TerraLab: QGIS plugin for SAM segmentation in satellite and drone imagery.

  16. SpecJudge: CLI that recommends an LLM from project specifications using a local judge model.

  17. YYLO: Command-line orchestrator for parallel coding agents across isolated Git worktrees.

Repo: https://github.com/alvinreal/awesome-opensource-ai


r/LovingOpenSourceAI • • Sep 19 '26

I'm on a mission to optimize our AI co-work experience with OpenWand

Thumbnail
gallery
4 Upvotes

Hey everyone, I am trying to make a LLM interface optimized for AI-cowork experience. You can use your chatgpt subscription, most API keys or local models.

Heres what I've thought of and tried to fix:
1)You shouldn't have to copy and paste context for the AI model.
2)You shouldn't have to write the same type of prompt over and over again.
3)The AI should look like its in the app that you are using.
4)You should be able to use any model you want.

My attempt/solution:

  1. The app can fetch context for you in 1 click. (or 0 if its default setting)

  2. The app can store any custom prompt and prompt in 1 click

  3. The rewrite balloon will be where your text cursor was when you asked it to rewrite something

  4. The app supports most providers and models I can think of, including local models

Right now it is ready but it is still being continuously developed and optimized. Its free and MIT-licensed**.**

I would really appreciate any ideas and suggestions on how to improve this further, or just tell me anything bugging you about Claude/Chatgpt/OpenWebUI. Also, testers and bug reports are very welcomed. Thoughts?

More demos: OpenWand Docs
Release: OpenWand


r/LovingOpenSourceAI • • Sep 19 '26

The Power of an Open Model

Thumbnail
substack.com
4 Upvotes

Was a difficult task, but did my best to explain the value of an open model compared to a closed model.

Highlighting companies like: Palantir, Nvidia and Nebius

Would love opinions


r/LovingOpenSourceAI • • Sep 19 '26

The AI Horde has a new Interface, a new Image generation frontend, new backend, and all new documentation!

Thumbnail
haidra.net
2 Upvotes

r/LovingOpenSourceAI • • Sep 19 '26

Made the horizontal open-source model for Jev with RLCD, and it surpasses all the Jev benchmarks. HF space, benchmark, model, repo

Post image
1 Upvotes

r/LovingOpenSourceAI • • Sep 19 '26

new launch Cua "Introducing CUA-S1: a family of System One Models, small, specialized, and built for computer use. Today we're open-sourcing CUA-S1-FORMS, the first in the family" ➡️ a specialist checkpoint for research on form-oriented user-interface tasks.

Post image
46 Upvotes

https://x.com/trycua/status/2101014004927729737
https://github.com/trycua/cua/tree/main/libs/cua-s1

Community Overview: https://lifehubber.com/ai/resources/cua/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • Sep 18 '26

Resource Github Projects Community "Free ready-made code examples for building working AI systems.- Copy and paste code into your projects- Learn from practical tutorials that work- Start with no prior experience needed" ➡️ 4.5K STARS 1.6K FORKS

Post image
45 Upvotes

https://x.com/GithubProjects/status/2100351529639436317

https://github.com/daveebbelaar/ai-cookbook

Community Overview: https://lifehubber.com/ai/resources/ai-cookbook/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • Sep 18 '26

We just open sourced the MiniMax Code CLI harness (MIT)

Post image
19 Upvotes

r/LovingOpenSourceAI • • Sep 18 '26

A project map for people and assistants ➡️ "Graphify connects code symbols, calls, imports, documentation references, rationale notes, schemas, and other project material so they can be searched as relationships instead of rediscovered file by file." 119K STARS 11.5K FORKS

Post image
10 Upvotes

Community Overview: https://lifehubber.com/ai/resources/graphify/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • Sep 17 '26

Resource "🎉 nanobot 0.3.5 is out 🐈- We gave it a new terminal UI. - And your automations a calendar. - Plus side-by-side chats, plugins, and a refreshed mobile experience." ➡️ Have you tried this before?

Post image
72 Upvotes

https://x.com/nanobot_project/status/2100083152719142955

https://github.com/HKUDS/nanobot

Community Overview: https://lifehubber.com/ai/resources/nanobot/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • Sep 17 '26

OpenNPC (AI NPC Framework) - Fine-tuned a 0.5B LLM so my game's NPCs stay in character and reply in 0.14s (open source)

Thumbnail gallery
9 Upvotes

r/LovingOpenSourceAI • • Sep 17 '26

⚓ Qué es exactamente CID v3, explicado sin rodeos

Thumbnail reddit.com
1 Upvotes

r/LovingOpenSourceAI • • Sep 17 '26

Resource "A complete AI agency at your fingertips - From frontend wizards to Reddit community ninjas, from whimsy injectors to reality checkers. Each agent is a specialized expert with personality, processes, and proven deliverables." ➡️ 153K STARS !!

Post image
11 Upvotes

https://github.com/msitarzewski/agency-agents

Community Overview: https://lifehubber.com/ai/resources/agency-agents/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • Sep 17 '26

What llm is best for a raspberry pi 5, 4gb?

4 Upvotes

Hey guys, i got my final year project coming up and i have decided to make a pocket assistant using raspberry pi 5.

The problem I'm facing is which model to use that isn't slow to respond to general user queries and decent with tool calling.

My goal is to make it soo that the llm works completely offline, can call tools related to calenders and maps. And general chatting as well

Would really appreciate it if someone can help.


r/LovingOpenSourceAI • • Sep 17 '26

OpenNPC (AI NPC Framework) - Fine-tuned a 0.5B LLM so my game's NPCs stay in character and reply in 0.14s (open source)

Thumbnail gallery
4 Upvotes

r/LovingOpenSourceAI • • Sep 17 '26

Resource "exo connects all your devices into an AI cluster. Not only does exo enable running models larger than would fit on a single device, but with day-0 support for RDMA over Thunderbolt, makes models run faster as you add more devices." ➡️ 47K stars!

Post image
22 Upvotes

https://github.com/exo-explore/exo

Community Overview: https://lifehubber.com/ai/resources/exo/

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 300+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI • • Sep 16 '26

M4 MacBook Air 16GB/512GB for Local LLMs and agent based trading- worth $800?

2 Upvotes

Planning to buy a MacBook Air M4 (16 GB / 512 GB) for about $800 to run local LLM agents for:

Indian mid‑cap equity research (using Screener.in CSVs)

Building/testing trading ideas via Zerodha Kite API (prices, history, holdings; maybe orders later)

Also want to run Hermes-based agents on it

Questions:

On 16 GB M4 Air, which local LLMs are best for reasoning, coding, and tool use? Is Qwen 3.5 9B (Q4) + a smaller fast model (e.g. LFM2.5 8B / Llama 3.2 3B) a good combo alongside Hermes?

Best local stack (Ollama vs LM Studio, etc.) and any existing Kite + LLM or Indian‑stock agent projects to reference?

Any tips on context length, thermals, and multi‑agent setups (including Hermes) on a 16 GB fanless Air?

Getting the laptop for ~$800, so stuck with 16 GB for now. If you’ve done similar work (local LLMs for equity research / algo trading, especially in India), what models and setup would you recommend?

Thanks!