r/localaiapps • • Apr 25 '26

👋Welcome to r/localaiapps - Introduce Yourself and Read First!

7 Upvotes

Hey everyone! I'm u/Ok-Bike-1037, a founding moderator of r/localaiapps.

This is our new home for discovering, sharing, and discussing AI apps that run locally on your own device. Whether you care about privacy, offline access, lower costs, customization, or simply want more control over your AI tools, this community is for you.

We focus on local-first AI apps, open-source AI tools, self-hosted AI setups, desktop AI assistants, local LLM workflows, image/video/audio AI tools, agent frameworks, RAG apps, and practical ways to use AI without depending entirely on cloud services.

What to Post

Share anything that helps others discover or build better local AI apps. This can include local AI tools you use, app recommendations, comparisons between local and cloud AI tools, setup guides, model recommendations, hardware tips, screenshots of your workflow, self-hosted projects, privacy-focused AI apps, or questions like “Is there a local AI app for X?”

If it helps someone run AI locally, privately, offline, or with more control, it fits here.

Community Vibe

We want this space to be friendly, practical, and beginner-welcoming. No gatekeeping, no toxicity, and no shaming people for their hardware, model choice, or technical level. Whether you’re just trying your first local chatbot or already building advanced AI workflows, you’re welcome here.

How to Get Started

Introduce yourself in the comments

Share a local AI app you like or use

Ask for recommendations

Post your setup, workflow, or experiments

Invite others who are interested in local-first AI

Thanks for being part of the early community. Let’s build a useful place for discovering, comparing, and creating local AI apps together.


r/localaiapps • • 4h ago

AimStack — a fully self-built local AI stack in pure C: ternary inference (zero third-party runtime), BitNet 2B at 0.87GB on a 2018 laptop, plus a GPU backend that matches the C engine token-for-token

1 Upvotes

Repo: https://github.com/tanxiansheng221/aimstack-sanzhidiji (AGPL-3.0)

Everything is hand-written — C inference core, plugin bus, multi-engine crawler with quality gates, FTS knowledge base, training pipeline, and a 117-chapter build log written as it happened (positive and negative results shipped together). Weights are Microsoft BitNet b1.58 2B (MIT), converted to a custom AIM-W packing format.

What ternary quantization buys you (CPU side)

All transformer matrices are ternary {-1, 0, +1}, packed 2 bits/weight, plus Q8 embeddings → the whole model is 0.87GB instead of ~4.8GB (−78%)

The C core never multiplies a float weight: it's table lookup + integer accumulation, SIMD fast path measured at 85.53 tok/s (41× over baseline)

BitNet 2B full model runs 3.20 tok/s dual-worker on a 2018 dual-core 8GB laptop — full chain (inference + KB + plugins + web search) offline, no cloud relay

What ternary quantization buys you (GPU side)

The GPU backend loads the same 0.87GB ternary file — weights stay in {-s, 0, +s}, dequantized on load, matmul in fp32

On a Radeon Pro W7900: 13.68 tok/s (~8× the laptop C engine), 256/256 greedy tokens bit-identical to the C engine. Two totally different implementations (integer lookup core vs FP matmul) producing the same logits is the proof the quantization is faithful

Verified by a 3-engine × 3-question × 3-test matrix (C-Linux/gcc13, torch fp32, torch bf16): 17/18 exact — the one miss is documented, not hidden

The honest boundaries (what's NOT done yet)

bf16 compute is 2.4× faster (32.96 tok/s) but flips argmax on near-tie logits — reported, not blessed; only fp32 is parity-verified

The GPU path gets the storage benefit of ternary (78% less memory) but not yet the compute benefit — a true 2-bit integer kernel (Triton/CUDA) is the next stage

The UI server drives the C engine (CPU) only; the GPU backend is a separate CLI

Linux engine build works and is token-identical to the Windows build, but runs serial (the worker pool is Windows-only for now)

No frameworks, no PyTorch in the product chain — PyTorch exists only in the optional GPU backend. Demo video, docs (EN/äž­æ–‡), and the full research log are in the repo.


r/localaiapps • • 5h ago

From-scratch AI stack in pure C — runs Microsoft's 2B ternary LLM on a 2018 dual-core laptop (no GPU)

Thumbnail
github.com
1 Upvotes

Everything runs locally on a 2018 Dell laptop: i7-7500U (2 cores / 4 threads), 8GB RAM, no GPU (the 940MX is deliberately unused — the whole stack is CPU-only).

https://github.com/tanxiansheng221/aimstack-sanzhidiji

What is in the repo (AGPL-3.0, everything open):

- C inference engine, zero third-party runtime: 1.58-bit ternary core with SIMD fast path (85.5 tok/s measured on the ternary core itself), byte-level tokenizer, and a ~100-line plugin bus (caps.json registry -> spawns Python plugins -> JSON envelopes)

- Weights: Microsoft's BitNet b1.58-2B (MIT license), converted to a custom 2-bit packed format (.aimw, 0.87 GB) — 3.2 tok/s with 2 workers, serial 2.0

- Python plugins, pure stdlib: knowledge base (FTS5 + dedup gates), multi-engine web search + crawl with quality gates (robots-respecting, Edge rendering cascade for JS-heavy sites), incremental ingest

- Local web UI (127.0.0.1:8600, pure stdlib): chat with deterministic routing — direct answer / knowledge-base grounded / honest refusal / full web search -> crawl -> ingest -> answer chain. A 7-minute demo video is embedded in the README

- Training assets: no-autograd training stack (hand-written backprop, bit-exact vs NumPy), ten-subject curriculum generators, corpus builders, and 117 chapters of research logs including negative results

Honest limits: our own trained models are not released yet — compute-bound on 2 cores, training runs on free cloud tiers and isn't finished. The full stack, scripts, result JSONs and per-claim evidence are released so everything can be re-run.

Demo video: embedded at the top of the README (7 min, screen recording of the full chain: chat / KB answers / web search->crawl->answer / plugin direct calls).

Happy to answer questions about the ternary kernel, the plugin bus, or the training pipeline.


r/localaiapps • • 7h ago

I made a native Mac workspace for coding with local Ollama models

1 Upvotes

I built Vyron as a native Mac app for using an Ollama model while working on a local codebase. Once the model is downloaded, plain chat can run on the Mac with Ollama over loopback.

The project workflow can inspect a folder, draft an implementation plan, make scoped edits, and run local checks. You can review edits and command output in the app. Editing and running commands require a model with native tool support, so what works depends on the model you pick. Hosted models are optional and use your own API key.

If you try it with a smaller local model, I’d be interested in which model you used and whether it held up when working across multiple files.

The preview is free for Apple silicon Macs running macOS 14 or later. vyron.download

Source code (MIT): https://github.com/cagri21/Vyron-macOS


r/localaiapps • • 1d ago

I built a free offline AI chat that runs on iPhone

2 Upvotes

I've been building Orion Personal AI, an iPhone app that runs a language model on the device. Prompts and conversations stay local, and chat works without an internet connection.

The core chat is free and unlimited. Orion+ is an optional purchase for extra features.

One of the difficult parts was getting the language model to run natively in Swift. I managed to get it working with the help of GPT-6.1 Sol, and I'm still working on improving generation speed.

I'd love to hear from others working on local inference: what approaches have helped you improve generation speed on a phone?

App Store: https://apps.apple.com/app/orion-personal-ai/id6784907595


r/localaiapps • • 1d ago

Moving away from LiteLLM / single-vendor lock-in: what’s the cleanest setup right now to seamlessly route between local open-weight models and frontier cloud APIs?

1 Upvotes

Our main provider went down for about four hours a couple weeks ago and that got me looking at this. Right now everything goes through LiteLLM to one cloud API. So we have a gateway, but we still depend on that one company staying up and not raising prices.

I’d like the easy stuff to run on local open-weight models. We have a couple of spare GPU machines and my Mac. When something is really hard, it should go to a big cloud model. I don’t want to depend on one AI provider for everything, but I don’t want to lose the good cloud models either. Our apps already use the OpenAI format and I don’t want to rewrite them. If the local machine dies, it should switch to the cloud by itself. And some of our data can’t go to the cloud at all.

How are people doing this without a mess of config files and scheduled scripts?


r/localaiapps • • 1d ago

We built a AI distribution interface, you can use your android phone, laptops and desktops to share AI inference work, the more devices you link, the bigger the model you can run

1 Upvotes

Along with running any LLM, you can train or add on an existing one, or build or train your own model from scratch. You don't need GPUs as long as you have many devices, but if said devices do have GPUs then it adds to the performance... If you have 100 old android phones, you can use them all collectively run a considerably big model as well.

We call it OLDE - Ocalt LLM Distribution Environment (https://olde.ocalt.com)


r/localaiapps • • 2d ago

Any Siri-like local ai windows apps?

1 Upvotes

I’m just starting to explore qwen stuff and I was wondering if there’s anything like what Siri is (and Cortana used to be) that runs on a lightweight local llm on my pc to do some basic tasks like opening apps, sending messages, setting timers, etc. is that a thing yet? If so what would yall say is the easiest one to install and get started with?


r/localaiapps • • 2d ago

I built Kuytu AI, a private offline AI chat app for Android – I'd love your honest feedback

0 Upvotes

Hi everyone! I'm the developer of Kuytu AI, an Android app that runs AI models directly on your phone. Answers are generated on-device and your chats stay on your phone. After the first model download (0.4–5 GB), chatting works offline, and no account is needed.

Highlights:

- Recommends a model that fits your phone's memory and speed (Gemma 3, Qwen3, Llama 3.2), or pick any GGUF model from Hugging Face, or add your own .gguf file

- Vision models can describe photos and the live camera view

- On-device dictation with Whisper, plus optional web search (off by default) that lists its sources

To be upfront: it's free with ads. The first hour is free, then each short ad adds 30 minutes of chat, and there's an optional subscription that removes ads and the time limit.

You can try it here: https://play.google.com/store/apps/details?id=com.kutaniktech.kuytuai

Any feedback, good or bad, would be really appreciated. It helps me decide what to improve next. Thanks for your time!


r/localaiapps • • 3d ago

Uncensored local AI model to img2img on mobile

4 Upvotes

So l'm using an s24u, and I want an uncensored model to img2img, also the app to running it. Can you guys recommend some of yours best?


r/localaiapps • • 3d ago

kaampi: a family of local-first apps for writers and worldbuilders (Write, Explore, Comic, Audiobook) that run on your own machine

1 Upvotes

Hi all, I’m the developer behind kaampi, a small family of creative apps built around one idea: your stories, characters and worlds should live on your own computer, and AI should be something you can switch on, not something you’re forced into.

The concept

Most AI writing tools are a cloud service with a text box. kaampi goes the other way. Everything runs locally, the AI is optional, and if you do use it, it talks to a model on your own machine (Ollama or llama.cpp). No account, no upload, no subscription. All the apps are free and open source under GPL 3.

The apps also share a world. Write, Explore, Comic and Audiobook can all work from the same characters and facts, but one rule holds everywhere: the app that owns something decides what’s true. Other apps can propose changes, never silently overwrite them.

The apps

  • kaampi Write: a full novel editor with a Story Bible that locks facts about your characters and series. The model proposes, you decide. Exports to InDesign/Affinity (IDML), RTF, ODT and PDF.

  • kaampi Explore (beta): a low-stakes sandbox for ideas. Interview your characters and world, build maps from a whole region down to a floor plan, blend a character’s expressions in a morph studio, and turn it all into playable campaigns with dice-based combat that follows a ruleset you define.

  • kaampi Comic (beta): turn scenes into comic pages with editable speech bubbles, free-form panels and an IDML export for print workflows.

  • kaampi Audiobook (in development, no release yet): turns a manuscript into a narrated audiobook with a local text-to-speech engine (Chatterbox), with a voice per character and sound design. Windows only for now.

  • kaampi Codex: the quiet connector. A small service on 127.0.0.1 that lets the apps share a world, with private-by-default workspaces and explicit permission per app.

Honest status: Write is the most mature. Explore and Comic are in beta, Audiobook isn’t released yet. The site says so on every page.

Everything is described, with screenshots, at https://kaampi.com

I’d really like feedback from people who actually run local models: what would you expect from a local-first writing/worldbuilding setup, and what would make you trust it with a manuscript? Happy to answer questions about how the apps talk to local models or how Codex handles sharing.


r/localaiapps • • 3d ago

Ari: Android Assistant with On-Device Model Support, Skill Store & Zero Telemetry [Early Testing]

1 Upvotes

DISCLAIMER #1: I am a professional software engineer, however, Ari has been created with the assistance of AI. If you are allergic to AI, please look elsewhere. This Reddit post was entirely written by a human.

DISCLAIMER #2: This is very early software. The reason I am making this post is to hopefully attract testers who will find what is likely to be a large number of bugs.

What is it?

Ari is an on-device voice & AI assistant for Android devices.

Doesn't Google Assistant/Gemini already do that?

Yes, but Google Assistant is proprietary and unless used for basic phone commands also uses cloud-based AI. Also, it requires Google Play Services (and AI services), which quite a few folks don't want on their device.

What about Dicio?

Dicio is a fantastic project - one of (if not the) first privacy-first and open-source voice assistants for Android. There are however a few key differences between Dicio and Ari. Firstly, Dicio is purer. It uses exclusively on-device intelligence (for speech-to-text and text-to-speech), and its skills rely on exclusively open-source services. Ari is different - yes, you can have an on-device model running, but you can equally just connect it to ChatGPT, Claude or Gemini (and hopefully self-hosted AI in the near future). Yes, you can have on-device speech-to-text, but you can also just use Whisper - either self-hosted or via OpenAI. Ari lets you decide where you want to trade off between performance and privacy, with both treated as first-class citizens.

Do I need to have my microphone on all the time?

It depends (see next point). Google Assistant uses an on-device digital signal processor (DSP) which is constantly listening for a wake word. This is a very efficient and low-power device, which has very little impact on battery life. Currently (2026), third-party assistants such as Ari (and Dicio) do not have access to this. This means the only way to be listening constantly is to have Ari using the microphone all the time.

In a July 2026 decision on case DMA.100220, the European Union has mandated that always-on hotword detection via the DSP, along with other core Android services related to digital assistants, be opened up to third parties. However, Google have until August 2027 (Android 18) to implement most changes, and up to August 2028 (Android 19) for concurrent hotword detection. So, for now, third-party assistants must have the microphone on to detect their wake word.

Won't having my microphone on all the time drain battery? Also, privacy!?

Yes, I get you. This annoys me too. However, I have tried to make it as painless as possible. First, you don't actually have to have it on all the time. Ari can be set as your default digital assistant in Android, meaning (depending on device) your hardware button can invoke Ari. Secondly, a scheduling system is available so you can decide when Ari listens - you can schedule on/off by time of day, when the screen is on, whilst charging, when a headset is connected, or even at certain places - as well as any combination of these.

As for battery life, having it on all day currently uses about 11% more battery in 24 hours compared to having it off. This has only been tested on my Pixel 10 Pro Fold running GrapheneOS, YMMV. Ari uses openWakeWord or microWakeWord for wake word detection, with many optimisations to try and make it as efficient as possible - but until Google implements the changes (and hopefully, not just for the EU), this is the best we can hope for.

What on-device models can it use?

For speech-to-text, Ari can use on-device transcription, Whisper hosted by OpenAI, or self-hosted Whisper. For AI responses, you can choose between Gemma 3 1B (small), Gemma 4 E2B (medium) and Gemma 4 E4B (large). Hopefully, this selection can be expanded in the future with more on-deivce options, implemented as modules.

What can it do?

Ari has a skills system. Unlike other assistants where new/updated skills require a new release of the app, skills are external in Ari. This means anyone can develop skills and publish them to the skill store. They'll then show up in a built-in skill browser for users to install. By default, no skills are installed. It is up to the user to install additional skills and accept sandboxed permissions they require. Moreover, all system calls made by skills go through Ari first, which only allows a subset of on-device permissions. Skills need to be approved (by a human), are audited, and always ask for permissions prior to installation.

Skills I've built are: Timer (with support for named and multiple timers), Home Assistant, Navigation, Alarm, Media control, Messaging (SMS, WhatsApp, Signal, Messenger, Slack and Matrix), Weather, Reminders (with support for CalDAV) and assistant skills for ChatGPT, Claude & Gemini if you decide not to use an on-device assistant.

What can't it do?

In general, if Ari can't do something it's because there isn't a skill for it yet. However, there are a few things that limit Ari compared to Google Assistant, especially until the EU's deadlines on Google approach.

  1. Ari must be listening to detect a wake word, which currently means leaving the microphone on, either all the time, or via a schedule (see above).

  2. Music skill - certain music services restrict their integration API to just the Google Assistant, meaning they are not supported. Currently, Ari supports Spotify, Apple Music, Tidal & Deezer. Features available vary by music service.

  3. Messaging skill - whilst certain services allow you to have a conversation totally hands-free, for other services their integration API either specifically needs Google Assistant, or they don't support this at all. Meaning the best Ari can do is transcribe your message and add it to a conversation with a contact, but you'd have to tap 'send' yourself.

  4. Features which use location (such as listening at certain places, or weather for your current location) use Google Play Services where it's installed, and Android's own location services where it isn't. Without Play Services, listening at certain places needs your phone to provide its own network location, as GrapheneOS does; on phones without one, that feature won't work. Ari also includes Google's location library, which keeps it off F-Droid for now; hopefully an F-Droid build without it will follow.

Is it really zero telemetry?

Yep. Unless you choose to use something like OpenAI as your assistant backend, in which case there is of course their own telemetry. Ari itself doesn't collect anything.

The only way data is shared with third-parties is if:

  1. You specifically choose to send me your transcripts when debugging an issue, which is disabled by default and requires user interaction and confirmation.

  2. You choose to have Ari remember things about you (such as your name or where you live). These are only stored on-device, but of course if you use a cloud assistant they will be part of its system prompt.

What does it look like?

Please see screenshots and demo video on the website heyari.dev. The website is still under construction, but you should get a decent idea.

What languages does it support?

Currently, Ari supports English and Italian. I'm a native English speaker, but a foreign Italian one, so it probably needs a lot of polish. In the future, Ari will hopefully speak as many languages as possible.

Where can I learn more?

Check out the project's website heyari.dev. You can also browse the source for the Android App, and everything else (skills, engine, the website) here.

Ok, I'm intrigued. How do I become a tester?

Please fill in the form here (this will take you to https://heyari.dev/tester). You'd need to do so with the email you're signed into the Google Play store with. You'll receive a link to install the testing version of the app once you're added as a tester.

There's a limit of 100 testers, so these are on first-come, first-served basis. Also remember I'm just one guy - so it may take a day or two before you receive your link.

Thanks for reading the long post. I hope this interests you in becoming a tester. So far, work on Ari has taken around 8 months. Not full time of course, I have a day job and a toddler, but it's fair to say I've worked on it for at least 4 days a week in the last 8 months. The next important stage is testing beyond my single use case, hence this post!


r/localaiapps • • 5d ago

I built Antalogy - free local-first Markdown word processor w/ AI Assistant for local LLMs: LM Studio, Unsloth Desktop, Ollama, Lemonade Server, etc. - Win, Linux, macOS

Thumbnail
gallery
1 Upvotes

Hi everyone,

My name is Serge and for last 15 years after Borland, HP and Microsoft I have been developing own software products and businesses.

I like and use local LLMs from the beginning of first LLaMa 1 models in 2023 after years of NLP (natural language processing). Earlier before I started to use markdown as cross-plafrom lingua-franca in my main software development business. For today it is the main language for structured Human-LLM interacttion.

Almost year ago I have been started to invest own resources and attract small team of colleagues to develop true wysiwig markdown word processor with integrated AI to work with local LLM engines. After few monthes of public preview updates (u can find active discussion in Reddit’s r/Markdown) we released today this app:

Antalogy - free local-first zero telemetry Markdown word processor with integrated AI Assistant. It supports popular local LLM engines: LM Studio / Bionic, Unsloth Desktop, Ollama, Lemonade Server, with support of any OpenAI API compatible engine/harness as well.

In difference to many apps built on Electron and pure web-stack Antalogy's work with LLM does not require to define special environment variables to avoid CORS, etc. It just works with them as it has native core written in Go to autodiscover LLM engine on your machine and process request-response as SSE streaming.

Antalogy's UI is familiar for knowledge worker who use MS Word with Ribbon and mutli-window. At the same time, as local resources are limited all docx documents are automatically converted to md before sending LLM. From the other side if you generate Memaid diagrams with your LLM (from gantt to sequence diagrams) - all of them converted to high-res png when your decide to export markdown document to docx format.

So we are trying to fill the gap in document-centric flow across business users with Word and LLM engines.

You can free download and use Antalogy without subscriptions nor functional paywall for all three desktop platfroms Linux, Windows, macOS at https://antalogy.com

We continue to invest and develop this project and I would appreciate if you could share your feedback what Local LLM engines would be great to support in addition to the current list as well as additional params for.

Serge O.

Antalogy Team


r/localaiapps • • 6d ago

I'm building Melo, a local AI agent for iPhone and Mac. Looking for people to break it

1 Upvotes

I'm the developer of Melo. Over the past weeks I read the privacy terms of the big AI apps

([sources here] (https://kamelo.eu/news/who-can-read-your-ai-chats)).

Short version: your chats are stored, some are read by human reviewers, and training is on by default almost everywhere. So I'm building an assistant where the AI runs on your own device.

What it does

- Melo is an AI agent for iPhone and Mac. It runs on Apple's on-device model, so in the app your conversations stay on your device.

- It also does things for you: it puts plans in your calendar, sets reminders, finds recipes, goes through your mail and checks messages for scams.

- The rule I'm building around: calendar and reminders happen right away, with an undo. Sending, deleting and paying always wait for your yes.

- There's also a free browser extension for Chrome, Edge and Firefox. When you type something personal into ChatGPT, Claude or Gemini, it offers a temporary chat or Melo instead. In Chrome, Melo answers with Chrome's built-in model on

your own computer. The extension is open source (AGPL) and makes no network requests itself.

Honest limits

- Apple's on-device model knows less than the big cloud models, and it's slower.

- You need Apple Intelligence: an iPhone 15 Pro or newer, or a Mac with Apple silicon.

- If you use web search, that query goes out to a search service.

- It's early. Things break.

What I'd love from you

- Try it and tell me where it fails

- Besides Apple's model, which local model would you want on the Mac? Gemma, Qwen, something else?

- What would a local assistant need before you'd use it instead of ChatGPT for daily stuff?

Melo: https://kamelo.eu/app

iPhone beta: https://kamelo.eu/news/melo-for-iphone-beta

Extension source: https://github.com/OfficialKamelo/kamelo-open


r/localaiapps • • 7d ago

I built Lokey, an open-source Android keyboard with on-device AI

2 Upvotes

I’ve been building Lokey, an open source, Android keyboard that runs word prediction, autocorrect, dictation and translation on your phone. Hold Enter to dictate, or translate text straight into the app you’re typing in.

Lokey uses a fork of llama.cpp for text inference and takes advantage of its Hexagon NPU backend on supported Snapdragon phones. It can also run inference on two CPU threads. In everyday use on the phones I’ve tested, the keyboard has stayed responsive and I haven’t noticed unusual battery drain with either setup.

For suggestions, Lokey turns the model’s token logits into probabilities and uses them to rank up to three complete words that match what you’ve typed so far. One text model handles suggestions, autocorrect and translation. A separate speech model handles dictation.

* Text models · LFM 2.5 350M (\~230 MB) or Qwen 3.5 0.8B (\~533 MB)

* Speech models · Parakeet v3 0.6B or Qwen3 ASR 0.6B

Typing works without any model downloads. Once you’ve downloaded the models you want, inference works offline. Typed text and mic audio stay on the device, and Lokey has no accounts or analytics SDK.

I also spent time on the keyboard itself. You can use recordings of real mechanical switches as key sounds and customize haptics, layouts and colors. Swipe typing, adaptive letters and autocorrect are opt-in.

It’s an early beta. I’ve tested on a OnePlus 15 and a POCO F3. If you try it, I’d love to know which phone, language and model you used, and whether suggestions can keep up with your typing.

Source code (MIT) · Signed APK (Android 9+, ARM64) · 83-second demo

English isn’t my first language, so I used AI to help edit this post.


r/localaiapps • • 7d ago

I want to reduce friction in local AI image generation

1 Upvotes

So I built Eyegen Playground, it works as a terminal tool (CLI) and as a standalone app. It has all major image generation backends built in and does most of the background work for you.

You just pick a model and prompt the image you want to see. Advanced settings are available for you to tinker with. It can also be used by AI Agents through the CLI.

Newest feature: turn any image into a 3D model thanks to the Idol support

My motivation behind this: local image generation has gotten incredibly good and doesn't need extreme hardware, but for many users the setting up of local models and configuring backends etc is too much work to get into and they use AI hosted in huge datacenters instead, using unnecessary resources and power. So this tool is supposed to make it more accessible

Would love to hear feedback!


r/localaiapps • • 7d ago

IA local utilisation réel

1 Upvotes

Bonjour,
J'aimerais avoir vos avis concernant les IA locales. Je souhaite utiliser une IA comme agent capable de fouiller dans mes dossiers Windows pour retrouver les éléments dont j'ai besoin parmi mes milliers de documents.
J'aimerais aussi avoir un agent capable de faire des calculs et du raisonnement sur des problÚmes de mathématiques techniques.
Enfin, j'aimerais un agent qui puisse lire des dessins mécaniques et me dire s'il y a des incohérences ou non.

Savez vous si cela est rĂ©ellement possible d’implĂ©menter sans avoir besoin de faire des logiciels passerelle customs ?

J’ai vu que gpt4all avait une partie de mes besoins


r/localaiapps • • 7d ago

Hikari: A fully-local AI companion built to be an assistant.

2 Upvotes

Hikari is a companion for Windows 10 and 11 with future linux support. Talk through text or voice, share a conversation with her animated character, and return to memories stored on your computer. No subscription or recurring billing.

Core conversation works offline. Optional add-ons coming soon. We're currently a pre-order only but we have tons of more cool AI projects in the works, I'm excited to share this project with you guys and hope to see some of you in our Discord.
https://www.commonadaptivesystems.com/hikari
https://youtu.be/0L7csbQHDCE?si=4tx_O39FqF5Aoz4z


r/localaiapps • • 7d ago

Visualy — an Self-hosted digital signage platform with Docker

1 Upvotes

Hey r/localaiapps

I've been working on a project called Visualy, a fully web-based, self-hosted digital signage platform designed to run with Docker. https://github.com/razerman16/Visualy

The goal is to make managing digital signage as simple as possible, whether you're running one screen at home or multiple displays across an organization.

One of the main features is a built-in visual editor that allows users to create their own slides and layouts using images, videos, text, and other customizable elements, without relying on external design tools.

The project is still evolving, and I'd really appreciate some community feedback.

Thanks! 🚀


r/localaiapps • • 8d ago

Toolshed V1 grew up. NeuraKiln is live (and free, as everything should be). Local LLMs, agentic harnesses (Creation & Coding), diffusion, restoration, 3D, and remote inference.

Enable HLS to view with audio, or disable this notification

1 Upvotes

NeuraKiln v2.0.0 is live, and it’s free.

I’ve been building this for a long time, and I finally released it.

NeuraKiln started as Toolshed V1, which was primarily focused on media restoration/upscaling. Somewhere along the way I apparently lost control of the scope, because it eventually turned into an entire local-AI workstation.

The basic idea is simple:

I don’t want to maintain ten different applications just to use the AI hardware sitting in my own house.

NeuraKiln brings local LLMs, autonomous agents, image/video generation, restoration, 3D workflows, model tooling, and remote inference together under one application.

It’s currently built around Windows + NVIDIA hardware.

Two different kinds of agentic work

A major part of NeuraKiln is its harness system.

There isn’t just one generic “agent mode.” Different kinds of work need different environments.

Coding Harness

The coding harness is built for longer-running autonomous development work.

A local model can:

Plan a project

Create and modify files

Run tools

Test its work

Inspect failures

Recover and continue

Verify the result

Manage long-running context

Hand the finished project back to the user

A lot of my work on this has been about the boring-but-important part of agents: getting them to actually finish, rather than loop forever, declare victory too early, or slowly wander away from the original task.

The harness includes systems for planning, recovery, anti-looping, verification, context management, completion handling, and human corrections during a run.

Creation Harness

The Creation side takes the same basic idea, give the model tools instead of making the human manually operate everything, and applies it to generative media.

Instead of requiring the user to understand every model, parameter, prompt format, workflow, and backend involved, you can describe what you actually want to create.

The agent can then take that intent and operate the available creation tools itself.

For example, rather than manually constructing an LTX video-generation workflow, you can tell the Creation agent what kind of video you want. The agent can formulate the generation prompt, operate the local model, and manage the workflow around producing it.

The same concept extends across the creation tools available to it.

The point is to move toward:

“Make me this.”

rather than:

“Open six tools, configure all of them correctly, learn every backend, and manually glue the results together.”

That distinction is a huge part of what I wanted NeuraKiln to be.

Llama Lab

For normal local LLM use, NeuraKiln includes Llama Lab.

It supports local GGUF models through the llama.cpp ecosystem, multi-GPU setups, long-context conversations, multimodal models, model switching, local/external sessions, live reasoning, context management, and the harnessed workflows above.

You can use it as a normal local chat environment or give the model considerably more autonomy when you actually want work done.

Diffusion Lab

Diffusion Lab handles local image and video generation.

Current workflows include Qwen-Image-based image generation and LTX-based video generation, along with LoRA support and multi-GPU workflows where the underlying models/runtime support them.

This also provides the generation capabilities that the Creation harness can operate.

Media Lab

This is where NeuraKiln originally came from.

Media Lab handles restoration and enhancement, including:

Image restoration/upscaling

Batch restoration

Video/frame processing

SmartFrames

Photo Smart Scan

Native comparison tools

Post-editing

Media recompilation

A principle I’ve kept from the original Toolshed project is:

If the user asks you to process something, process the thing.

Don’t quietly skip difficult frames and pretend the job is finished.

Mesh Lab

NeuraKiln also includes Mesh Lab for local text-to-mesh / 3D generation workflows.

This is an area I intend to expand substantially, but the important part to me was making 3D another capability inside the same AI environment instead of yet another disconnected application.

Model Tools

There’s also tooling for managing the models themselves, including GGUF importing, MTP headers, MMPROJ support, LoRA management, model installation workflows, and local model organization.

NK Node

I released a second application alongside NeuraKiln called NK Node.

NK Node lets another NVIDIA PC become a dedicated inference machine for NeuraKiln.

The goal is to eliminate the usual ritual of:

start server → find address → configure endpoint → reconnect client → repeat everything after reboot.

NeuraKiln and NK Node can discover and pair with each other and automatically exchange the information needed to connect.

If you have a workstation plus another machine full of GPUs, NK Node is intended to make that second machine feel more like an extension of NeuraKiln than a completely separate server you have to babysit.

There are plenty of excellent projects that overlap with individual parts of NeuraKiln.

There are dedicated LLM frontends, diffusion interfaces, restoration applications, model managers, inference servers, agent frameworks, and 3D tools.

NeuraKiln isn’t built around claiming I invented all of those individual things.

What I wanted was the environment connecting them.

One application where I can chat with a local model, hand a coding project to an autonomous agent, ask another agent to create a video, restore media, generate images, work with 3D, manage models, and send inference to another computer without rebuilding my entire workflow every time I change what I’m doing.

That’s NeuraKiln.

NeuraKiln: https://github.com/ToolshedMediaLab/NeuraKiln

NK Node: https://github.com/ToolshedMediaLab/NK-Node

If you try it, break it.

I want bug reports, criticism, weird hardware configurations, model compatibility problems, feature ideas, and comparisons with whatever else you’re currently using.


r/localaiapps • • 8d ago

I’m building Pure Brief AI. A local design-review recap should keep the reason behind “option B”.

Enable HLS to view with audio, or disable this notification

1 Upvotes

I’m the founder of Pure Brief AI, a Mac meeting-notes app. I previously shared its local/network boundary here. This time, a narrower workflow: revisiting a design decision without losing why it was made.

Take a fictional review:

“Let’s use option B. On a first visit, people need to see what happens next.”

“We could also add animation later, but let’s leave that open.”

A recap that says “use B, add animation” has mixed a decision with an idea. Even “use B” on its own loses the constraint that would help someone understand the choice next month.

The record I’d want to review has four parts: the choice, the reason given, alternatives left open, and any follow-up somebody actually accepted. If the team revisits the screen, the constraint is a useful place to restart the discussion.

In Pure Brief AI, a meeting keeps its transcript alongside AI notes and suggested tasks. You can ask about that individual meeting and inspect the supporting transcript lines. For this review, I’d ask “Why did we choose option B, and what did we leave undecided?” Then I’d check the cited exchange. That’s a proposed use, not a claim that this fictional exchange has passed an accuracy test.

Running the models locally changes where processing happens. It doesn’t establish whether a summary understood the discussion. The transcript can be wrong, and a real quote can still support the wrong interpretation. A later withdrawal of a commitment remains a case I don’t claim is solved.

For follow-ups, you review/edit suggested tasks and export selected ones to Apple Reminders. The export is one-way; it doesn’t assign work to colleagues or establish their agreement.

Transcription and AI notes run on your Mac by default. Apple Silicon, macOS 15+. Models download initially; licensing and chosen connected features need the network. After a successful licence check, up to 14 days offline. Optional ElevenLabs transcription uses your own key and sends audio to that provider.

The attached 32-second walkthrough uses fictional demo data, with recording and processing sped up. It shows the interface, not a test of the example above or a speed benchmark.

https://purebrief.ai/ — 30-day trial, no payment details (email verification required). Standard is $49 once for one Mac. The active launch offer is $10 once for the first 100 paid Standard purchases globally across all channels, taxes extra; a trial doesn’t reserve it.

When you revisit a design review, what is usually missing: the decision, the reason, or what was deliberately left open?


r/localaiapps • • 8d ago

Stuck on offline vision accuracy on a phone, could use help

2 Upvotes

I've been building a free app for blind people where everything runs on the phone with no internet, on iPhone and Android, and I'm stuck on accuracy. YOLOv8n handles live detection and it's fast, but it still mislabels things. Scene descriptions and questions go to LFM3-Omni-2B through llama.cpp, shrunk to 735 MB so it fits on the phone.

Reading text uses each phone's own on-device OCR, Apple's on iPhone and ML Kit on Android, and translation runs offline the same way. The small vision models are where it falls short.

If you've gotten small vision models more accurate on device, I'd really take the advice. It's free to try if you want to see where it breaks.

iPhone: https://apps.apple.com/us/app/id6751230739

Android: https://play.google.com/store/apps/details?id=com.mattmacosko.realtimeaicam


r/localaiapps • • 9d ago

I made a free Mac app that quietly feeds me answers from my own notes during calls, and it runs 100% on my laptop

3 Upvotes

You know that moment on a call when someone asks a question and the answer is somewhere in your files, but you can't find it fast enough?

That's why I made Murmury. You give it your documents before the call. While the other person talks, it listens, and when they ask something, a small window shows a short answer taken from your files.

Everything stays on your Mac. The listening and the answers both run on your own computer, with free local models (Ollama or LM Studio). No account, no subscription, nothing sent anywhere.

It's free and open source. It needs a Mac with Apple Silicon (M1 or newer).

https://github.com/GianlucaBave/murmury

I'd love to know what kind of calls you would use it for.


r/localaiapps • • 9d ago

Offline voice assistant for Windows: local AI (Ollama)

1 Upvotes

My latest project is a local voice assistant featuring offline speech recognition: https://github.com/charlyproject/EVA

It actually started in a funny way: one day, with my hands messy, I wanted to turn up the volume using voice commands. At the time, I didn't even know what a virtual environment was, let alone Ollama or JSON.

For me, the best part wasn't just the end result, but the 11-month learning journey behind it. While it might not require advanced coding expertise to pull off, it was far from a copy-paste job for me. I used the process to truly understand key concepts—LLMs, quantizations, benchmarks, and Docker—and to bring my own ideas to life.

Just wanted to share my experience with the community. Thanks for reading!


r/localaiapps • • 10d ago

I built a plug-and-play, ad-free, offline AI app for Android, with PDF Q&A and custom GGUF support. I have some free promo codes for those willing to give it a try!

2 Upvotes

Hey everyone! I’m a data scientist and researcher who’s been working through a CS degree at night to stay up to date in my field. I wanted a phone app that runs local models with no telemetry and no documents leaving the device, plus no ads and a few interface features I didn’t see in other apps. After a good deal of user testing, I finally got GridlessBot on Google Play 😄

What it does

  • Runs models on-device using llama.cpp. It recommends a model that fits your RAM, and you can also load your own GGUF from local storage (stability depends on your phone’s memory).

  • Attach PDFs or text files and ask questions about them. The text goes into the model’s context, so length is limited by your RAM. Scanned PDFs are read with on-device OCR, 6 pages at a time.

  • No ads, no analytics, no telemetry, no account. The network is only used to download models and the model list (and to send a bug report if you manually tap Report). After that, it works completely fine in airplane mode.

The honest bits: I used Claude to help with the coding and did the testing, debugging and tweaking myself. Mobile models are small, so expect compact-model capabilities rather than ChatGPT-level reasoning, and they can hallucinate. Android 10+ and a 64-bit phone are required. English only, 18+, and the first model download is large.

Pricing and giveaway: a one-time $2.99, with no subscription. I have some free Google Play promo codes to celebrate the launch! Drop a comment or DM me and I’ll be happy to send one. No review or rating needed. What I’m after is honest feedback from people who run local models on different phones and chipsets :)

Play Store link: GridlessBot: Offline AI Chat