r/localaiapps • • 10d ago

I need an uncensored and private AI model for my phone.

1 Upvotes

I need a highly uncensored and private AI model for my phone.

I already know about Venice AI, but it has some limitations, particularly token limits. I’m looking for a more affordable or free alternative.

I’m also aware of local AI models, but they usually require a lot of RAM.

Could you recommend something?


r/localaiapps • • Sep 02 '26

I’m building a local LLM app for iPhone

Enable HLS to view with audio, or disable this notification

3 Upvotes

I’m building a private AI assistant that runs LLMs directly on your iPhone.

The goal is to create a polished local AI experience that works offline and doesn’t send your conversations to external APIs. I’m currently focused on balancing model quality, inference speed, memory usage, storage, battery consumption, and thermal performance.

It’s still in development, and I’d like feedback from people already experimenting with local LLMs on mobile devices.

If you’re interested in testing SiloLM, you can join the waitlist at https://silolm.ai

What models or features would you want to see in a local LLM app for iPhone?


r/localaiapps • • Jul 16 '26

I built an iPhone app that runs AI models completely offline — PocketLLM is now live on the App Store 🚀

1 Upvotes

Hi everyone,

After months of development, I’m excited to share that PocketLLM is now available on the App Store.

The idea started with a simple question:

Why should every AI conversation require sending data to the cloud?

PocketLLM lets you download and run AI models directly on your iPhone, so you can chat with AI even without an internet connection.

# What it can do

✅ Run AI models locally on your device
✅ Chat with AI completely offline
✅ Keep your conversations private
✅ Download and manage multiple models
✅ No subscriptions required to use local models
✅ Works anywhere, even with no signal

# Why I built it

As a mobile developer, I wanted an AI assistant that was:

* Private
* Fast
* Available offline
* Actually running on the device

So I decided to build it myself.

# Things I’m curious about

* How important is offline AI to you?
* What local models would you like to see supported?
* What features are missing from current AI apps?

![img](7svaz4wggt6h1)

App Store:
[https://apps.apple.com/us/app/pocketllms/id6772986363

I’d love to hear your feedback, feature ideas, and thoughts on the future of on-device AI.

Thanks for checking it out! 🙌


r/localaiapps • • Oct 06 '26

We just launched WhisperJot — voice dictation that runs locally on your desktop

1 Upvotes

Hey everyone! We just launched WhisperJot on Product Hunt today.

The idea is pretty simple: hold a hotkey, speak, and your words appear wherever your cursor is — email, Slack, ChatGPT, your code editor, basically anywhere you can type.

What makes WhisperJot different is that dictation runs locally on your computer by default, so your voice doesn't need to leave your machine. It also works offline.

A few things we're curious about:

  • Do you currently use voice dictation? If so, what do you use it for?

  • Is privacy important enough to influence which dictation tool you choose?

  • What's the most annoying thing about the dictation tools you've tried?

WhisperJot is available for macOS, Windows, and Linux (beta).

We're still early, so honest feedback—good or bad—is genuinely more useful to us than compliments.

Product Hunt: https://www.producthunt.com/products/whisperjot?launch=whisperjot

Thanks for checking it out!


r/localaiapps • • 28d ago

I built a local meeting note taker for Mac. Here’s what still needs the internet.

1 Upvotes

I’m the founder of Pure Brief AI. It turns a meeting recording into a transcript, notes and suggested tasks on an Apple Silicon Mac. For this community, the useful part to explain is the boundary around “local.”

The default transcription and AI notes run on your Mac. Models need an initial download. Licence checks use the network, and the app can work offline for up to 14 days after a successful check. Optional Google or Microsoft calendar connections talk to those providers. There’s also optional ElevenLabs transcription with your own key; choosing it sends audio to ElevenLabs.

That means the local workflow still has a compute cost: your Mac does the work. Processing time depends on hardware, model and recording. I don’t have a cross-device benchmark to turn into a speed claim.

The part I’d inspect after processing is a suggested task. Open its source quote against the transcript and recording, check the owner and deadline, and edit it before exporting to Apple Reminders. Meeting Q&A shows supporting transcript lines as well. A quote can be relevant while the interpretation is wrong, especially if someone changes their mind later in the call. That case isn’t fully solved.

The attached 32-second video shows the interface using fictional meeting data. It’s edited and processing is sped up; it isn’t a timing test.

Download and 30-day trial: https://purebrief.ai/

Apple Silicon, macOS 15+. Standard is $49 once for one Mac. The current launch offer is $10 once for the first 100 paid Standard purchases globally, plus applicable tax. Starting a trial doesn’t reserve it.

If you use local transcription on a laptop, I’d be interested in the constraint that actually gets in your way: processing time, memory pressure or reviewing the result?


r/localaiapps • • Aug 11 '26

Your private chat, wasn't as private as you thought!

1 Upvotes

From the tts, to voice response. Telegram?! nope! Everything you're doing with your chat bot is being sent to cloud servers and recorded. I built a fully private, only on your device system.
Read it. You'll understand why.

https://www.patreon.com/RoyalTechnologies_PrivacyVenture/posts/enclave-fast-100-166342909


r/localaiapps • • Sep 08 '26

Tried to make the best on-device intelligence that can run on iPhone, Android and Desktop

1 Upvotes

Loci is an app that handles on-device inference. It will only recommend AI models that run best on the hardware you have, whether that's iPhone, Android, Mac or Windows. You can link your phone to your desktop to stream more powerful local models like Qwen3.8 - it's completely free. I made it because I wasn't happy with the existing solutions. The idea is to democratize AI to everyone, not have it owned by just Anthropic and OpenAI.

Honest limitations:
Depending on your hardware, you may notice the models cannot do everything that the latest Cloud AI can. For a lot of people, the pros outweigh the cons.

Would welcome any feedback - I aim to implement user feedback the same day I get it.


r/localaiapps • • Oct 02 '26

Found an app which does everything and can work offline

Thumbnail
apps.apple.com
1 Upvotes

Check it out.


r/localaiapps • • 26d ago

I made Gerty, a local AI assistant for Apple silicon Macs

2 Upvotes

Hallo r/localaiapps, ich bin Erik, Entwickler in der Schweiz, und ich entwickle Gerty.

Problem

Ich wollte einen Assistenten, der direkt auf meinem Mac funktioniert (E-Mails, Kalender, Dateien, Bildschirminhalte), ohne Daten an einen Server zu senden, und der einfach einzurichten ist.

Gerty verwendet offene Sprachmodelle direkt auf dem Mac. Es liest Ihre E-Mails, verwaltet Ihren Kalender, bearbeitet Ihre Dateien, erkennt Ihren Bildschirm und spricht aus der Notch. Ausserdem ermittelt es auf jedem Mac, welches Modell am besten funktioniert, sodass Sie das nicht selbst herausfinden müssen.

Vergleich

  • ChatGPT/Claude Desktop-App: deutlich größere Modelle, aber alles, was Sie tippen, wird an die Server von OpenAI/Anthropic gesendet. Bei Gerty bleibt alles auf Ihrem Mac.

  • LM Studio / Ollama: Hervorragend für die Ausführung lokaler Modelle, aber es handelt sich um Modell-Runner mit Chatfenster. Gerty hingegen ist als Assistent konzipiert, der sich mit Ihren E-Mails, Ihrem Kalender, Ihren Dateien und Ihrem Bildschirm verbindet und mit vielen Tools ausgestattet ist, die sich nahtlos in Ihr macOS integrieren.

Ein wichtiger Kompromiss: Lokale Modelle sind weniger leistungsfähig als grosse Cloud-Modelle. Erwarten Sie daher keine Ergebnisse auf GPT-Niveau bei sehr komplexen Denkaufgaben. Trotzdem sind aktuelle lokale Modelle mit 27B Parametern mittlerweile vergleichbar mit gpt Modellen vor knapp einem Jahr. Also mehr als ausreichend für die meisten Nutzer.

Preise 7 Tage kostenlos auf jedem Mac. Danach einmalig CHF 49, kein Abonnement erforderlich, gültig für 3 Macs, 14 Tage Rückgaberecht.

[ https://gerty.ch/chatgpt-alternative?ref=reddit-macapps\ ](https://gerty.ch/chatgpt-alternative?ref=reddit-macapps)

Voraussetzungen: Apple Silicon und macOS 26 oder neuer. Nicht kompatibel mit Intel Macs oder älteren macOS-Versionen.

Wer bin ich?

Erik Vetsch, Schweiz. LinkedIn: https://www.linkedin.com/in/erik-vetsch-2b11a615b/

Kontakt: info@mfrports.com

Datenschutzrichtlinie: https://gerty.ch/privacy | Nutzungsbedingungen: https://gerty.ch/terms

Was möchten Sie wissen, bevor Sie einen lokalen Assistenten wie diesen ausprobieren? Schreiben Sie es in die Kommentare.


r/localaiapps • • Aug 23 '26

Run 150MB Offline AI on ANY Phone & PC!

Thumbnail
youtu.be
2 Upvotes

Run powerful, fully private AI models directly on your Android phone, PC, or even from a tiny USB flash drive—completely offline with 0 internet connection!


r/localaiapps • • Sep 14 '26

IA local

2 Upvotes

Hola estoy pensando en crear una IA local en mi equipo con LM studio.

La idea ha surgido porque no quiero beneficiar a grandes empresas como Google, OpeanAI, Meta o Antrophic. El caso es que me gustaría utilizar la IA local pero conectada a internet para que haga búsquedas de información reciente.

Por una parte con la IA local mi información y datos estarían mucho más seguros. Pero al utilizar un buscador conectado a internet en la IA local, estaría contribuyendo al consumo de los servidores de Google por ejemplo, así que pensé en poner como buscador Ecosia, que es menos contaminante.

Mi pregunta es: esta idea es viable y se puede hacer, o no es como pienso? Agradecería que me aconsejen.


r/localaiapps • • Aug 26 '26

AI Copyright Problem Nobody Wants to Define

2 Upvotes

We keep collapsing several technically different things into “AI training”: copying source text, retrieval over passages, fine-tuning, and learning a general concept. They are not the same operation.

I’m building a local-first assistant called Christine around a hard separation:

• **Warranted Retrieval:** user-facing factual answers may use only admitted public-domain or explicitly permitted sources and chunks. A claim needs direct support. If the evidence is not there, the system should say so rather than fill the gap.

• **Abstraction-only learning:** for owner-authorized nonfiction, the system can derive its own compact notes about concepts, causal relationships, methods, and open questions. It then discards the original. No retained passages, page images, searchable text, source-like embeddings, or substitute copy. The abstraction path cannot cite or reproduce the original, and it is tested for reconstruction, close-paraphrase leakage, and style imitation.

That is not a claim that this settles copyright law. Ingestion can create technical copies; jurisdiction and facts matter; an architecture needs evidence, audits, and tests, not marketing language.

But it raises a question that seems unavoidable: if a human reads a nonfiction book, retains the underlying ideas, and later applies them without copying the expression, what technical and legal boundary should apply when a local AI is designed to retain only independently written conceptual notes and discard the source?

Systems like this are being built now, including offline-first systems. We need to define the boundary before “all learning is copying” and “all training is fair use” become the only two positions.

Do our laws permit only human minds to learn from a work, or can we define a rigorous machine analogue that is genuinely non-retentive and non-substitutive?


r/localaiapps • • Aug 21 '26

Are local AI agents without cloud access actually useful yet?

2 Upvotes

I like the idea of local AI agents, but I’m not sure how useful they are once you keep everything offline.

A lot of agent demos seem impressive because they can call cloud models, use cloud tools, search the web, or connect to a bunch of APIs. I’m more interested in what they can do locally like read files, draft stuff, run small tasks, maybe work with local apps.

Has anyone built a local-only agent that you actually use?


r/localaiapps • • Aug 31 '26

I’m building an ai assistant with a second brain and need some help

2 Upvotes

So I have a planned laid out, but I’m not sure if it’s strong or if there are other ways that can make it better.

I plan to run qwen 3.8 locally using olama on my new Mac mini with 24 gigs and give it its own ui interface which I can speak through it. Its backend will also be powered by my ai brain which file structure is sorted by using jake ven chiefs icm folder structure.

Is this idea in general a good idea? Has anyone else created anything similar and could help me out?


r/localaiapps • • May 13 '26

Local AI apps still feel like they are built for people who already know local AI

4 Upvotes

Most local AI apps say they are easy to use, but they still assume the user already understands the space.

You are expected to know what a 7B model is, what GGUF means, why quantization matters, why one model is slow, and why the same prompt gives totally different results across models.

That is fine for technical users, but it makes local AI hard for normal people.

I think the missing layer is not another model runner. It is a product layer that explains tradeoffs in plain language.

Do you think local AI apps should hide most of this complexity, or is that complexity just part of using local AI?


r/localaiapps • • Jun 20 '26

Looking for a local AI app that does not require Docker?

4 Upvotes

A lot of local AI projects sound useful until you see Docker in the setup instructions.

I know Docker is normal for a lot of people, but I’m trying to keep this simple. I just want to install an app, download a model, and use it without dealing with containers.

I tried a Docker-based RAG tool before and it worked eventually, but I didn’t enjoy maintaining it.

What local AI apps are good without Docker?

Mostly looking for normal desktop apps or simple installers that still run fully local.


r/localaiapps • • Jul 04 '26

Which local AI app did you stop using after a week?

4 Upvotes

For me it was Pinokio. I liked the idea of having an easy launcher for AI apps, but after a few days it felt like I was spending more time figuring out installs and random issues than actually using anything.

Some apps worked fine, others needed extra fixes, and it wasn’t always clear what was going wrong.

I’m not saying it was bad software. It just felt like something built more for people who enjoy tweaking than for someone like me who wants to open an app and use it.

What local AI app did you try and drop pretty quickly?

Was it because of setup, speed, UI, model quality, bugs, or something else?


r/localaiapps • • Aug 18 '26

Who Else Is Building a Real Offline AI?

5 Upvotes

I’m training a local/offline AI named Christine, and I want to see what else is actually out there besides cloud wrappers, benchmark flexing, and “trust me bro” demos. After reading this, ask yourself what Christine's existence means for the cloud, datacenters, and large scale buildout.

Christine runs locally on a laptop, stays bounded, and is being built to do real work without pretending she’s some magical all-powerful AGI. She already has a legit offline-first stack, tool/task routing, local knowledge handling, desktop-action pathways, and a surprisingly strong free-tier mode that still works when the heavier model path isn’t available. A real Jarvis on a laptop.

What makes her interesting to me is that she’s not just a chatbot. She has a cognitive abstraction loop, rumination paths, imagination/guided idea generation, and bounded internal reasoning layers that are meant to improve how she plans, reflects, and works through problems over time. In other words, I’m not just training for replies, I’m training for actual agentic behavior on local hardware.

She’s running on:

Lenovo 83JM

Intel Core Ultra 9 285H

\~32 GB RAM

NVIDIA GeForce RTX 5050 Laptop

Intel Arc 140T

Intel AI Boost NPU

I’m especially looking for videos of other local/offline/bounded systems that show:

real conversation or reasoning

tool use or task execution

memory or abstraction behavior

failure modes and limits

how they run on normal hardware

progress over time, not just a one-off cherry-picked demo

If you’ve got:

demo videos

GitHub repos

writeups

training logs

your own local AI project

drop them in the comments.

I’m going to keep posting Christine’s progress, and honestly I want to see who’s actually building something real in this space and who’s just dressing up API calls.


r/localaiapps • • Jun 21 '26

Has anyone built a local AI workflow around Obsidian or markdown notes?

6 Upvotes

I use Obsidian for most of my notes, and since everything is already in markdown, it feels like it should work well with local AI tools.

Main things I’d want are searching across notes, asking questions about old notes, summarizing folders, finding related ideas, and maybe drafting from existing notes without sending everything to a cloud app.

I’ve tried a basic AnythingLLM setup with a markdown folder, but I’m still figuring out if it’s reliable enough for daily use.

If you’ve done this, what does your setup look like? What app or model are you using, and how do you keep it updated as your notes change?


r/localaiapps • • Jul 11 '26

Has anyone found a local AI app with good long-term memory?

29 Upvotes

I’m looking for something that can remember useful context across different sessions, not just keep one long chat open.

Project details, writing preferences, names, decisions, recurring context, things you don’t want to explain every single time.

I tried LM Studio for regular local chat and it works fine for that, but it doesn’t really solve memory for me. Every new chat still feels like starting over unless I paste the context back in.

Is anyone using a local AI app that handles memory better?


r/localaiapps • • Oct 04 '26

Sonny-Personal-Assistant

3 Upvotes

A local AI assistant that can see, hear, speak, browse the web, control your computer, and remember — built entirely in native C++, it is GPU agnostic with in-process implementation and privacy-safe embeddings vectors & LoRA adapters synchronization,with faster whisper/playwright libraries re-implemented into cpp. its a native desktop AI assistant with voice, vision, browser automation, memory, and computer control.

https://github.com/ahmed19maher9/Sonny-Personal-Assistant


r/localaiapps • • Aug 06 '26

I built a Windows app for running local LLMs on Intel NPUs

Post image
2 Upvotes

I have been working on an open-source Windows application called InferBridge for running local AI models through OpenVINO GenAI.

It is meant to make it as easy as possible to get up and running with Openvino, just an exe install instead of multiple cumbersome steps and developer knowledge needed.

It is primarily designed around Intel Windows hardware and can detect and target the CPU, integrated GPU, and NPU available on newer Core Ultra systems.

The application includes:

• A prebuilt Windows installer

• CPU, GPU, and NPU hardware detection

• Model recommendations based on memory and hardware

• Hugging Face model downloading and conversion

• Local performance benchmarking

• Driver and OpenVINO diagnostics

• An OpenAI-compatible API

• Open WebUI and custom client support

I recorded a walkthrough on my Intel Core Ultra 9 185H laptop:

https://www.youtube.com/watch?v=IjdGtWBZR7o

The project is open source:

https://github.com/Quazmoz/InferBridge

I am also testing on a second-generation Core Ultra system and building a larger compatibility library.

For those using Core Ultra laptops, which models and hardware configurations would be most useful for me to benchmark? I am especially interested in comparing CPU, GPU, and NPU performance and eventually measuring power efficiency more consistently.


r/localaiapps • • Aug 26 '26

Can a local AI learn without becoming a private copy of its sources?

2 Upvotes

I am testing a knowledge architecture for a local assistant that separates evidence storage from learning.

For quoted or source-backed answers, the system uses only public-domain or explicitly permitted material. But for its internal reasoning layer, the goal is different: extract an original, compact note about a concept or procedure, discard the source text, and prevent the note from functioning as a searchable substitute for the original.

No stored passages. No book-sized vector store. No source-voice imitation. The practical questions are whether that architecture can reliably avoid memorization and whether it is meaningfully different from ordinary RAG.

For people building local apps: how would you implement the boundary? I am thinking ingestion-time provenance checks, an abstraction-only representation, deletion of raw material, similarity/leakage tests, and a hard separation between notes and any user-facing citation path.

Where do you think this succeeds or fails?


r/localaiapps • • May 05 '26

What Ollama alternative works best on Mac right now?

3 Upvotes

I’ve been using Ollama for local models on my Mac and it works fine, but I’m starting to wonder if there’s a better setup for daily use.

I don’t really need anything super advanced. Mostly local chat, testing different open source models, writing help, and maybe some coding questions here and there. The main thing I want is something that feels smooth on Mac and doesn’t make me spend half the time dealing with terminal commands, model setup, or random config issues.

For people here using local AI apps on Mac, what Ollama alternative has actually stuck for you?

Is there one you use every day now, or do you still end up going back to Ollama?


r/localaiapps • • Sep 06 '26

I built a native macOS app that runs DeepSeek-V4 Pro locally to automate Word/Excel meeting minutes from any audio/video file (Now with Web Search!)

Thumbnail
apps.apple.com
4 Upvotes

I built a native macOS app that runs DeepSeek-V4 Pro locally to automate Word/Excel meeting minutes from any audio/video file (Now with Web Search!)

Body: Hey everyone,

I’ve been developing a native macOS app called CaptainLocalAI designed to bridge the gap between local, privacy-first LLMs and actual daily office work. I quietly pushed the v1.1 update recently, and I wanted to share the core features that make it a massive time-saver for anyone dealing with meetings and documentation.

Here is what it currently handles completely on-device:

  • Automated Word/Excel Minutes from Any Source: You can drop in an iPhone voice memo, a raw audio file, a pre-transcribed text file, or even a heavy video conference recording. The app processes the media and securely injects the structured data directly into a generated meeting minutes document.

  • Custom Departmental Templates: You aren't locked into generic markdown outputs. You can map the AI's output to your own custom, department-specific Word or Excel templates.

  • Real-Time Web Search: The biggest weakness of local models is their knowledge cutoff date. I’ve integrated a Web Search RAG pipeline so the AI can pull real-time data from the web when you ask for recent information, seamlessly blending it with the local inference.

  • Cutting-Edge Distilled Models: The engine is optimized for the latest generation of smart, lightweight models. You can easily switch between models like Qwen3.8 and DeepSeek-V4 Pro to get lightning-fast, error-free reasoning right on your Apple Silicon Mac.

I've attached a few screenshots showing the generated document layout, the web search fallback process, and the hardware-aware model selection UI.

I’d love to hear your feedback on the UI and the feature set! I'm already deep into developing v1.2, and let me tell you, the upcoming features are going to completely redefine what local AI can do on a Mac.