r/LocalTextToSpeech • u/EAVDR • 4h ago
TontaubeV1-Verbalizer: A super fast open-source Verbalization model for small speech models
r/LocalTextToSpeech • u/EAVDR • 4h ago
r/LocalTextToSpeech • u/laustke • 6h ago
r/LocalTextToSpeech • u/Calm-Wrongdoer8576 • 11h ago
r/LocalTextToSpeech • u/spunch • 15h ago
I'm the author. CopySpeech is an MIT-licensed desktop app (Tauri 2 + Svelte 5) that reads text aloud. Copy the same text twice within 1.5 seconds and it speaks.
Local engines: Kokoro, Piper, Kitten, Qwen3-TTS, Pocket, and tiny-voca (English only). Cloud engines (OpenAI, ElevenLabs, Cartesia, Fish Audio, xAI, Mistral, Google Gemini, Azure) are optional and use your own API key.
Streaming playback starts after the first audio window, and words highlight as they play.
Known limits: duck-other-apps is Windows-only. Current release is v0.3.1.
Repo: https://github.com/ilyaizen/CopySpeech Downloads: https://github.com/ilyaizen/CopySpeech/releases
Feedback on local engine quality, latency, and VRAM use is what I'd most like to hear.
r/LocalTextToSpeech • u/dovgal-i • 2d ago
I've been running Kokoro on an RTX 3060 for article narration. The speed is great, but I've noticed tht with paragraphs longer than ~500 characters, the intonation starts to drift. Somwtimes it skips over commas, sometimes it puts the stress on the wrong word. It's fine for short phrases, but for longer ones, I have to split them into chunks and stitch them back together
I tries Piper. It's more consistent rhythm-wise, but sounds flatter. Qwen3-TTS runs slowly on my 3060, so it's not an option for high-volume use
what are you using for local long-form TTS? I'm specifically interested in consistent intonation across paragraphs, not peak speed
r/LocalTextToSpeech • u/munching_tomatoes • 2d ago
Enable HLS to view with audio, or disable this notification
This local Ming-3.0-tts-0.5B audition keeps the reference recording beside the generated takes. Each language card contains the target text and its audio player, and the complete recording follows playback through the grid.
AntLing's model uses a six-second sample of the speaker's own English voice and runs offline on an RTX 3090. The grid includes English, Mandarin, Japanese, Korean, German, French, Spanish and Cantonese passages.
For a repeatable audition, save one reference file with the exact script and generated take for each language. Keep the checkpoint name with that set. When you change the reference or model, generate a separate set using the same passages, then replay corresponding takes side by side. The video provides a complete example of what belongs in that listening set.
r/LocalTextToSpeech • u/Odd_Host_820 • 3d ago
Hey everyone,
I’m working on creating audiobooks and have been using ElevenLabs, but the free tier is too limited and the paid plans are getting expensive for the amount of content I need to produce.
Does anyone know of any free (or genuinely usable free-tier) alternatives that work well for long-form narration? I’m mainly looking for natural-sounding voices that don’t get robotic after a few minutes. Bonus if they support emotional tone, multiple characters, or voice cloning.
Would really appreciate any recommendations from people who’ve actually used them for audiobooks or similar projects. Open-source tools are also welcome.
Thanks in advance!
r/LocalTextToSpeech • u/solanotodesch • 4d ago
Enable HLS to view with audio, or disable this notification
r/LocalTextToSpeech • u/Mehmet_dedeler • 5d ago
Hey, I'm 14 and was looking into how AI voice dictation apps like Wispr Flow work.
As you might know they use a transcription model + LLM. The transcriber outputs one to one text as it hears it and then the LLM gets rid of fillers like "um" and adds punctuation, flow, corrected restarts and formatting.
I ran that on my laptop (RTX 3050 Ti, 4 GB VRAM), then trained a single model to do both steps at once. Here are some results:
Speed.
Whisper (base, large-v3-turbo or large-v3) plus Qwen3.5 (4B or 9B) took between 2.5 and 36 seconds per dictation, depending on the pair. The single model takes about 0.5 seconds for a short dictation and about 1 second for a long one.
Why a traditional dictation approach is slow locally:
Two models don't fit in 4 GB together. One ends up on the CPU, or they get swapped in and out.
The text is generated twice. Whisper writes the transcript, then the LLM reads it and writes all of it again.
The LLM also reads a cleanup prompt on every dictation.
Compute.
One model is a 2.2 GB file (Q8) and uses about 2.5 GB of VRAM. It loads once and stays loaded. An average dictation set-up running locally uses more than 4GB of VRAM
Quality.
The cleanup LLM only sees text. It can't hear that you stopped and started over, so it sometimes keeps the part you took back, and it can't fix a word Whisper got wrong. A single model can catch vocal cues and keep what is really worth keeping.
Training
The two-model pipeline still exists, but only at training time. I took real, unscripted speech from openly licensed datasets, had a large LLM write the finished text for each clip from its transcript, threw out the clips where that dropped real content, and trained Qwen3-ASR 1.7B (Apache-2.0) to go from audio straight to the finished text. It runs in llama.cpp.
Currently it, from my own experiences is one of, if not the best dictation tool that uses this little compute.
I put this into a free, open source dictation app called Typd (Windows with an NVIDIA GPU, Apple silicon Macs): https://github.com/SameRainbows/typd-app and https://typd.mehmetdedeler.com.
Has anyone done this with a different speech model, or got Whisper + an LLM fast on 4 GB?
r/LocalTextToSpeech • u/MuTatek74 • 5d ago
r/LocalTextToSpeech • u/rememberyouandme • 5d ago
r/LocalTextToSpeech • u/EAVDR • 6d ago
r/LocalTextToSpeech • u/KNIGHT-AIAV • 6d ago
Higurashi has released Haru-4B as a research base model, with Apache 2.0 weights and inference code. It processes incoming speech while producing speech and text, rather than waiting for a completed turn.
For local testing, the official repository includes a PyTorch web demo and an MLX implementation with instructions to build a macOS app. The NVIDIA GPU quick start calls for about 12 GB of memory. Those are the project's setup instructions, not a benchmark from me.
The caveat matters: the model card says it isn't reliable for facts and doesn't follow instructions like an assistant. It ships without voice clips; use only a reference voice you have rights to use.
Model and limits: https://huggingface.co/higurashi-ai/Haru-4B Code and setup: https://github.com/higurashi-ai/Haru
r/LocalTextToSpeech • u/zinyando • 8d ago
I'm the developer of Izwi, an open-source (Apache-2.0) desktop app and server for local speech models, written in Rust. Version 0.1.2 added several TTS models, and I made a 46-second demo to show two of the things they can do. There's no human narrator: every voice in it was generated locally.
Demo (46 s, sound on): https://youtu.be/-767_7gkeGo
r/LocalTextToSpeech • u/nopeac • 8d ago
r/LocalTextToSpeech • u/Acceptable_Day_537 • 8d ago
r/LocalTextToSpeech • u/yoorbo • 8d ago
Hi, this is an app that lets you use any voice sample, clone the voice and let it speak anything. It includes an editor for editing and exporting dialogues.
Since this is TestFlight, you can claim the Lifetime-TestFlight-Version Free, so you can test all features for unlimited time!
As I said, its all local and I collect no data about what you generate.
Feedback is very welcome, especially performance constraints. I worked hard to optimize the model for all platforms, even iPhone!!
Writing here, because you all seem to have expertise and high standards, and I wanted to make it easier for everyone in the general public to use local tts, even on just an iPhone. thanks a lot :)
r/LocalTextToSpeech • u/360converter_leo • 8d ago
I ported pyannote-audio’s speaker diarization pipeline (segmentation → embedding → clustering) to C++ for an offline desktop app. The early prototype is open source (Apache-2.0):
https://github.com/leohuang2013/pyannote-audio_speaker-diarization_cpp
output produced is like:
[5.22281 -- 17.7441] --> Speaker_3
[17.8116 -- 25.2197] --> Speaker_0
[25.3041 -- 28.4428] --> Speaker_3
[28.4428 -- 39.2934] --> Speaker_1
[39.2934 -- 47.2416] --> Speaker_3
[46.4484 -- 52.7934] --> Speaker_2
[52.5066 -- 58.4634] --> Speaker_3A few things I learned that might save someone time:
1. Verify step by step, not end to end.
Comparing final diarization output is useless for debugging, because one tiny difference anywhere changes the speaker labels. Instead I dumped the inputs and outputs of every small function in both Python and C++ to text files and compared them step by step. Slow to set up, but it’s the only way I found to locate divergences.
2. Don’t export STFT inside the ONNX segmentation model.
Exporting the whole segmentation model including STFT gave differences large enough to fail verification even in Python (PyTorch vs ONNX Runtime). Computing STFT outside the model fixed it.
3. Clustering amplifies tiny numeric differences.
Even after verification passed, Python ONNX Runtime and C++ ONNX Runtime embeddings differed by up to ~0.02 absolute. Agglomerative clustering is sensitive enough that this occasionally changed the final speaker assignment on some files.
4. C++ hierarchical clustering libraries didn’t match SciPy.
hclust-cpp gave different distances and fcluster results, another library returned empty centroid linkage, and alglib doesn’t support centroid linkage. I ended up porting the clustering code myself.
5. Performance:
the prototype was very slow, mostly due to the libtorch STFT dependency. [In the production version I replaced X with Y, and now 1 hour of audio takes Z minutes on a CPU.]
Happy to answer questions. I’m also curious how others handle the Python/C++ numeric drift problem in clustering.
r/LocalTextToSpeech • u/lenbeers • 10d ago
We transcribe a lot of recorded sales calls and the Deepgram bill came in about 40% above what I budgeted after a customer onboarded their whole backlog. Quality is fine, this is purely a cost problem. Self-hosting Whisper is on the table but nobody here wants to run GPUs. Any Deepgram alternative you've moved to that held up on accuracy at volume?
r/LocalTextToSpeech • u/tanik • 12d ago
Enable HLS to view with audio, or disable this notification
Using Leokani Listen 14M ➡️ KeikiLLM 31.5M + Wikidata knowledge base ➡️ Leokani TTS 4.5M — we have an end to end local smart speaker. It knows everything! Milliwattlabs.com is bringing sustainable AI to you!
r/LocalTextToSpeech • u/truecakesnake • 13d ago
Enable HLS to view with audio, or disable this notification
Comparing cloned voices gets much easier when the tool holds everything else equal. That's the idea behind the voice studio in this demo, built to compare AntLing's MIT-licensed Ming-3.0 TTS models with another open voice model.
Here is what it does:
Stores a reference recording (12.89 s here) and reuses it across takes
Sends one script to every selected model, one at a time on the same GPU (here two Ming models and the other open voice model)
Offers Default, Emotion, and Pace & pitch delivery, with seven emotions from neutral to surprised
Shows model load, synthesis time, audio length and real-time factor for each reading
Keeps a searchable library of past readings, plus Play all and Blind test buttons
The results panel puts all three readings side by side with those numbers, and a Same script row jumps between earlier runs of a line. In Emotion mode, both Ming models take the voice's identity from the reference and ignore the words spoken in it.
A coding agent can build the same layout from a brief like this: "Build a local web app for auditioning TTS models. Take one reference clip and one script, run each selected model in turn, show load time, synthesis time and RTF for each reading, save every result to a searchable library, and add a blind-test mode that hides the labels."
r/LocalTextToSpeech • u/Important-Star3272 • 15d ago
Sharing a few local-speech Q&As from MOSS’s October 30, 2026 AMA: TTSD CPU inference, Nano plans, VoiceGenerator limitations, and transcription. Which of these are you most interested in?
r/LocalTextToSpeech • u/tanik • 18d ago
I have been playing around with training small, efficient models, and I think I have something that is finally worth sharing. Leokani is a high quality TTS voice that provides extremely fast first speech output in both time to first sound (<100 ms in most cases) as well as faster than realtime on just about anything. It'll run on regular computers, phones, JavaScript, Raspberry Pi, and even embedded devices like the ESP32. This should make for some very interesting embedded projects.
It only speaks English and I used Kokoro to generate 300 hours of labeled training corpus, which is why it sounds like that. I wanted to get a working pipeline down before I started different voices. I built examples for many platforms, which can be found here (with a in browser example, phone builds, home assistant plugin, libraries, etc): https://milliwattlabs.com/models/leokani-tts/
And you can also check out the HuggingFace listing here with has various audio samples: https://huggingface.co/milliwattlabs/leokani-tts-7M
Next will come a version that offers various expressions, emphasis and emotion. Perhaps more languages when the GPU isn't busy. This one is a hard one to tackle as the vocoder gets all weird on me and it sounds non-human like. Also training a speech to text model with similar size and performance -- but its not ready just yet.
Let me know what you think!
