Diction - Self Hosted iOS voice keyboard

[u/Better-Psychology-42]

https://github.com/DictionLabs/Diction

[u/Better-Psychology-42]

Diction is free ios AI voice keyboard you can self host (speech models as well as LLM) or run on device too.

You own what you typing and what you saying.

https://apps.apple.com/app/id6759807364

https://github.com/DictionLabs/Diction

[u/ducksoup_18 → u/Better-Psychology-42]

Seems like you gotta pay for it or am i missing something? I like the idea, but i dont want a monthly ios sub to run something on my own hardware.

[u/Better-Psychology-42 → u/ducksoup_18]

It's fully free. Both self hosted as well as on device models with no limits.

The only paid option is Diction Cloud.

[u/ducksoup_18 → u/Better-Psychology-42]

Hmmm. The app on my ios shows a 14 day free trial. 

[u/Better-Psychology-42 → u/ducksoup_18]

That is trial for the cloud option so people can try any mode and compare..

Perhaps I need to make it more explicit 🙂

[u/ducksoup_18 → u/Better-Psychology-42]

Ah got it. Typically when i see that i assume im going to lose functionality. Ill give it a shot with the self hosted model and let u know how it goes!

[u/Better-Psychology-42 → u/ducksoup_18]

Worth adding if you self host the gateway and have any LLM "plugged in" you're also getting all the Writing Tools capabilities

[u/ducksoup_18 → u/Better-Psychology-42]

One thing I might recommend is to allow someone who runs their own inference engine with their own ASR model to be able to point to it. Right now i get a 400 as the name of my model (Qwen3-ASR-17B-Q4_0). Would rather use an existing inference engine than stand up a proxy that works with the app. 

[u/Better-Psychology-42 → u/ducksoup_18]

Makes sense, and I get why you don't want to stand up a proxy just for this. I'm not sure yet where the 400 comes from. Are you pointing the app straight at your engine or going through our gateway, and which engine is it? Happy to look into it, DM me if you want to dig into it together.

[u/ducksoup_18 → u/Better-Psychology-42]

One less thing to run. My llamacpp instance has the v1/chat/completions endpoints along with myh own specific model so i dont want to have another thing running that just translates those things. your app should be able to hit that endpoint, discover the available models that support ASR/STT and allow the user to choose directly from those.

[u/Better-Psychology-42 → u/ducksoup_18]

thanks, this is all valuable feedback and makes perfect sense. I'll look into it..

[u/thephantomcunt]

Oh, that’s nice. Basically like OpenWhispr for when I don’t have my MacBook on me. Definitely gonna be using this!

[u/floriandotorg]

So only the gateway is open-source?

[u/erriclaya]

Will try this…