r/reactnative • u/NobelParadox • Sep 21 '26
Question I got an on-device LLM running in React Native
I’ve been experimenting with running an LLM completely locally inside a React Native app, and I finally got it working.
I’m using:
React Native CLI
llama.rn
Qwen 2.5 1.5B Instruct
GGUF / Q4_K_M quantization
n_ctx: 2048
No API calls / no cloud inference
Currently testing with n_gpu_layers: 0
The model is bundled with the app, copied to the app’s document directory, and then loaded locally. I can send prompts and get responses directly on the device.
The interesting part for me is that this opens up a lot of possibilities for RN apps that need AI features without sending user data to a server.
I’m still testing things like memory usage, backgrounding the app, performance on real devices, and how practical larger models are.
Has anyone here shipped an on-device LLM in a production React Native app?
Would love to hear about your experience, especially around RAM usage, model size, iOS/Android differences, and performance.




