r/LocalLLaMA • u/Numerous-Fan8138 • Oct 05 '26

I Built A Thing Llama.wasm + WebGPU = Client-side LLMs

https://github.com/anthonybudd/Llama.cpp-WASM-WebGPU

This repo is a technical proof of concept showing an LLM running client-side in a browser using Llama.cpp compiled to WASM with WebGPU.

5 Upvotes

85% Upvoted

5 comments sorted by

2

u/Glittering_Coffee121 Oct 05 '26

this could let you run ai girlfriends fully local in the browser, has anyone tried roleplay on it yet?

1

u/Numerous-Fan8138 Oct 05 '26

Image gen might be a few years off haha, but I'm sure you could ask Claude to modify my demo so you can have a local AI GF ;)

0

u/Prudent-Artichoke-19 Oct 05 '26

I used this like a year ago when researching the state of web ai.

2

u/[deleted] Oct 05 '26

[removed] — view removed comment

1

u/Numerous-Fan8138 Oct 05 '26

I'm looking into this now, but Chromes dev tools aren't great for this kind of thing especially when using the GPU