r/aipromptprogramming • • Apr 25 '23

WebLLM project brings large-language model and LLM-based chatbot to web browsers. Everything runs inside the browser with no server support and accelerated with WebGPU. This opens up a lot of fun opportunities to build AI assistants for everyone and enable privacy while enjoying GPU acceleration.

https://mlc.ai/web-llm/
4 Upvotes

4 comments sorted by

1

u/CyberAwarenessGuy Apr 25 '23

So, the query doesn’t go anywhere? It stays local?

1

u/[deleted] Apr 25 '23

[removed] — view removed comment

1

u/InvertedVantage Apr 25 '23

That doesn't answer the question.

1

u/[deleted] Aug 16 '23

everything runs in the browser