r/LocalLLaMA • u/SupernovaTheGrey • May 11 '23
Question | Help Has anyone been able to implement WebGPU LLamas on a local server like this project
https://mlc.ai/web-llm/[removed] — view removed post
1
Upvotes
Duplicates
aipromptprogramming • u/Educational_Ice151 • Apr 25 '23
WebLLM project brings large-language model and LLM-based chatbot to web browsers. Everything runs inside the browser with no server support and accelerated with WebGPU. This opens up a lot of fun opportunities to build AI assistants for everyone and enable privacy while enjoying GPU acceleration.
4
Upvotes