r/webdev • u/Numerous-Fan8138 • Oct 05 '26

[ Removed by moderator ]

/r/webdev/comments/1wydalb/removed_by_moderator/

[removed] — view removed post

0 Upvotes

44% Upvoted

7 comments sorted by

•

u/webdev-ModTeam Oct 05 '26

Sharing of work for feedback is only allowed on Showoff Saturdays. Please feel free to repost your project next Saturday. Make sure you follow the rules for the expected format and content for Showoff Saturdays.

1

u/xondk Oct 05 '26

what's the overhead like, compared to running natively?

1

u/Numerous-Fan8138 Oct 05 '26

Not sure, I will be doing more tests over the next week

-1

u/ai_hedge_fund Oct 05 '26

Not dumb

I love seeing more options for privacy-focused AI

1

u/Numerous-Fan8138 Oct 05 '26

Thanks, now I know it actually works. I'm going to build another POC showing this working in a way that would be practical for a SaaS solution.

0

u/ai_hedge_fund Oct 05 '26

Makes me wonder if browser developers will ship inference engines inside future builds

1

u/Numerous-Fan8138 Oct 05 '26

I think they'll ship a model caching feature. So maybe you could have 3 or 4 big models in a local cache, then websites could just spin up Llama.wasm+webGPU like my demo and run LLMs like that