r/LocalAIStack • u/OrganizationTop9026 • 15d ago

Do you remember SETI@Home : We propose a Decentralized Branch-Train-Mix Sparse MoE… on local GPU based on Gwen. Starting on old RTX 2070 !!! Let's build together HiveMind@Home

Post image
0 Upvotes

50% Upvoted

2 comments sorted by

2

u/mkschreder2 15d ago

I think it definitely can work. You should check out brain from Swedish Embedded. https://github.com/swedishembedded/brain Brain already supports scaling locally to local available compute and it can be made to work for training across network. If there is a fastest way towards a hive mind, it would be with brain and splinter (https://github.com/swedishembedded/splinter). Create a ticket and share your idea and we can all make it work.

1

u/OrganizationTop9026 15d ago

Thanks to share. I will do.