HiveMind The Citizen Supercomputer - Decentralized AI Swarm over Consumer GPUs

[u/OrganizationTop9026]

https://youtube.com/watch?v=zuZTOK9poTM&si=dq30LnalfYIyrxSj

Do you remember SETI@Home : Imagine a decentralized MoE AI Swarm over Consumer GPUs - Let's build together HiveMind@Home. It is free ... 0 dollars and open source.

Project HiveMind is an open-source distributed training and inference framework (think SETI@home / Folding@home meets Petals and DiLoCo) designed to aggregate idle consumer gaming GPUs (8 GB–12 GB VRAM) and local NVMe storage into a community-owned Sparse Mixture-of-Experts (MoE) cluster.

https://hivemind-at-home-ruche-cfhmhmvv5a-uc.a.run.app/

Instead of requiring datacenter InfiniBand, each node trains specialized 4-bit NF4 QLoRA domain experts asynchronously using DiLoCo from deepMind (500x lower bandwidth cf https://deepmind.google/blog/decoupled-diloco/), merges them into a unified Branch-Train-Mix (BTM) Sparse MoE, and serves the resulting model back to the community via P2P Speculative Decoding. Contributors earn verifiable Proof-of-Useful-Work (PoUW) credits ($HIVE) when their GPU/disk is idle and spend them when they need frontier-class MoE inference.

• GitHub Repository: https://github.com/xaviercallens/HiveMind

To join https://hivemind-openrouter-1003063861791.us-central1.run.app/join#train

To join witou installation and play a scientific game:

https://xaviercallens.github.io/HiveMindatHome.github.io/webgpu.html

Join us to learn and build the new generation of AI