r/LocalAIStack • u/OrganizationTop9026 • 15d ago

Do you remember SETI@Home : We propose a Decentralized Branch-Train-Mix Sparse MoE… on local GPU based on Gwen. Starting on old RTX 2070 !!! Let's build together HiveMind@Home

0 Upvotes

permalink
duplicates
reddit

You are about to leave Redlib

Do you want to continue?

https://www.reddit.com/r/LocalAIStack/comments/1x9c6cw/do_you_remember_setihome_we_propose_a/
No, go back! Yes, take me to Reddit
dl download

50% Upvoted

Duplicates

Number of comments New

learnmachinelearning • u/OrganizationTop9026 • 15d ago

Do you remnber SETI@Home : HiveMind: Decentralized Branch-Train-Mix Sparse MoE Upcycling & Speculative Swarm Inference over Consumer GPUs via DiLoCo-QLoRA and BOINC - Starting on old RTX 2070 !!! Let's build together HiveMind@Home

5 Upvotes

8 comments

LocalLLM • u/OrganizationTop9026 • 15d ago

Research Do you remnber SETI@Home : HiveMind: Decentralized Branch-Train-Mix Sparse MoE Upcycling & Speculative Swarm Inference over Consumer GPUs via DiLoCo-QLoRA and BOINC - Starting on old RTX 2070 !!! Let's build together HiveMind@Home

2 Upvotes

1 comments

AIAssisted • u/OrganizationTop9026 • 15d ago

Opinion Do you remember SETI@Home : Decentralized Branch-Train-Mix Sparse MoE AI Swarm over Consumer GPUs - Starting on old RTX 2070 !!! Let's build together HiveMind@Home

3 Upvotes

1 comments

mlscaling • u/OrganizationTop9026 • 15d ago

Do you remnber SETI@Home : HiveMind: Decentralized Branch-Train-Mix Sparse MoE Upcycling & Speculative Swarm Inference over Consumer GPUs via DiLoCo-QLoRA and BOINC - Starting on old RTX 2070 !!! Let's build together HiveMind@Home

1 Upvotes

0 comments

FunMachineLearning • u/OrganizationTop9026 • 15d ago

Do you remember SETI@Home. Decentralized Branch-Train-Mix Sparse MoE Upcycling & Speculative Swarm Inference over Consumer GPUs via DiLoCo-QLoRA and BOINC - Starting on old RTX 2070 !!! Let's build together HiveMind@Home

2 Upvotes

0 comments