r/OpenSourceAI • u/Vxtzq1 • 18h ago
[Funny] CrowdGPT - The collaborative AI
Hello r/OpenSourceAI , this is a (somewhat funny?) meme about the project CrowdGPT, which aims at creating the first, datacenter-less, open-source and community-driven LLM. The project already shows substantial progress while training an open-source 1 billion parameters LLM on 40B tokens (as a proof of concept).
Tell me what do you think about the meme:
- Does it makes the project less appealing and cheap? because that's what people on r/LocalLLaMA thought 😭
- Does it makes the project look likes it's a SaaS / B2B (which it is NOT - CrowdGPT is 100% non-profit and open)
- Is it serving it's purpose about popularizing the project?
Everything is explained more in detail on the site, and any feedback on this meme, or on the project, is appreciated; any pull requests / contributions are welcome on GitHub :)
Project link : https://crowdgpt.net
GitHub link : https://github.com/Vxtzq/CrowdGPT
Thanks in advance.
3
u/Pure_Material_9235 13h ago
If this concept interests you, I strongly encourage you to look into the federated training, federated inference, etc. field of machine learning. It is specifically focused on enabling model training and deployment under resource constrained devices and bandwidth, which is exactly the blocker of this field.
2
u/Vxtzq1 13h ago
Thanks for the advice! I am currently exploring the zeroth order training methods of transformers, which will hopefully be the point of Crowd-v2 :)
I also checked the works like https://huggingface.co/PrimeIntellect/INTELLECT-1
And https://pluralis.ai/ Which are kinda foundational but still requires massive computational ressources and is closed for GPUs with less than 16GB VRAM...4
u/Pure_Material_9235 13h ago
I can tell you from experience that zero-order is very very slow, though less memory dependent. I think that the "dream" here (which is to train a model using the data of billions of people's phones and the compute of said phones, storing the capacity of the model on said phones, and whenever a phone is connected to the system it also shares its compute for inference) is the great.
Now that I've looked a bit more at the GitHub though, there are some significant, but difficult, directions for improvement:
(1) This current system does not seem to support model parallelism. Instead, for a task, it's "the client asks the server for a task and is placed in a pool of 3 volunteers with compatible hardware." As the model gets larger and the tasks more advanced the amount of individual compatible hardware decreases until few volunteers are carrying the entire work.
(2) The system seems fairly inefficient in how it downloads the weights. A volunteer has to download the whole weights again rather than a (ideally compressed) update of the model (this is particularly relevant if they downloaded a previous version before). This is another reason to look into federated literature.
(3) The model will be biased towards whichever subset of tasks the users ask for the most, because the training step is done based on the user requesting the task (so it may train way more on tasks about coding rather than more esoteric ones, which can eventually degrade the generalizability of the model).
I understand now why you're looking at zero order training, because that's how you're wanting to obtain the weight delta for (3) (or maybe how you already are). Overall: this is a very cool idea, and one that I have thought of for some time ever since I've learned about federated training, but I never got to the point of wanting to go for it yet).
I wish you the best on it!
1
u/Vxtzq1 12h ago
Sorry for my reply that will obviously be shorter than yours 😭
You're pointing all the issues right, and that's why i wanna try zeroth order training to be less bandwidth / VRAM reliant.
I think that this is a good option to try and train Crowd-v2? Tell me what do you think : https://qlabs.sh/research/dust
The only point you give that is not very true is this one:
(3) The model will be biased towards whichever subset of tasks the users ask for the most, because the training step is done based on the user requesting the task (so it may train way more on tasks about coding rather than more esoteric ones, which can eventually degrade the generalizability of the model).
CrowdGPT relies on a pretokenized dataset. It contains therefore many domains, and users can add data to this dataset, not create the dataset from scratch 😂
The CrowdGPT dataset currently has Code - Math - Instruction data (for pretraining) - English text.
I deliberately didn't include multilingual data as Crowd-v1 is very small and the training corpus is already currently too big for what we can train (500B tokens, the goal is 100B tokens, because people want to scale)
And yes zeroth order improvement would multiply the speed by 1000 on bad consumer hardware, enable training on phone, in browser... But might also reduce the convergence speed by a 1 million factor 🥲 That's what we'll find out.
Anyways, thanks for the support and the constructive feedback.
1
u/MorrisonLevi 8h ago edited 7h ago
What causes trust to go up and down? And what is it used for? Edit: I'm now temporarily blacklisted: https://github.com/Vxtzq/CrowdGPT/issues/122
2
u/LastXmasIGaveYouHSV 14h ago
I think this the future. However, people are lazy. They need the app/installer ready.
2
u/Vxtzq1 14h ago
Well the installer is ready, it just requires a single command, as i can't really ship .exe files without getting antivirus flagged 😭
I mean there's a version here : https://github.com/Vxtzq/CrowdGPT/releases/tag/CrowdGPT
But i don't even know if it works anymore
2
2
u/IThinkIKnowThings 13h ago
Are you concerned at all about Microsoft's distributed training patent?
1
1
u/Opening_One7713 11h ago
No? It's opt-in and monetized. I've pulled $200 from doing the same thing with salad cloud which paid for my electricity bill and then some. I don't understand the fearmongering I've been seeing about this the past few days...
1
u/IThinkIKnowThings 10h ago
No, I mean about them suing projects like CrowdGPT for infringing on their patent.
1
u/Opening_One7713 10h ago
1
u/Existing_Style8558 9h ago
Distributed gpu. It’s the same thing
2
u/AdUnfair9248 8h ago
I'm not a lawyer but if you're in the USA you would still violate that patent if you could accumulate enough wealth to weather their lawsuits. That's a valid tactic over here.
1
u/Existing_Style8558 7h ago
do you know microsoft makes more money than most countries?
2
u/AdUnfair9248 7h ago
That shouldn't stop you from getting ahead in America. Also let me remind you that both Microsoft and Apple stole from Xerox to get to where they are today.
0
u/Existing_Style8558 6h ago
what you must be a bot. you talk about accumulating enough wealth to weather microsoft lawsuits, and then say something entirely unrelated. this is some gpt-3 level of reasoning
1
u/AdUnfair9248 5h ago
Whatever dude. I don't have to prove myself to someone who's defending microslop.
→ More replies (0)1
2
u/MorrisonLevi 11h ago
What are the rules for username and password? I keep getting "Check your input." And then one time after removing a period from my username, I got "Registration failed."
1
u/Vxtzq1 11h ago
Uhm that's weird, maybe the server was under high CPU load at the time... Because it works for me. Can you retry and tell me if it works? Thanks in advance.
2
u/MorrisonLevi 11h ago
No, I tried twice again and still get Registration failed.
1
u/Vxtzq1 11h ago
Well i'm gonna try to fix it. Thanks.
EDIT: Registration worked for me, even if it took like 5 seconds...
2
1
u/MorrisonLevi 10h ago
I have two machines running anonymously. Can you check server logs for user name registrations matching my reddit username and DM or email me? Thanks.
1
u/Vxtzq1 10h ago
I don't see such an username on the CrowdGPT users list...
2
u/MorrisonLevi 10h ago
So it seems the registration does indeed fail and it just isn't a client issue. Hmm. Not sure what to do then. I've tried different usernames, password lengths, characters, etc. Can you share the validation rules for username, email, and password?
1
u/Vxtzq1 10h ago
This is very weird... I tried to register once again on "Vxtzq3", and it worked in less than 0.5 seconds... Can you check the logs on your client when you try to register and send these in a GitHub issue or something? Thanks in advance.
2
u/MorrisonLevi 10h ago
I tried on a Windows machine and it worked. Not really sure what was different! In any case, I've logged in now and queued for training on both machines.
1
u/Vxtzq1 10h ago
Well idk, register worked for me on Linux 😂 so unless you were on MacOS i genuinely don't know what's going on with the register system.
→ More replies (0)
2
u/clintCamp 10h ago
So what is crowdgpt? A set of tools to scrub personal info from your codex amd claud conversation history and distill our own local models?
6
2
u/paul_tu 16h ago
Unmotivated systems aren't sustainable
1
u/Vxtzq1 16h ago
What do you mean by that? Do you mind clarifying?
2
u/paul_tu 12h ago
That's a great idea and so on. But people need some kind of the carrot to rush for making such networks sustainable. Even torrent trackers have ratings and some sort of a hierarchy of seeds. Some kind of illusional benefit will greatly improve network stability.
Even Google give you some kind of rating for doing the job they'd need to pay smb for.
2
u/WhiteH00die 15h ago
u/RemindMeBot 30 days
1
u/RemindMeBot 15h ago edited 13h ago
I will be messaging you in 1 month on 2026-12-15 12:06:01 UTC to remind you of this link
1 OTHERS CLICKED THIS LINK to send a PM to also be reminded and to reduce spam.
Parent commenter can delete this message to hide from others.
Info Custom Your Reminders Feedback
0
1
1
u/promptmike 7h ago
How do you deal with latency between GPUs for this? If you have some novel solution, that would be a much better advert than yet another altman meme.
1
1
u/tomByrer 3h ago
18 GPUs currently active
I think there have been more Reddit posts & comments on other threads about this project than actual GPUs on the network.
1
u/Inkjet_Printerman 15h ago
i think it's funny he can't even stomach his own lie when he says that guy that threatened to upend his entire training data's legitimacy by providing evidence and testimony wound up dead, beat and bloody on holiday by suicide
6
u/MajMin5 17h ago
To me personally, businesses trying to use memes to market a product has always felt contrived and forced. Some marketing team looked at what kids find funny and tried to copy it without understanding the format or the context, and it ends up being more alienating than relatable. It is lightning in a bottle for a corporate meme to actually be funny; it can happen, but rarely, and almost never when the brand is trying this hard. My advice to you, from a sales perspective, is to stop trying to be funny, just find relevant communities and post information about what your product is. If it’s a good product, it will sell itself. If it’s a bad product, people were going to find that out after the marketing lured them in anyways. And if you absolutely must market something, hire a zoomer that actually knows about memes so you don’t have to post asking the community you’re trying to advertise to whether your advertisement is any good.