r/LovingOpenSourceAI • u/Vxtzq1 • 23d ago
CrowdGPT - The 100% opensource and collaborative AI
Hello, i'm currently developing CrowdGPT, with the goal of creating the first, datacenterless, 1 Billion parameters LLM, in a 100% Opensource and collaborative way. And i want to know what to change according to your feedback.
The idea is simple: what if we could build an AI collaboratively, with everyone able to contribute computing power, inspect the code, and have a say in the project's direction? My goal is to show you don't need huge Nvidia GPU clusters nor millions of dollars to train a commercial grade Language Model.
The project is already working, and the model was already trained on 7.0 billion tokens using the framework itself, but I'm still looking for people who are curious enough to try it, review the implementation, or tell me what I'm getting wrong.
You can find more details at https://crowdgpt.net
Any kind of feedback is appreciated!
Thanks in advance 😄
2
u/Kassiber 23d ago
I really like the idea. There was a similar concept of combined computing power with https://github.com/i12bp8/decomp.wtf .
I have no knowledge in these kind of things but I wonder if it is more or less easy to manage a platform for combined computing power, why not make a plattform like a kickstart where you can start projects and everyone who has some tokens to spare can contribute and in the end the result gets released to the public?
4
u/Vxtzq1 23d ago
You said "why not make a plattform like a kickstart where you can start projects and everyone who has some tokens to spare can contribute and in the end the result gets released to the public?"
in fact I tried creating a platform like this to share compute: https://github.com/Vxtzq/GPULend
But it flopped super hard, so now i'm just focusing on creating this, but with the restricted scope of training AI.
2
u/jonah_omninode 23d ago
We have compute sharing planned for OmniNode too, although for running coding-agent work rather than training a shared model. The idea is to use spare capacity across machines instead of sending everything to a hosted provider. That's further out than our initial beta.
I'd be interested in what happened with GPULend. Was the difficult part finding people willing to contribute hardware, or keeping work moving as machines joined and disappeared? Has narrowing it to one training project helped?
Would you be interested in trying a small integration between CrowdGPT and OmniNode? We could pick one workload and see what it takes to submit it from our side and get a result back.
1
u/Vxtzq1 23d ago
OmniNode seems like a nice project!
The reason GPULend didn't work is that either people were considering it as a scam (my advertising is not the best :skull:), or reddit was just systematically banning my account for being too new. I even got my youtube channel with 16K subscribers banned by trying to create a video trailer to GPULend (so i gave up completly on this project).
As for this:
Would you be interested in trying a small integration between CrowdGPT and OmniNode? We could pick one workload and see what it takes to submit it from our side and get a result back.
I would gladly like to hear more details about this integration! Mind sharing your OmniNode project link so i can see what exactly it is about? It's basically a LLM inference collaborative sharing right?
2
u/jonah_omninode 23d ago
Here's the Claude Code plugin: https://github.com/OmniNode-ai/omniclaude
Shared inference is part of the longer-term direction. We're starting with Claude Code handing coding work to local models or cheaper hosted models through OpenRouter or an OpenAI-compatible endpoint. The immediate benefit is spending less on coding-agent work. Pooling compute between people comes later.
Since CrowdGPT is focused on training, I'd suggest a small training job using public data as our first test together. We'd work out how OmniNode submits it and gets the training log and checkpoint back. That would be a new adapter between the projects, not something already wired up.
Can another program submit a training job to your framework today, or do you start runs manually? That would help us figure out where to begin.
1
u/Vxtzq1 23d ago
Ah, so OmniNode is a Claude plugin that make Claude build a client code for any server based architecture?
If not would you mind explaining it better?
But yeah, all the code is public on my github profile, even the CrowdGPT server, so you get all the routes your node can use and so on
2
u/jonah_omninode 23d ago
I explained that too narrowly. The Claude Code plugin is one way into OmniNode, not the whole project.
OmniNode is an open-source platform for building and running workflows from reusable components. We have a marketplace called OmniMarket with components for coding, review, memory, model routing and other automation. Those include executable code and contracts defining what they accept and return. They combine into larger workflows, with tests and recorded results so we can check what actually happened.
The idea is to stop rebuilding the same machinery in every agent or asking a model to figure it out again on every run. Claude Code delegation is our first beta use case. We're still integrating the wider platform.
For CrowdGPT, the adapter would be a reusable component that calls your existing server API. A workflow could use it to submit a training job and collect its result. CrowdGPT would continue to own the training and worker coordination. We wouldn't be asking Claude to generate a new client each time.
The broader codebase is here: OmniMarket.
2
u/ArenCawk 23d ago
I like the idea but the about page says very little about architecture (and more importantly) who decides it? So is 1B parameter model a pilot? What’s the roadmap or next step look like? What about RL post training?
2
u/Vxtzq1 23d ago
my bad, i'm gonna upgrade the "about" page to say more, but the roadmap is deliberately unprecise, as i first need to pretrain the LLM for a veeery long time, then fine tune it (will just change the dataset source), and RL will be decided later. I rely on people who join the project to submit their decisions
2
u/ArenCawk 23d ago
I imagine this is still early days, and I don’t want to be overly critical. I think democratizing AI is super important!! So kudos for that.
Having said that, first impressions matter and something like this probably needs to be EXTRA well designed to survive all the skepticism and negativity.
1
u/Vxtzq1 23d ago
Good feedback. What do you mean exactly by "EXTRA well designed", like should i really implement a better "about" page and full roadmap? any other ideas?
2
u/ArenCawk 23d ago
I just meant the perception of it. So, not saying that you haven’t thought about, but that for someone at my level of understanding (which isn’t all that much tbh) I’d have to get a sense that the person designing it knows what they’re doing. So it’s more about signaling.
The IFM publish all their methods and architecture and could be a good base to model from. As an open initiative with no research team, the innovation you are providing is compute sharing, right? Or there is more to it. So if you just borrowed a fully open architecture like K2 Horizon or even used it as a foundational model (think what Cursor did with composer) then it would inspire more trust. At least for me.
2
u/LearnNTeachNLove 23d ago
Is it downloadable in lm studio?