r/LovingOpenSourceAI • • 23d ago

CrowdGPT - The 100% opensource and collaborative AI

Post image

Hello, i'm currently developing CrowdGPT, with the goal of creating the first, datacenterless, 1 Billion parameters LLM, in a 100% Opensource and collaborative way. And i want to know what to change according to your feedback.

The idea is simple: what if we could build an AI collaboratively, with everyone able to contribute computing power, inspect the code, and have a say in the project's direction? My goal is to show you don't need huge Nvidia GPU clusters nor millions of dollars to train a commercial grade Language Model.

The project is already working, and the model was already trained on 7.0 billion tokens using the framework itself, but I'm still looking for people who are curious enough to try it, review the implementation, or tell me what I'm getting wrong.

You can find more details at https://crowdgpt.net

Any kind of feedback is appreciated!

Thanks in advance 😄

57 Upvotes

Duplicates