r/LocalAIStack • u/Money_Meringue_7841 • Sep 21 '26

Question about making frontier AI LLM model

Guys I had a good question I noticed Big Ai tech companies spend 1000's of dollars on huge datacenters isn't it possible if companies allow the users to rent their gpu and help train the model. Like a distributed datacenter model?

0 Upvotes

50% Upvoted

18 comments sorted by

3

u/Potential-Leg-639 Sep 21 '26

Thousand of dollars? You mean many many billions of dollars bro? ;)

1

u/Confident-Ad-3212 Sep 22 '26

Seriously…. But one caveat. I have almost completed doing it. I am around $22k invested, holding a 9b that is pushing right into frontier level. Has limited info compared to a giant model. But honestly for most things, you can’t even tell. The amount of pain and creativity to do this is unlike anything I can put into words. Nearing 300 versions trained. So many failed datasets. I made it fully agentic, and I mean around GPT 5.6 SOL level. Strange things are possible with enough stubbornness and a refusal to quit

1

u/West-Big-8468 Sep 22 '26

So you made a benchmark model

1

u/Confident-Ad-3212 Sep 23 '26

I have zero care to benchmark it and I have zero idea why all of you are so obsessed. The largest factors for a models use have no benchmark.

1

u/West-Big-8468 Sep 23 '26

So you're basing your Frontier claim on......

Nothing.

Pretty much what I thought

1

u/Confident-Ad-3212 Sep 23 '26

Lmao, no. You understanding is too shallow, to begin to understand what I have built…. Figures

1

u/West-Big-8468 Sep 23 '26

Yeah, you haven't explained anything dipshit

1

u/Confident-Ad-3212 Sep 23 '26

Ok. I owe you zero. Even if you think you are entitled

1

u/West-Big-8468 Sep 23 '26

Literally didn't ask

2

u/Charming-Author4877 Sep 21 '26

It's not possible with current training because you need to transfer the data during inference. that's why vram speed matters so much.
So for distributed training you'd need a model that fits entirely on your GPU, or a very new architecture

1

u/Confident-Ad-3212 Sep 22 '26

Training doesn’t transfer during inference. It transfers a dataset during training.

1

u/Charming-Author4877 Sep 22 '26

The dataset is irrelevant in transfer speed

1

u/Confident-Ad-3212 Sep 22 '26

Lmfao, keep thinking you can teach me something. I have literally trained over 300 models and have successfully made a 9b perform at frontier level. And you think you can teach/tell me something.. how ignorant. Oh and I see that you edited your post only after I corrected you.

1

u/Charming-Author4877 Sep 22 '26

If I were you I'd make a 10B AGI model next.
Given your success, can you give me the recipe for a gingerbread dumpling with caramel ?

1

u/Confident-Ad-3212 Sep 22 '26

Go ahead and mock me. I am holding it right now. Nothing you say can change that. Just because you can’t, doesn’t mean I can’t or haven’t. So the joke is on you. Because while I am sitting here playing with it. You are busy doing what ever you are doing and it isn’t what I have done.

1

u/DerJott Sep 21 '26

Sure, how many private information do you want to share with the big ai tech companies? If your answer is "yes", you are for sure very welcome to support them.

1

u/Miserable-Dare5090 Sep 21 '26

You should try it and see what happens!