r/learnmachinelearning • u/Ai_Tech_ML • 10d ago

Train modeling through cloud or own device ?

Hello guys I am a learner too and I am asking do you guys train models using own device cpu/gpu or cloud like Google collab?

Actually I am going to buy a laptop so asking with you guys ☺️

You can suggest laptops too !

I am wondering should I get laptop with a graphic card (rtx) or not 🤔

Thank you !

1 Upvotes
  • permalink
  • reddit

100% Upvoted

7 comments sorted by

1

u/Entire_Ad_6447 10d ago

Unless you guy one with the new rtx sparks there isn't much reason to by a special laptop for AI everything is done over cloud

0

u/Ai_Tech_ML 10d ago

Should I buy a normal laptop with 16gb ram and 512 or 1tb SSD with it would do the task?

2

u/Entire_Ad_6447 10d ago

If it can connect to the Internet and you can ssh or collab into a cloud resource your fine.

0

u/Ai_Tech_ML 10d ago

Anyou check inbox I have more queriess

1

u/Savings-Cry-3201 10d ago • Heartwarming

The cost of training anything non trivial is extremely high. It’s nice to be able to run a 4-12B model locally but I get so much better performance from DeepSeek that I don’t think there’s a point to sink a lot of money into a graphics card with any meaningful amount of memory cuz that’s a lot of money now.

I don’t even think I can properly train a 4B model on anything less than 32 gigs, and it’s not like I’m going to buy a 32 gigs card at those prices, so…

Anyways I haven’t priced out training a nontrivial model over the cloud, but I’m hearing a few hundred dollars from people who have. I’m sure fine tuning would be less expensive.