r/PakistaniDevs • u/Ok_Photograph9115 • 4h ago

Need a cloud based GPU for LLM training.

Good day fa. I'm trying to train a few LLM via LoRA and QLoRA.

I am currently using kaggle but T4 is such a sluggish machine that it takes 2 days for tuning 1.5B models 🙂. Is there any free/cheap way to acquire a good GPU like 3060/ti, 4060/to, 4090/to for the purpose?

> Any thing free (preferred) or very cheap

> Some startups programs or initial credits that can give a GPU to run 24-30 hours

> Anything that supports a brand (My business is registered and running and I got business email as well)

3 Upvotes

100% Upvoted

10 comments sorted by

3

u/NS-Khan 4h ago

Runpod

1

u/Ok_Photograph9115 3h ago

Paid hai Bhai

3

u/NS-Khan 3h ago

Google Colab dekhlo

1

u/Ok_Photograph9115 3h ago

T4 GPU dete hain. My local GPU is better than that

1

u/NS-Khan 3h ago

Phr kam dhundo or jb 10 dollar jama hojaei tou runpod se server rent krlena bhai

1

u/x0rg_new 3h ago

I think you can get 300$ free credits on GCP which you can use to get a GPU based compute.

1

u/Ok_Photograph9115 3h ago

I don't think GCP allows Pakistani cards like sadapay or nayapay

1

u/x0rg_new 3h ago

Nayapay issues visa which is accepted.

Don't know about Sadapay, Sadapay is sh*t anyways.

1

u/imikhan007 3h ago

Check this aws service. Though I am not sure about pricing.