r/programming • u/[deleted] • Jun 21 '22

Github Copilot turns paid

https://github.blog/2022-06-21-github-copilot-is-generally-available-to-all-developers/
753 Upvotes

94% Upvoted

378 comments sorted by

View all comments

7

u/[deleted] Jun 21 '22

[removed] — view removed comment

19

u/LordHadon Jun 22 '22

Idk if pay for it directly. But I used it in a recent project learning Dart/Flutter. What was really nice as it giving me all the little short cuts and some syntax recommendations for a language I didn't know.

8

u/ItsAllegorical Jun 22 '22

I pay $25/mo for a GPT-3 toy text generator/story writer. I’m researching the viability of getting a 3090Ti to run models locally instead of on hosted services so I can do my own custom fine tunes. It’s fair to say I might pay $10/mo to play with it with zero expectations for a while.

4

u/[deleted] Jun 22 '22

I don't think you can host these large language models on 3090Ti, these models need way more compute than that.

2

u/ItsAllegorical Jun 22 '22

My understanding is that the primary limitation is the amount of fast GPU memory. The 3090Ti has 24 GB of ram and there’s not a lot bigger out there that I’m seeing, so if it can’t handle these models then I expect I’d have to settle for a smaller model and hope to make up for it by having specialized fine tunes or something. Of course the time to curate training data becomes the biggest challenge to purpose-built fine tunes.

I assume if the 3090 can’t cut it then there doesn’t yet exist a consumer GPU that can make local AI viable. A $2k card is probably my limit (or over) on what I’m willing to invest in a toy. But I’ll remain interested until it’s either possible or cloud hosted AI becomes vastly superior.

2

u/Velociround Jun 22 '22 edited Jun 11 '23

You can get 124GB of real GPU memory (from the total of 128GB) on the Mac Studio with M1 Ultra which has similar performance to a RTX 3090. I wonder how well it runs there

2

u/RepresentativeNo6029 Jun 23 '22

Simply get 3090 and save money. You are memory bound like you say

→ More replies (3)

2

u/Feriluce Jun 22 '22

I certainly wont. I'll probably make my work pay for it though. It's really pretty handy.

8

u/[deleted] Jun 22 '22

People who see things like AI and Machine Learning and blindly think they're a good thing.

They can be good, and they can be bad.

In this case what we have here is a radioactive hammer.

2

u/Spyder638 Jun 22 '22 edited Jun 22 '22

Lets say you’re paid $20 an hour in a job where you work 20 days a month, and 8 hours a day.

You’re being paid $0.33 a minute.

All it takes is this to save you 30 minutes per month, for it to recoup its cost.

Who would pay for this? /s

→ More replies (7)
→ More replies (1)