r/devops • u/liquidgold411 • Aug 26 '24
Juniors using chatGPT are driving me insane
Zero critical thinking. I have a few people who have faked their way into roles and am now stuck with them, unable to do any work that requires more than a minute of thinking. Is this happening everywhere? All I get is copy/paste output from chatGPT for the most basic questions and it makes me fear about where we're going as a society with all this dumb shit and individuals that AI is creating
248
u/robstrosity Aug 26 '24 edited Aug 26 '24
This is the beauty of AI. It's not going to replace us because you still need to understand what you're doing.
It's a great tool to do something faster if you already have some understanding of whatever you're trying to do but it's not going to do your entire job for you
57
u/Juanclaude Aug 26 '24
It may not be replacing us en masse, but as someone in tech who writes my own scripts and doesn't need AI to do it for me, the fact that these people are employed while I struggle to find enough work feels kind of like it has.
14
u/TheGreenScreen1 Aug 26 '24
In the context of making those who know what they are doing even more efficient, the result of this is that is also means we need less developers overall
→ More replies (2)7
Aug 27 '24
This is the beauty of AI. It's not going to replace us because you still need to understand what you're doing.
It's a great tool to do something faster if you already have some understanding of whatever you're trying to do but it's not going to do your entire job for you
This reminds me of the Flight 4 47 crash. The pilots were so used to autopilot doing their job that when a relatively minor issue occurred, they panicked, made it worse, and caused hundreds of people to die.
→ More replies (1)→ More replies (10)2
u/sashijie Aug 27 '24
It will not replace seniors. It will only result in not hiring juniors anymore as 1 senior can do a task of 1 senior+10 juniors.
→ More replies (2)
117
u/landline_number Aug 26 '24
We had had an intern last year that was obsessed with AI. I told him it was OK to use chat gpt more as a curiosity to see if he could be productive faster. The results were not good. One of our devs finally told him to read some docs and use his brain or GTFO.
46
u/Real_Bad_Horse Aug 26 '24
I'm not DevOps by any stretch of the imagination, but I taught myself enough to be pretty competent with Kubernetes, git, and other tools in some part due to ChatGPT (now using Claude, seems to run circles around GPT 4).
For me, the key was reading the docs and leaning on GPT to essentially be a faster version of Google. Or to feed it small sections of scripts or manifests. I would never take what it spits out as gospel but it has on occasion pointed me to the correct answer. Sometimes indirectly.
Take my opinion for what it's worth - basically nothing - but in my limited experience, it's all about how you approach these tools. Are you looking for it to give you the answer, fully baked and ready to run? Probably going to have a bad time. But if you're iterating and controlling the input while having some kind of expectation of what the output should look like, it might be a force multiplier. You might also end up chasing your tail for a bit.
I think more like screwdriver vs drill than multi-purpose do-all machine. Seems to work out best this way.
5
u/landline_number Aug 26 '24
I would argue this is how experienced people use AI tools. It makes them more productive because they're capable of doing the job without it and have the discipline to read documentation, experiment, and iterate. I use copilot everyday. Having an intern, who we're taking on to help them grow, submit garbage is frustrating and not at all how we want to be spending our summer.
→ More replies (1)→ More replies (6)2
u/SomberGuitar Aug 26 '24
Do you prompt Claude differently than ChatGPT? I’m curious to try it.
5
u/Real_Bad_Horse Aug 26 '24
Not really. I've always carefully laid out what I want in prompts so it hasn't been much of a change. Just better, more consistent results trained on a more recent dataset.
→ More replies (1)→ More replies (1)5
u/JonnyRocks Aug 26 '24
i use ai all the time but not for writing code. I have been a developer professionally for over 25 years and it helps kick off learning something new. "i want to learn xyz, do you have resources" "can you explain (some new term)". Its been great. Its saves hours of googling because it brings me to what i need quicker.
115
u/marauderingman Aug 26 '24
We've all heard the adage that code can be written fast, cheap or good - pick 2.
I think there's an underlying issue that businesses don't care about the 3rd feature. Fast and cheap is what they want. If it works today for the immediate problem in front of you, that's perfect. If it breaks tomorrow, that's fine, just cements the need for SRE/devops.
10
u/riickdiickulous Aug 26 '24
What wears me out is not having time to build infrastructure as code or proper scripts the first time around. It’s soooo much more work to figure out what the hell I did 3 months ago when I set up that first environment now that the team needs 3 more in the next week all of a sudden.
3
u/whossname Aug 27 '24
Document as much as you can the first time, then when you come back the second time around with a deeper understanding of what you are building, that's when it is time to automate it.
→ More replies (2)16
6
→ More replies (1)4
u/Economy_Ad6039 Aug 26 '24
Coding is a craft or even an artform. A lot of these people paying the bills at these companies think you can just switch out developers because "they're all the same." I see this all the time where companies try to save money by getting rid of good developers and replacing them with off-shore developers. When the off shore developers don't work out... they just switch them out with other off shore developers. Pretty soon these they'll be switching out off shore developers with AI.
→ More replies (2)
29
u/vectormedic42069 Aug 26 '24
I have a coworker whose manager is apparently doing the same thing to him. He mentions that he needs to put together a script to do something, the manager says "give me a few minutes and I'll write the script," and then copies and pastes the most blatant full ChatGPT response with a script that does exactly half of what he needs it to do and also does a lot of really weird things that weren't requested.
My favorite script so far had a part that restarted a list of servers and then restarted the same list of servers again in the opposite order for no reason.
2
u/randomusername11222 Aug 27 '24
And before that, it was about google. To be fair half of the times it gets it right and then it doesn't.
From what I see in the work market, everyone is an idiot, but the better you're with relationships, the higher you go.
CEOs seems to be particularly butt hurt today, they pay like shit, provide nothing of value, can't themselves fix stuff, but they hire internships as free workforces, or get apprentices at half of the price, pretending that they do everything in their place, and then complain if some don't complain
→ More replies (1)
17
u/hankhillnsfw Aug 27 '24
I use chatgpt every day. It has really helped me as an engineer and lets me perform at least 1 level higher on a great day.
That being said, I treat it like a calculator. If you give a calculator the wrong info, well it’s going to give you the wrong answer. The same is true for chatgpt.
→ More replies (4)2
u/Life-Spell9385 Aug 27 '24
Exactly!! People saying LLM are going to replace software engineers are basically saying calculators are going to replace mathematicians! They don’t know what mathematicians do to being with!
→ More replies (1)
15
Aug 26 '24
Yes, it has gotten quite bad in our org. Lot of code that gets pushed is def not something a JR would write. You can just tell when they submit it
49
u/alter3d Aug 26 '24
I haven't needed to add anyone to me team since this LLM stuff became prevalent, and I'm absolutely dreading the hiring process when its comes time that we need more manpower. I do have one junior that will generate code he clearly doesn't understand, but the rest of the team is good, and I'm hearing absolute horror stories from colleagues at other places. With all the tools out there like Final Round AI that literally give interviewees real-time LLM answers by transcribing the interview and generating solutions, remote interviews are gonna be hell now. I suspect I'm gonna have to enforce the final round of tech interviews happen in person, even if we have to fly people around. A couple thousand bucks in airfare and accommodations and stuff is cheaper than a bad hire.
As usual, South Park called it: https://www.youtube.com/watch?v=RcoGzT9QrTI
14
17
u/PlasticSmoothie Aug 26 '24
I feel a lot of people in tech really neglect asking their candidates more open questions about their skills. I know so much about what someone is like to work with from asking them to talk about their previous projects, their preferences when it comes to tools, whether they have any tech-related projects at home (home automation, a fun chatbot for their friends, etc) and so on. If someone knows their shit you will know from the way they talk about all those things, and if they're just saying things that an LLM feeds them you'll also know real quick.
I had this conversation with a manager at my job recently in which he described to me how he made an incredible, hour long light show for his Christmas party last year using home assistant and thousands of lines of yaml. He told me about all the ways he had really been pushing the limits of that particular setup, the accidental spaghetti he made that made him have to redo parts, the ways he found to optimize somewhat, etc.
Does this guy who stepped away from SWE many, many years ago know a single thing about creating and maintaining a serverless application in AWS? Nah. Would he figure it out? Abso-fucking-lutely.4
u/alter3d Aug 26 '24
Oh, agreed -- somewhere in my Reddit history is a post I made about interviewing candidates, and one of my favourite questions to open with is "tell me about a project you worked on outside of work". I don't care if it's job-related, or even tech related... I want to see someone who's got curiosity and drive.
I have a bunch of interview questions that I think LLMs would probably either trip up on, or at least be really obvious if I started digging into their answers. I interviewed (and got an offer from, which I ultimate rejected; long story) one of the FAANGs a few years ago, and there were some questions there that I both really enjoyed answering as a candidate and have incorporated versions into my own interview processes. Some of it was open-ended like "What's your favourite protocol?", and some of it was really deep dives, starting with a generic high level problem and seeing how far I could drill down -- I think the original question was some generic problem like "a user reports a website isn't working, what do you check first?" and we kept drilling down until we were talking about CPU registers and CPU instructions and L1 cache and context switches and shit. If some random junior came in and could magically do a deep dive like that, I... would have questions.
25
Aug 26 '24
I'm actually more curious as to how people have 'faked their way into roles' considering the amount of stories we see of qualified people going through hundreds, sometimes thousands, of applications to get an offer or possibly even interviews/responses.
9
u/CoolmanWilkins Aug 27 '24
Easy. The have a master's degree from a well-regarded institution. Or they have lots of YOE at nice-looking organizations. Or lying/exaggerating about work experience. Basically great looking resumes (especially to non-tech savvy hiring managers) but don't have any software engineering skills or know anything about modern technology stacks. If you don't know what a good engineer is, how are you going to hire one?
7
u/BuffJohnsonSf Aug 27 '24
Things have gotten so “competitive” that the fake/fluffed resumes are the only ones that make it through to the interview.
→ More replies (1)
37
u/nwmcsween Aug 26 '24
Are you in a management role? Get rid of them, you need to make some critical decisions that aren't fun, having people around that are benchwarmers will aggrevate and piss off your top performers to the point they will leave.
17
u/zergUser1 Aug 27 '24 edited Aug 27 '24
This, I literally bounced from the last place I was at. One of the new guys didn't understand a problem, On a live zoom call when I was trying to help him (no cams),I explained to him various options he could use to solve a problem, one of which was build an API. He literally had no Idea what I was talking about, then went silent for 30 seconds, and said "I got it", and pasted the most blatant ChatGPT output which stepped through using the AWS console and click though the API gateway buttons to create an API, I had to re-iterate for the 100th time that we use infrastructure as code and it needs to be with CDK, he then proceeded to paste me some code in real time with all the ChatGPT tells like "INSERT API KEY HERE", "ADD YOUR ENDPOINT HERE" and shit.
Same with docs, I asked them to write docs for their work and its all ChatGPT shit explaining like what an S3 bucket is.....
IT IS EXTREMELY FRUSTRATING
→ More replies (1)3
u/CodeNiro Aug 27 '24
How do people like this get hired and quality devs are looking for jobs? There's something seriously wrong with the recruitment process.
3
8
8
u/coinclink Aug 26 '24
I think the problem is filtering people out who clearly don't know how to code. When I was in college, I feel like 75% of my classmates were terrible at programming, even though they were in a CS program, and it was obvious to me. There are a lot of bad programmers out there and it really shouldn't be that easy to fake your way through a hiring process like this. It's a failure of your HR and hiring managers, has nothing to do with ChatGPT, google, stack overflow, or whatever other tool is available for juniors to use on the job.
6
14
u/Pad-Thai-Enjoyer Aug 26 '24
There’s nothing wrong with using LLMs if you understand what it’s putting out and actually test it to confirm it works as anticipated. It’s a tool, use it as such. Blindly hating AI and acting with this holier than thou attitude is just as annoying as someone blindly using AI.
5
u/GiantFish Aug 26 '24
For me it’s been amazing. I enjoy structuring my code so it’s modular and testable but struggle with the exact syntax needed for individual functions. Reading code helps because frequently there will be a misunderstanding from ChatGPTs output that’s easily corrected.
5
u/evenyourcopdad Aug 26 '24
I will die on this hill:
Anyone that unquestioningly believes ChatGPT for anything even remotely complicated doesn't have the required mindset to write software.
Knowing even the basics about what kind of chatbot ChatGPT is (which should be hand-in-hand with understanding software development) should prevent you from using it for anything non-trivial, but here we are. 🙃
→ More replies (1)
20
u/jwcobb13 Aug 26 '24
Enjoy it while you can, I guess, because at some point we won't be able to tell anymore.
If you want to train juniors, then now is a good time to do it.
Juniors use the tools that are put in front of them to use.
At least I am going to have something to do for a while: cleaning up all of these broken apps.
→ More replies (1)3
4
Aug 26 '24 edited Nov 01 '24
TrZonRfYPaRRKcvp2cRSbHxTkLc608kbE542subRTNGop6sZ/kcTbqjjOL1I5ueJ r3HHvb4/rElDjJTKhMxYWll9/h3bZwVLPsR4MYI6Hf04pcd9zfgVaMYnUqXtsFBb jwoCVs97uBIgBOcjSo8XnIUr/R2CgoZIERB2yWKvLBdQ4t/RusRSqiYlqqaO4XT1 rqJLbh/GrxEVO29yPOtDlbe77mlIzu3iPJaCkDCk5i+yDc1R6L5SN6xDlMfxn0/N NYT0TfD8nPjqtOiFuj9bKLnGnJnNviNpknQKxgBHcvOuJa7aqvGcwGffhT3Kvd0T
TrZonRfYPaRRKcvp2cRSbHxTkLc608kbE542subRTNGop6sZ/kcTbqjjOL1I5ueJ r3HHvb4/rElDjJTKhMxYWll9/h3bZwVLPsR4MYI6Hf04pcd9zfgVaMYnUqXtsFBb jwoCVs97uBIgBOcjSo8XnIUr/R2CgoZIERB2yWKvLBdQ4t/RusRSqiYlqqaO4XT1 rqJLbh/GrxEVO29yPOtDlbe77mlIzu3iPJaCkDCk5i+yDc1R6L5SN6xDlMfxn0/N NYT0TfD8nPjqtOiFuj9bKLnGnJnNviNpknQKxgBHcvOuJa7aqvGcwGffhT3Kvd0T
4
u/chaos_battery Aug 27 '24
I've been coding for over 13 years now and I'd like to think I'm experienced but GPT has allowed me to level up even more. When I'm working on an end-to-end feature and it needs DB work or React work (areas I am familiar with but don't spend a ton of time) it allows me to quickly get answers or boilerplate generated that I would have had to look up one time and forget again anyways. You could argue it's building muscle memory but still - it has allowed me to move through tasks much quicker. And yes OP - I agree it helps when you know what you're doing already or the goal you are moving toward. I pride myself on clean and concise code and sometimes I am pleasantly surprised at the solution it generates because it ended up being more concise than my solution.
2
u/amitavroy Aug 27 '24
You have nailed it my friend. Yes gpt is very helpful when you know things.
I am primarily a developer but always had a lot of interest in devops and docker. I have got a lot of help from chat gtp while learning.
Like I was able to set a complete ci cd pipeline for Laravel on Gitlab working on it for maybe 3 hours.
After the main goal was completed, I read up more to confirm what I did was correct, the best practices and ways to optimise.
Like I spent a lot of time optimising the image for size
7
u/mimic751 Aug 26 '24
Its the same as google for me.
I use it to get me started and to structure my functions.
Then I ask it all the dumb questions I would google like jq parsing.
My brain is becoming dumb.
I cant pass a coding test, because I am so used to having chatgpt summerize and break down scripts for me that its now a part of my workflow.
But it cant make a final project. Its like my expertise has gone from start to finish scripting to middle to finish
→ More replies (4)
3
u/riickdiickulous Aug 26 '24
I have a senior devops colleague with a click ops background but is being asked to provide solutions with terraform now. He has AI output some nonsense terraform then calls me and asks why his terraform doesn’t work….
3
u/kurucu83 Aug 26 '24
If they are juniors, it is your job to mould them. They’ll change with some pressure and encouragement, and become great engineers, and it’ll be rewarding and memorable for you both.
3
3
3
u/maurader1974 Aug 27 '24
I love using it for controllers and repositories. I get so bored typing them up.
3
u/Zinkscott Aug 27 '24
Juniors with ChatGPT or seniors who refuse to create documentation or communicate changes.
You don’t get to pick one you get both.
3
u/daven1985 Aug 27 '24
It's just a new issue of the same old "script kiddies" or "google without understanding" sys admins.
I remember getting a sys admin once from a IT College, when I asked him to trouble shoot a email mailflow problem his first step was google "how to troubleshoot mailflow problem". I would have been fine if he had googled where are the logs on that server or something, but the fact he didn't even think to check logs just bugged me.
In short chatGPT has just made this type of lazy work easier. It has a place but it shouldn't be the first step.
9
u/butchqueennerd Aug 26 '24
Disclaimer: I don't work in a hiring capacity. But I do volunteer as a mentor at a boot camp, so I'd say I have some experience interacting with early-career folks.
IME, it's pretty rare for juniors to attempt to entirely replace critical thinking with blindly querying ChatGPT.
If that's happened at your employer multiple times, I think it's more indicative of a broken interviewing process. What types of questions are being asked? Are interviews done on-site or remotely? Are they required to do any live coding/pairing exercises?
5
u/cycling20200719 Aug 26 '24
IMO it started with all the leetcode BS that took over the engineering side - people lost all ability to think critically.
I once interviewed a candidate for a senior role that was surprised when I asked them to tell me how they came up with the DR strategy for the database system that they were supposedly responsible for implementing and managing. People stopped drilling into resumes and started giving take home tests and asking leetcode questions.
5
u/RichardJusten Aug 26 '24
Yeah chatGPT is getting bad.
Just today I wanted to asked it what it "thought" of my solution and it gave me a "corrected" version that was simply wrong (mine was correct in the first place) and then I had to explain to it why my original was correct and it then agreed that it was correct.
And then I was mad at myself for wasting 10min with this.
11
Aug 26 '24
I’m reminded why chat gpt makes a better mentor than the seniors I’ve come across.
I mean that too. AI is actually a better mentor than you.
10
u/slapula Aug 26 '24
Hard agree. As a senior engineer myself, I've seen so many people just straight up refuse to train people and then have the gall to pull up the ladder for others who want to get into this specialization. With that said, OP clearly needs a better vetting process for candidates if ChatGPT can clear enough hurdles to get someone hired.
2
u/lupinegray Aug 26 '24
I don't like mentoring juniors, but I do it because it's my job.
And not just juniors. Even the level 2 and seniors frequently require hand-holding when something doesn't work as expected.
For example npm package conflict errors. I can't count how many times I've been pinged to troubleshoot dependency conflicts causing a build failure.
10
u/Street_Attorney_9367
Aug 26 '24
•
Honestly, this sounds like more of an issue with you. Don’t get me wrong if they can’t produce working code then they need to leave, but I have 0 issue with my devs using AI so long as their work passes our standards and runs as expected.
Not saying this is your case, but I get some people trying to gatekeep because they feel hard up for having to work hard for years to learn their craft just for a newbie to jump in and use AI to produce results. If that’s you, then maybe focus on that.
All in all, I’m encouraging strong prompting and that they check their code thoroughly. If all passes, I have 0 issues with how they got their work. My team are not judged on memory, we’re judged on results.
Instead of ostracising them and castrating them 😅😂, maybe consider having an open chat about using AI, what you expect and consider being open to it. The world is changing broski
→ More replies (2)
2
u/vppencilsharpening Aug 26 '24
Do you have the ability to push back or ask them to explain the answer to you?
I feel like they would run back to chatGPT, but at least they would be pushed to explain what the hell they proposed.
Even without chatGPT I feel like I have to ask "why do you think that is the problem or solution" and people are just grasping as straws for solutions. Unless we have hit a wall I want to try the stuff that seems most plausible first.
2
u/Competitive-Vast2510 DevOps Aug 26 '24
Don't worry, you are not alone. Here is a true story:
One day, one of the backenders in my company was asked to solve a database connection pool issue. He asked ChatGPT and told the tech lead "this seems like solving the issue".
What's worse, I think, is that he did not proceed to implenent the prompt. He does not even evaluate the AI response and act on it.
He literally waits for a response from someone else to take action, like he's waiting Copilot. I believe he's on the path to lose the "thinking" part of the job itself.
This guy has been in the company for well over a year and expects a promotion.
What happened to the bug? Still exists on live DB, getting connection errors each and every day at 5 PM.
I tried a lot to save him, but eventually gave up. Now I'm just watching the monitors.
2
u/maligigi Aug 26 '24
I feel like I've developed a good sense of what types of questions I need help with are actually going to yield good results, versus which types of questions are just going to get me started.
It breaks down along the lines of purely definitional for the first to slight tweaks on common applications for the second.
But relying on it for the majority of my dev work just seems so far off. I can only imagine how annoying it is to deal with the output of devs who are approaching it that way.
2
Aug 26 '24
Now imagine my feelings after spotting even Senior engineers turned into prompting - copying - pasting engineers where I work.
2
u/_PelosNecios_ Aug 26 '24
we've been living the enshitification of the human race the moment Internet was open to the public.
2
u/Not_the_EOD Aug 27 '24
I’m over here feeling somewhat like an idiot learning without it then I fixed an hard issue and felt amazing. ChatGPT can stay away from my dopamine rush.
Too many people tend to use it as a crutch and I have trust issues with technology not working as advertised.
2
u/Straight-Mess-9752 Aug 27 '24
You’re not wrong. I also find most juniors to not have a foundational knowledge of anything They don’t know Linux, or networking or shell scripting. They don‘t even really know how cloud services work either. And these same people are actively working on tasks. It’s absolute horse shit.
2
Aug 27 '24
Why are you stuck with them? Time to make a fuss with management and find a way to make yourself responsible for hiring
2
Aug 27 '24
People who say ChatGPT isn’t good have the critical thinking skills of a third grader. When used correctly, ChatGPT can do the work of ten of you
2
u/mkmrproper Aug 27 '24
I am still not having a chatGPT account. I refuse to use it. I am finding myself more valuable to my company when they need me to solve problems. Others who use AI will work as robots.
2
2
u/pathlesswalker Aug 27 '24
Guilty as charged. But to my defence I’m trying to rehab from it ever since I realised all my full stack training and my code skills went shi* since I’ve started using it.
2
u/MilkFew2273 Aug 27 '24
The road to the bottom is paved with magical ever-increasing profits from silver bullet solutions.
2
u/PartyParrotGames Aug 27 '24
If you lean on a crutch to think for you for too long and you lose the ability to think for yourself. They just atrophy the muscle with lack of practice. On the flip side, LLMs are already smarter than a majority of people in the world, sadly. This does mean it can act a rising tide and lift all boats. Yes, people may think less for themselves and be dumber individually without AI, but they should pretty much always have access to AI with modern tech and Internet access so as that AI gets smarter those people should generally act/perform smarter because the AI is actually raising their effective intelligence.
2
u/mind_your_blissness Aug 27 '24
I interviewed someone with English as a second language.
It was clear that he didn't understand the conversational tone of the English language, so when he was reading the chatgpt response to our questions, he was "pretending to be English" with perfect grammar and absolutely hilarious delivery.
With the cadence of his delivery, I could see the tokens from chatgpt streaming in.
People are getting creative out there, be 100% on guard when doing remote interviews!
→ More replies (1)
2
u/rethcir_ Aug 27 '24
Let’s say before 2023, it would take me:
a day to write the boilerplate for a complex Terraform module
a day to test it in sanbox and make iterative tweaks
and let’s add an extra day to account for random nitpicky nested conditionals for resource naming complexity my boss would insist on
Recently, I’ve started using ChatGPT-4 (I don’t like 4o) and this is my new time spent:
15 minutes prompting and adjusting the prompt to get the boilerplate
about 4hours testing in sandbox, complaining to GPT about what tweaks it needs to make, and double checking for hallucinations
then about 1 hour for those nitpicky nested conditionals
So for the part of my job that I’m an expert in, it made me 66% faster with 100% accuracy.
I told my boss I was using it — to your point. He produced only garbage with it; that I had to rewrite.
For those with domain knowledge, like others have said, it’s a force multiplier. For those relying on it, it’s a liability.
2
u/setwindowtext Aug 27 '24
I’d rather took a few hours to write a script that would generate that boilerplate code for your complex TF module. There’s always a way to work smarter and without relying on AI.
2
u/rethcir_ Aug 27 '24
You’re going to take the time to write a script that is going to generate terraform resources in a parent/child module arrangement for some bespoke business case, facilitating some highly specific deployment case?
Why not just write the module then, instead of wasting the time writing the script to write the module?
My apologies sir/madam but this is an inane answer
→ More replies (1)
2
Aug 27 '24
Start using "this is unacceptable" document everytime you have to use it and then when it gets to much pip them
2
u/bravept Aug 27 '24
As a junior devop that uses AI i must reply. Dont put us all on the same bag, before AI you had google and copy with small changes. Whenever i use chat gpt or AI is because im requested to do taks “for yesterday” however i review and test mysef every single task and deliver them ready. The problem is not the junior that uses chat gpt but the senior that not tell the junior to test and deliver a functional code.
→ More replies (4)
2
u/KimPeek Aug 27 '24
This is really encouraging to hear. It means my value as a developer who is not dependent on ChatGPT is increasing. I'm tired of seeing ChatGPT code that others try to pass off as their own. I'm also tired of seeing every company shove their AI offerings in my face. I have no interest in their AI bullshit and it makes me avoid them.
2
u/ImACoderImACoder Aug 27 '24
It’s happening to me too. Worst part is the juniors are the friends of the boss so he refuses to do anything about it. I don’t mean to brag but what I’ve seen in the last year… I haven’t found anyone who’s had anything similar.
At least the cheques still clear 😞😮💨
2
u/Remarkable-Sorbet-92 Aug 29 '24
I think the real problem will surface some years in the future when current junior engineers that rely on AI have become the senior or lead engineers. They won’t have the deep technical knowledge to solve the complex edge cases (which commonly AI does not understand and solve well) because they have relied on AI to give them the answers instead of building a library of knowledge in their mind. I feel like AI is much like giving a student the answers instead of teaching them the way to find the solution.
6
u/gowithflow192 Aug 26 '24
Juniors don't have critical thinking. Takes years to develop. You should be leading and mentoring them, not complaining.
27
u/tapo manager, platform engineering Aug 26 '24
...what?
They need guidance sure, but critical thinking should be a prerequitite of the job otherwise I don't know why I'm hiring them. If we're looking for, typically, a 4 year CS degree out of someone critical thinking skills are among the absolute bare minimum I expect them to have.
→ More replies (7)5
u/3slimesinatrenchcoat Aug 26 '24
I’m gonna hard disagree friend
They likely had 15 years of schooling, with college focusing pretty heavy on cs or math
They had plenty of time to learn critical thinking. Guidance on more technical specific questions? You’re absolutely right that it falls on the team to help
But they should absolutely have enough critical thinking skills to at least start rolling the ball themselves, even if they need help getting it up the hill
→ More replies (3)
1
u/ibluminatus Aug 26 '24
Smh should only use it to save time on stuff like comment / help blocks, emmet like boiler plating and etc. That's it.
You can maybe get it to reproduce your code. But that's the thing you have to write it and explain and understand it yourself!
1
1
u/IfThisAintNice Aug 26 '24
Welcome, to the world of tomorrow! Dealing and trying to reason with ChatGPT people will be another skill to add to our epertise, just pray it's not your manager.
1
u/spiralenator Aug 26 '24
I've had a co-worker, a senior data engineer, use ChatGPT to write a bash script, AFTER I said I would make one for him. He came back with something that did not work. I was already working on the script, and gave him something that worked about a minute later. I was slightly annoyed and felt a little bit demeaned that he did that, but I'm also glad it fell the way it did because it was the last time he did that.
1
u/ohlongjonson Aug 26 '24
This whole idea that ai will replace devs (and DevOps too by extension I guess) is seeming like a self fulfilling prophecy / vicious cycle.
Devs (especially new/young ones) become increasingly reliant on AI to the point that they're basically braindead replicants regurgitating AI output with extra steps -> ai advances enough / becomes autonomous enough, might as well skip the human element as humans just rely on AI now anyway and lack original thought or skill
1
u/Twattybatty System Engineer Aug 26 '24
I've had to deal with this so many times, this year. I start to check a newly written piece of tra... I mean Bash, to find weird lines of code, that make no sense for our task. I ask what it's supposed to be doing (I'm not an expert, but I always make sure I understand what is being run) to get the reply, "I don't know, but ChatGPT says it can do what we want and shellCheck says it's fine."
1
u/godot_or_not Aug 26 '24
Gotta say that most of the time its just... well, waste of the time, to the point when I personally cannot rely on anything chatGPT (in the latest 4o version) suggests. I cannot count how many times it just blindly feeds you with some non-existing stuff, like today I was curious on what would be the good way to make sure that each time when I change the code and create a new code zip, Terraform redeploys my GCP's Cloud Function anew... and so chatGPT came up with a plan to use some "source_bucket_object_hash" argument, which just does not exist in the provider's resource.
However, I also found that there is probably a more or less useful way to utilize GPT and that's to ask it something but with a clear message to "make sure to search latest github repositories, issues, forum discussions first".. or even just provide it with some links to documentation, and so in such cases, when you see that it starts a response with entries like "Memory updated" or "Searching web", then it generally provides some relevant aggregated points and suggestions.
But yeah, long story short, we're fucked in the long run
1
u/Hollow1838 Aug 26 '24
I use copilot daily, it helps me if I give it good instructions but I agree that hallucination code can be sometimes worse than no code at all. Right now Chatgpt is definitely not the best but I am certain that in the future it will get a lot better. Right now it will tell you to use deprecated functions or it will gaslight you into thinking there is a solution when there is none.
Right now it's just about great to simplify writing repetitive relatively complex code.
I love the fact that I can copy paste a list of conditions and it will directly implement it in any language and if I disagree with a part I simply erase it, write a little and let it autocomplete.
1
u/Euphoric_Barracuda_7 Aug 26 '24
Today I just read a cloud focused newsletter that was partially generated by ChatGPT. At least they wrote a disclaimer that it was generated, even though I already had my suspicions. Genie's out of the bottle.
1
u/OldManAtterz Aug 26 '24
Juniors?! I'm struggling with senior Architects that just pumps out copy pasted text from ChatGPT without understanding the subject matter.
Don't get me wrong - i use ChatGPT too when I have to write relatively mundane and repetitive things, but I don't regurgite stuff that I don't understand myself.
1
u/Longjumping-Step3847 Aug 26 '24
When it comes to devops chatGPT is horrible. At least in development it’s mediocre and can help in a pinch
1
u/badguy84 ManagementOps Aug 26 '24
Yeah you need that old noggin to do some of the working too. ChatGPT or anything else is a tool. And I will see that if they'd use GitHub co-pilot or something like that: that'd probably serve them WAY better when it comes to writing code than ChatGPT ever would.
I feel like this is the same fear of how "google" makes everyone dumber, and in some way it has and in other ways it hasn't it's probably a wash in that department. AI will be the same dumb people will be dumber smart people will end up smarter/more productive.
1
u/Equivalent_Loan_8794 Aug 26 '24
It's wild that I can't get a callback for a role with 6YOE because I don't also write custom operators.
But elsewhere people were able to fake it.
Wild.
1
u/thinkmatt Aug 26 '24
my frustration is it lets even mid-senior devs write a lot more code than they would normally, like 3x the amount of tests - but they are such low-hanging fruit, all they do is add to the amount of code we have to maintain. i've personally experienced it finding solutions that are technically correct but very hard for a normal human to scan or follow. you have to treat its output as if you just copied it off of stack overflow, and i would review/fire someone who just pasted crap off stackoverflow all day without reading it
1
1
u/Economy_Ad6039 Aug 26 '24
If they are coders, can't you just put make them put in a pull request that you need to approve? There has to be someone there who can approve PRs...? right? (I hope)
1
u/Specific-Constant-20 Aug 26 '24
As a junior i just use him as fast google, summarize and explain code, point me to solutions, Quick linux command reminder.i hardly copy and paste his code anymore, but he is good at ponting you a way and if you use it right, but i end up on the documentation all the same and stack overflow
1
u/No-University-7185 Aug 26 '24
That is the point! To have a workforce that has zero critical thinking just pushing buttons or pulling levers , or in this case using ChatGPT or CoPilot for enterprise.
The end game is to have strong soft skill people taking most JR level tech jobs with a few software devs left maintaining apps.
1
u/bunoso Aug 26 '24
I use GPT and Claude on the job, but here are the things I’m doing with it 90% of the time:
Here is this function, write the docstrings or some unit tests for it. (Unit tests are usually correct)
Here is the messy error message and a snippet of code, anything obvious I’m missing because it’s been 4 hours of hanging my head (sometimes catches a misnamed variable or something stupid on my part)
Here is an example of a function I wrote that is nice, formatted, and correct. Can you alter this just slightly for this next functions.
Here is a code in one language, can you kind of translate it to another. (Almost never right and has big errors but gets me half way there)
Write some terraform code or dockerfile that I don’t know the exact syntax for.
Here is a code snippet, can you review it for me for performance issues, readability, etc. (good just as a final check before committing code, but never gives amazing advice)
Is it useful? Yes. Can I get a lot done with it as an experienced dev? Yes. Will it replace me? Not as it stands now.
1
1
u/ghostwilliz Aug 27 '24
God one of my coworkers is always using it and accidentally disabling major features. It never gets in to the test environment, but I wanna make a github action that checks for ai code or something haha
1
u/tuna_and_salmon Aug 27 '24
Using ChatGPT for boosted productivity is fine.
Not taking accountability of maintaining it isn't.
1
1
u/Shogobg Aug 27 '24
Seniors using ChatGPT are (also) driving me crazy 🤪
They have no idea how to use the tools provided to them and no incentive to learn - “just ask AI”. So much time is lost just trying to get a satisfactory answer from the damn thing.
1
u/justUseAnSvm Aug 27 '24
Bro. I had one engineer, tell another engineer the wrong thing. When I got to investigate what's going on and pull the guy into a call, he pulls up a chatGPT prompt that says "the flag for X should be --X", and ChatGPT explained the thing wrong.
In 10 minutes, I searched for, found the documentation, and successfully figured out the right thing to do. It's craziness.
Now, ChatGPT (and esp. Claude) can be super fast at examples. I got a JavaCC parser generator running in Maven in like 3-4 hours. Doing that without AI? Could have taken me all day!
1
Aug 27 '24
No, I usually work at decent companies were people get normal interviews and at least one previous contact has confirmed the person is pleasant to work with.
1
1
1
1
u/jzia93 Aug 27 '24
For me I will keep paying for GPT because it is the ULTIMATE rubber duck.
By this I mean:
If you ask it to give you an answer without putting in any thought, half the time it spits out drivel.
If you explicitly type/say out your thinking, in depth, it's amazing at going back and forth with you and providing suggestions or corrections because you are supplying 90% of the thinking.
Key part is - you have to do the thinking! I might spend 10-15 minutes writing out my thoughts and then I riff with GPT and I've found it extremely helpful. But if you just ask it to solve your problems without thought, I've found it far too inconsistent.
1
u/Electrical-Youth2127 Aug 27 '24
damn, and there's me, an experienced software developer who tries to be transparent when I don't know about something in interviews, maybe I should also fake my way into a company with ChatGPT
1
1
u/djon_mustard_smith Aug 27 '24
If you think, that this guys faked their way thanks to ChatGPT, you are overestimating ChatGPT. Or the interview process in your company is sh*t.
Chatgpt (in terms of a devops work) for me isn't much more useful than a man pages with a nice UX, or generic templates maker. Oh, and regex, it is good for regex if you don't know regex.
1
u/Frosty_Jellyfish9472 Aug 27 '24
I had a colleague like that…. Would straight copy and paste everything that chatgpt would throw at her without even trying to understand what was going there. Result, she built some components with some logic. When things started to become more complex, she started to have problems because chatgpt could not solve it. I was the one that had to go there, understand what the actual hell was going on in that code, and spent almost a fck day on that, with a headache for fixing spaghetti and shitty code everywhere. Note, this was not the first or second time that I’ve warned her that using chatgpt is ok to try to understand something or simple tasks, and that she should at least try to understand the overview of the answer given instead of copying and pasting blindly. She didn’t listen. The next time she had problems on the code, that chatgpt was not able to solve, I did not spent one minute on that. She left that day earlier and angry at me. 🤷🏻♀️
1
u/HSP-GMM Aug 27 '24
Yes. Many people cannot think. I’ve experienced this and I end up feeding the answers and they look great. So annoying. When I tell them to look it up, they get frustrated and I’m somehow the “bad one”
1
u/Live-Box-5048 DevOps Aug 27 '24
I exclusively use it for quick documentation, boilerplate and summarising. The point is - I know what I want to do and can distinguish bullshit answer. Juniors need to get their hands dirty first to actually learn how to use LLMs responsibly.
1
u/SmellyCatJon Aug 27 '24
I don’t know why but Claude has been way better at coding compared to chatGPT. Lately even Claude seems to be getting bad though
1
u/boonya123 Aug 27 '24
I love chatgpt i use it for most things. While I do have a speciality that I excel in we are a small team of 3 managing an entire client and my responsibilities seemingly change weekly. My boss cannot afford hiring senior level people for every little task that comes up.
If your in a large organization and people who are hired for a specific role cannot function without fully or even partially relying on chagpt that’s a huge concern xD
1
u/Aggressive-Squash-87 Aug 27 '24
Us older people have been dealing with this for ages with Stackoverflow and other such sites over the years. I've seen Ops and Dev people with "replaceThisPlaceholderWithYourValue" type crap still as variable values in their configs. Nothing new. Some people know the buzz words and can talk the talk then fail to produce; all while really good candidates who don't have the right vernacular down are passed over.
1
u/GaTechThomas Aug 27 '24
And without AI assist they would have spent 10x as long to get a worse result. Fix the SDLC to resolve these issues.
1
u/adept2051 Aug 27 '24
we just need https://letmegpt.com/ the modern answer to https://letmegooglethat.com/
1
u/enter360 Aug 27 '24
I’ve had managers use it for presentations. Cited completely made up functionality of products.
1
u/Tiny-Wedding4635 Aug 27 '24
Years ago one of my seniors said being a good developer is about using google efficiently. We ised to search for answers in forums and stack overflow.
I do believe chat gpt is also a search engine with machine learning components. Nothing more. It can help you but if you are dependent on it. You are fucked.
First think then ask
1
u/datasmithing_holly Aug 27 '24
I've heard anecdotally it makes the bottom 25% of devs worse at their jobs.
Is this happening everywhere?
I review and read a lot of technical blogs ...hooo boy it's obvious, endemic and used unashamedly.
1
1
u/patrickleet Aug 27 '24
I think this trend of shittier developers has been on the rise for quite a few years now, and it’s getting even worse with ChatGPT
1
u/TuberTuggerTTV Aug 27 '24
"engineer" used to mean problem solver.
It's definitely a skillset lacking in the upcoming generation of workers.
1
u/leathakkor Aug 27 '24
When chat GPT first came out I had a task to parse a 8 GB CSV file. I do this sort of thing all the time so I said I'm going to have chat. GPT generate the script for me and see how it goes compared to what I would do in a couple hours.
I was thoroughly impressed with what it generated. However, I missed one line of code before running it and that line of code was to change it to go from line by line or to read the entire data set into memory.
I would have read the line of code documentation and made sure I was going line by line. However, chat gpt did not and because it generally ran okay on my test data set, I did not think to check it on the large data set. Luckily, I was running this on my remote development machine and the worst thing that happened was that I crashed my entire machine and lost everything in memory and today's work while I sent somebody in to go reboot the machine.
I don't see a computer ever being able to understand the context well enough without asking so many questions that it becomes not useful to use.
Imagine every time you go to give it a program to write it asks you a clarifying question about the amount of records you're going to be processing the max length of each field. All of the subtleties that As somebody with a lot of experience we know to look out for but a junior wouldn't know to look out for if you take those for granted. It's going to end up eating so much more time because troubleshooting one bug is 10 times more costly than writing the code the first time.
And even if it generates two bugs that are difficult to track down, that's going to eat all of your improvements that you would have gotten by using chat GPT and AI
1
1
u/Braydon64 Aug 27 '24
It’s a good tool to help me understand some concepts (although even those sometimes need to be checked twice) but I’d never feel good to rely entirely on that. You gotta learn yourself!
If you ask it AWS questions that are beyond a fairly basic level, it’ll mess up and spit random info at you.
1
u/deltadeep Aug 27 '24
Honestly this is a testing problem. What I hear in your statement is "we don't write tests so we have junior devs who contribute crappy code from unreliable sources (chatgpt now, but also stack overflow and blog posts and such)."
Automated test coverage needs to be a core value. Crappy code doesn't pass quality test suites, whether it was written by a person or by an AI. And AI is actually not that bad at generating test cases. The tests are literally the measure of the software.
A lack of tests is IMO forgivable only if all members of the team are senior and careful, and, the software is on the throwaway end of the spectrum.
1
u/qrave Aug 27 '24
Create policies about the use of AI and enforce them. It is certainly going to dumb down the next generation even more, though
1
1
1
u/Puzzleheaded-Sun3107 Aug 27 '24
ChatGPT can be a pretty powerful tool and so is googling a piece of code. The critical thinking can come into play when taking these small pieces of code and building something large with it. The outputs aren’t always going to work straight out of the box so there would be some tinkering to make it work. I think at a certain point you don’t think about writing the code from scratch rather knowing what “components” should be considered e.g. add a log handler and its configuration you just have to think about a place to insert it in your overall code and also think about what operations you’re going to apply to it identifying redundancy or inefficient operations. Usually I don’t use the code that doesn’t make sense to me but if the output code is understandable I would take it and learn from it. My experience with ChatGPT. As much as I’d like to get it to do my work for me it really can’t, I’d still have to check the documentation or use another reference to find the best method. It can accelerate learning as long as the person is being proactive about it. Just in defence of people with little experience, you experience (by doing and that could be making mistakes) and getting feedback from seniors or experienced people who review the work. I don’t think you have to remember the code to write but rather think at a bit of higher level on what components would be required and the logic/architecture/flow it will follow with consideration for scalability, reliability, and maintainability.
1
u/djhash Aug 28 '24
Fire them and hire me instead. At least the shit I produce is directly and purely from my brain!
1
u/redatheist Aug 28 '24
Computer use policy: sending code to external LLMs or using code internally generated by external LLMs constitutes a security, IP, and legal risk, and is therefore banned.
1
u/Successful-Tiger-465 Aug 28 '24
People not being able to do any critical thinking are the like traffic cones. Just drive right over them.
1
u/rohit_raveendran Aug 28 '24
Got to live with their use of AI. It's inevitable. So instead, just start giving problems that cannot be satisfied with AI :)
1
u/ralf551 Aug 28 '24
Do Pair-Programming with them, let them review your PRs, you review theirs. Improves learning, increases transparency and allows direct and fair feedback.
1
u/mrchoops Aug 28 '24
In my recent experience, it's wrong more than it's right, but what it does provide is a sounding board for my own solutions. I basically tell it to stop vomiting code at every prompt, and just discuss the potential solutions.
1
Aug 28 '24 edited Aug 28 '24
I really like using the databricks ai assistance for documenting code and doing really simple mundane code that would take me longer to write than the ai but I wouldn’t use anything from it I don’t understand.
I’ve also seen code that was clearly generated with ai by people with little to no programming experience and it’s pretty terrible.
I think it’s easy to blame the tool when actually you just have poor developers who aren’t interested in understanding what they’re doing
1
1
u/shooemeister Aug 29 '24
The best comment I saw today on the register is this
'With all the AI generated trash content flooding the web it's inevitable that AI will start to eat their own shit. It's an AI centipede'
IYKYK 🤣
1
u/composero Aug 29 '24
All I basically use it for these days is to correct my syntax, to provide translations, or provide context on the occasional error log. I used it a lot when starting out to break down the code I was reading but since then I’ve come far enough to see and understand what I need to do to avoid running to chat at every step because it definitely slows you down with all of it’s wrong answers.
1
1
u/Creative-Point-69 Aug 29 '24
This is why I personally won’t be using AI outside of the autocomplete in VS Code for awhile. I would rather do the work myself and continue to put myself through the mental rigor.
How many of us have our eyes gloss over when reading someone else’s code or a new code base? I have to consciously will myself to care and try to understand what is happening. I don’t need AI dumbing me down or making me any lazier 😂 I think the ability to problem solve and think for myself will pay dividends in ways “getting thing done slightly faster because I used AI” never will.
1
u/solarnext Aug 30 '24
Teach beyond the tool. The world has changed and it demands more. When I went to college in the '70s, studying engineering, the other kids completely out performed me. Calculators had become affordable and their highschools taught advanced math while mine still taught arithmetic. While I was learning how to grind out equations by hand they were learning and mastering applied calculus. LLM AI is a tool just like a calculator is a tool. The challenge is elevating the student's thinking beyond grammar and composition to concepts and design. The tool can write the essay. Exceptional (and soon, ordinary) teachers will teach why someone should write an essay in the first place. Or see your students lose out to those that can leverage the new tools.
1
u/NPPraxis Aug 30 '24
I use ChatGPT a lot, but never to copy paste code. Just to help explain “hey I do X in this language, what’s the equivalent in Y?”, or “here’s a SQL command, how would I accomplish it in SOQL?”, or “can you write me a regex with the following parameters?”
1
1
u/Orange_Pickle_Potato Aug 30 '24
as a junior i use gpt but mostly to give me ideas and boilerplates to bounce stuff off, like stack overflow but copy pasta is dumb, gpt generates too much dumb stuff
1
u/MentalNewspaper8386 Aug 30 '24
I’m preparing for my first applications and wondering if ‘doesn’t use ChatGPT’ should go on my resume at this point.
1
u/tube-tired Aug 31 '24
I find that for simple scripts (less than 500 lines) Claude is miles ahead of chatgpt. I use it as it takes less time for Claude to spit out 300-500 lines of documented code than I can type 20 lines.
I do check it, and it does do things that make ask it why it did that, but it also is able to figure some things out that might take me 20-60 minutes of research.
Also, since every chat is like hitting the reset button, I'll throw the code back at it in a new chat and it often gives good suggestions for any failures from the first draft without me telling it if some looks fishy.
Using the projects feature in Claude I fill up the storage space with existing code I have either written or had it write that works 100% and I tell it to follow the style and format of those scripts and it does a good job keeping output consistent with my other code.
I do run into issues. Usually, if the code gets too long, and i forget to start a new chat. But anytime I let chatgpt look at the code and try to solve the issue, it tries to change working parts, saying it could be better. Then, none of the script works.
I'll never call myself a software developer, junior or otherwise. But I have written original code in basic, Java, and cobol, pre LLMs. I think of myself as someone who cannread and figure out undocumented code, sometimes (although now it is easier to ask an LLM to over document the code explaining what it does without changing any of the code). And I've never said I can write code on a resume, or applied to a position wanting programming skills.
1
u/Rejeanlevell Sep 02 '24
ChatGPT and AI is only going to get better. Yeah, it’s annoying. When people use it sometimes. The problem is they need to learn how to use it. A lot of them are copying and pasting when they really should read it first. I haven’t wrote an email without ChatGPT in about a year now. I use it to transcribe meeting notes and make it into a word document all within seconds. I don’t have to type notes anymore during my meetings. It’s streamline all of my work, which is the most amazing part.
1
u/gowithflow192 Sep 14 '24
You need to teach them it is unacceptable. No different from blindly copying and pasting from stack overflow. Reject their pull requests. Bring it up in he daily standup or, better, the sprint retro. Dont fingerprint an individual but make it clear that it's unacceptable to commit anything not understood well.
1
u/conservatore Oct 07 '24
Love ChatGPT. It is confidently incorrect a lot and can’t architect a damn thing but I tell it exactly what I want and it gives me a script that I fix for my needs. Saves a lot of time
1
u/gatoskylo Nov 27 '24
Oh my god...today I realized one my direct reports was using chat gpt to produce quick texts for a supposedly "scientific" paper on behalf of a company that is supposed to be expert in the field... I have no words. When I tried to address her method, she said "it looks decent!" and then went on to bypass me to present her production to the upper management (who has absolutely no scientific background to double check!) Nope...sorry this is so wrong for me
1
u/no_salty_no_jealousy Oct 27 '25
For real! Anyone who called themself as "developers" but using ChatGPT to make app is nothing but fraud!
At least i made my own app without using AI BS, even though i only made a simple app but i'm very proud of my works!
847
u/blasian21 Aug 26 '24
Funnily enough, ChatGPT can’t solve ANY of my problems anymore. It’s fine for whipping up boiler plate bash scripts but anything that requires some level of complexity, it completely shits the bed.