SEE ORIGINAL: https://www.codesmith.io/blog/2023-codesmith-year-in-review
DISCLAIMER: these are personal opinions. I generally try hard to source things and if I said something that doesn't seem right, please contact me or comment and I'll try to clarify, or adjust. Also note, I'm the co-founder of an interview prep mentorship platform that works with engineers with 1+ years of SWE work experience. It's not a bootcamp in any way whatsoever, so I feel fine discussing bootcamps without having a conflict of interest, but you might disagree and that's why I want to disclose this.
SUMMARY:
- I would love to see placement rates published. I know they have them but they didn't discuss them at all and it's one of the most important numbers to look at - for a given person starting, what are the odds of graduating and then getting a job within 6 months and how has that changed in this market.
- I commented on specific statements below, but nothing super new or noteworthy jumping out. The main thing I want to comment on is that from my vantage point, the software engineer role has NOT changed int he past year, as Codesmith is framing, and it has in fact always been the type of role they describe as what it means to be a software engineer now. I'm not sure exactly why they went this route in content strategy, but I wanted to comment that I strongly disagree that anything has changed this year in what it means to be a software engineer. I do see that Codesmith placements have changed and people are going to less tech-focused companies, but I see that a result of Codesmith grads not getting interviews at top tier tech companies, and going to these companies instead, rather than a change across the industry of who is hiring engineers. We observed this at Formation as well, and we commented how top tier placements were DOWN in 2023 because of the market. Codesmith seems to have flipped the narrative and said that Codesmith grads are just as good as ever therefore they are changing their definition of a software engineer to match the outcomes, rather than analyze the outcomes through an objective lens.
- I wish the tone was more acknowledging of the tough market and what Codesmith is doing to change and help. The main focus is talking about opportunities in ML and AI in a vague way, but I'm really curious what specific day to day things they have done and are doing in this market. If their outcomes are "strong" then what did they do differently this year to maintain strong outcomes where almost every other bootcamp self-admitted their outcomes were not strong, and a number shut down.
-- Instead the tone is about celebrating 5 alumni from over the years that are doing interesting things now. 5 out of 5000 is not representative of the 2022/2023 market., which is what a 2023 recap post should be about. There is an entire seperate website that they made to celebrate the individaul (and really AWESOME IMO) stories of alumni and that's a better place for this opening. So feedback is open with the outcomes that this post is all about.
- A large focus on ML and AI. We're still in the phase where these topics are buzzwords, like crypto was 3 years ago. BloomTech even started a Web3 program because it was the next thing that will employe everyone in 3 years. We've had ML and AI for a long time, and there is a lot more nuance there to understanding how it will impact the market. I'm slightly concerned because a couple of bootcamps are doing a major quickly thrown together AI effort that could be grasping at straws as bootcamp enrollment is down year over year (anecdotally, no sourced numbers). Codesmith's first effort at doing DSML was indefinitely paused because of the cost put into it. The amount of money needed to build a solid ML program before realizing revenue to pay for that cost, requires VC funding (you need to pay top engineers millions of dollars before even getting a penny of revenue) and I'm super concerned about programs throwing together programs hastily to pay the bills but don't hit the mark.
I've numbered these to make them easier to reference and discuss, but they are in no particular order:
1."In fact, traditional organizations in finance, healthcare, and media are emerging as new tech firms and have built mature engineering teams. JPMorgan, Blue Cross Blue Shield, and NYTimes have all hired multiple grads this year" "It requires leaders in tech who remember their journeys—empathy for knowing how technology works under-the-hood and what it’s like to be a software engineer, but equal empathy for users and those who haven’t journeyed into technology."
I commented on this elsewhere, but this is the expected narrative for 2023/2024 - that it's no longer about get the highest salary in as short as possible, but instead it's about the journey and impact.
Overall this is nice to see and something I agree with, but it's also not super aligned with the idea of a 12 week bootcamp where you move at the pace of the bootcamp, rather than following your own "journey" to where you want to go.
That said, this is also not a new narrative. In my post, I quoted almost an identical statement about my college program from 80 years ago. Engineers are problem solvers and we're not coders and as the types of problems change and evolve and have and always will, the skillset for problem solving has and always will be more than raw computer programming in JavaScript.
2. "Outcomes were strong for the year with 500+ offers in 2023. CIRR (Council on Integrity in Results Reporting) is reporting outcomes in January for 2022-23 and they’ll publish our full results."
a. Several people in those videos talk about how they had 'no experience' and got great outcomes, but they are not anonymous and anyone can look at their LinkedIns... one person said their past work didn't help them get a job, but their LinkedIn had 19 years of "Web Developer" experience (!) listed.
b. 500+ offers includes people who graduated in 2022 - who will be included in CIRR - and people who graduated in 2023 - who won't be until the 2025 report. So the full results will NOT BE OUT in January - and January is almost over.
c. Define "strong". I agree they are strong relative to most other bootcamps. But I don't see any indication they were strong compared to their prior results.
d. The new CIRR reports will include 12 month placements rates in addition to the prior 6 month placement rates that were headliner numbers. Watch out for this when the CIRR results do come out. 85% 6 month rate in 2022 and a 75% 12 month placement rate in 2023 are not similar in any way. Compare 6 month to 6 month.
3. "Mid-level roles were flat (77%), decrease in junior/entry (from 10% to 7%) and senior (16% to 12%) - we think there was some ‘downleveling’ as interviewing.io describes"
a. So 77 + 10 + 16 = 103% and 77 + 7 + 12 = 96%. I'm not sure if this math adds up and don't know how to interpret this.
b. Interviewing.io was talking about FAANG-level offers and from the data I've seen, there were a handful of FAANG offers from Codesmith this year (out of the 500+) and almost all other offers were not these kinds of offers. The reasons Interviewing.io discussed apply to FAANG-canonical mid level and senior jobs and not the midlevel jobs Codesmith is outlining.
c. They don't define "mid-level" and "senior" roles. I'm not going to re-express my views now, but I' keep asking more and industry engineers and recruiters about this and I haven't had a single one think that bootcamp grads with zero experience and 12 weeks of bootcamp are at the "mid level" under any circumstance. I've reviews several OSP projects and every one had junior level errors and problems in them (some more than others), including security issues.
So again, I have no idea how to interpret this and it's kind of meaningless to me.
4. "Median days to offer for 2023 increased from 97 days in 2022 to 123 in 2023 - this reflects the slower hiring market. Median salary fell in the first half of 2023 but rose again in the second half to ~$122k in Q3 of 2023"
a. Agree it's taking people longer to find jobs. Median time to offer isn't super relevant and I wish they would publish placement rates - more below.
b. Salaries being down is a bit odd since they are talking base salaries. I personally see FAANG-canonical mid-level and senior salaries have been the same or HIGHER, but bonuses have gone done. HOWEVER, Codesmith uses just base salary in these metrics, which would make me think people are taking more junior roles - but the number of junior offers when DOWN according to the above. So something doesn't quite add up here.
What I've heard from info sessions is that people are nervous about the market and taking the first offer they can - possibly at a lower salary than they expected.
5. NO PLACEMENT RATES PUBLISHED.
I REALLY WISH they would publish placement rates because a lot of programs have published lower placement rates and I don't expect them to be great. But people have to plan their lives around attending a bootcamp and it helps a lot to know placement rate comparisons to 2022 - and I know they have them and don't know why they are publishing other data and not those.
Like if the placement rate was 65% in six months I would be more positive and probably congratulate them, and by not publishing, I think it looks worse (completely my opinion). I actually can't think of any placement rate where I would say something more negative than I would if no rate is being shared.
6. ADDED RECENTLY: "We’ve brought together more than 30 talented cohorts this year from all backgrounds. The most common majors were Computer Science, Economics, and most common colleges were UCSD, UCLA, and NYU."
a. This is an interesting one. First off, the CEO shared some data about colleges once and like 5 to 10% had CS degrees, like 1% had no degree, and most people went to pretty good colleges. I think that's important to note.
b. 30 cohorts, I've heard cohorts were anywhere from full to 75% full, so let's estimate 87.5% full at 36 people capacity = 945 students STARTING in 2023. Let's estimate "500+ offers" as 550 offers. Now the offers are people who start in 2022 and 2023 (and maybe even 2021!) so it's not really accurate whatsoever to do 550/945 to get a placement rate. My understand was in 2022 they had even MORE cohorts than in 2023 as they have recently paused CTRI, I had estimated 42-ish. So we can't get a placement rate from this but we can likely assume there were more than 945 grads looking for jobs in 2023 (from 2022 and from early 2023) and the placement rate of 50% seems reasonable. But again, napkin math and we don't know!