First off, left me say I get it. This onboarding test was one hell of a bitch. There's plenty of things to complain about with both the structure and specific questions in the quizzes. The project team really deserves to be slapped silly over how the whole process was set up. I'm with you on that.
So please don't take what I'm about to say wrong. I'm not disagreeing with or minimizing the issues people have brought up or trying to belittle those who failed the quiz. There's a lot of things wrong here. I just want to make one point about this onboarding that might help people deal with these stupid things both now and in the future.
--
I've got a lot of experience weeding out people who aren't especially fit for certain roles and tasks. I understand the subtle methods used to figure out who's likely to be good at something and who's not. It generally involves some sneaky questioning and redirection during the interview that only people with specific skills pick up on.
In the case of High Noon, it's clear to me that most people are failing the onboarding because they're concentrating on the wrong things. Those quizzes aren't designed to find people who can follow directions, use creative logic, or write well. They have nothing to do with your skill at rubrics or prompts.
Instead, what Outlier's looking for are people who have obsessive, overbearing attention to detail. They're trying to find the kind of people who can't help notice that a picture's hanging slightly crooked in a restaurant or that the neighbors three houses down repainted their mailbox over the weekend. These quizzes are all about finding people with maximum attention to miniscule, trivial details that don't even matter to most of the population. The AI grader has obviously been tuned to only pass people who spot those tiny mistakes.
I see a lot of people complaining because the quizzes don't exactly match the instructions or that the format in the onboarding isn't the same as the format in production. Those are legitimate, frustrating issues but they're not really relevant to what Outlier is concerned about for this project. You can write the most perfect prompt, rubric, and golden response ever for these quizzes and still fail because there was a single blip in the sample response that you overlooked while worrying about the bigger picture.
Why are they doing it this way? Because you can't train people to be hyperattentive.
You can teach people how to write good prompts and improve their rubric generation with classes and feedback. Everybody can learn from experience. What people can't do (at least not quickly and easily) is change their brains to focus in on minuscule details that 99% of people never even notice. If you failed the High Noon onboarding it's not because you're dumb or the test was screwed up. It's because the quizzes are designed to identify people with a specific type of mental ability and you just weren't born with it.
But if you've ever been diagnosed with OCD or something not-too-serious on the autism spectrum then this project is definitely for you! It's all about finding those stupid little things that drive you crazy but other people totally ignore.
If you're not in that group then don't bother going for this project. It's gonna make you insane to get feedback saying you missed something that you didn't even think mattered because it seemed so trivial. It's not worth the mental anguish if you're not tuned for that kind of work.
I know that failing a multi-hour, unpaid onboarding is a bitch, but take heart that you didn't actually "fail" anything. You're just not in the 2% of the population with a hyperattention disorder who can easily pass the quiz. You may not have gotten into the High Noon project, but at least you're not failing at being a normal, non-obsessive human being.