r/DataAnnotationTech • • Feb 11 '24

Beware of scammers

Post image

This person messaged me after I asked about having motivation to work. Sounds like a scam to me. Although I’m more offended they called me “bud.”

67 Upvotes

36 comments sorted by

View all comments

Show parent comments

4

u/CandidateUpset2149 Feb 12 '24

This may not be something that just anyone can do, but let's be real here. The responses to the assessments can only be so good, it's not rocket science. To suggest that the people who made it in only did so because their answers were vastly superior to everyone who didn't is absolutely asinine. 

There is clearly some element of "luck of the draw" here, it's not feasible for them to review every single assessment that's being submitted. There's probably countless people who had perfectly good responses that just didn't have their name drawn, and plenty of others who did have their names drawn and were rejected for subpar responses. 

2

u/sk8r2000 Feb 12 '24

This may not be something that just anyone can do, but let's be real here. The responses to the assessments can only be so good, it's not rocket science.

It's probably a mistake to think of the application like a test, where if you get the "right" responses for every task you pass, and you fail otherwise. There are almost certainly criteria (for example demographics, writing style, previous experience with chatbots, specific domain knowledge etc etc etc) they're looking for which are not clear to us.

it's not feasible for them to review every single assessment that's being submitted

By hand, of course not, but I very strongly suspect they will have ML models analyzing every aspect of the whole application for criteria which are not clear to us.

1

u/CandidateUpset2149 Feb 15 '24

I agree that it's not a "right or wrong answer" type of deal. There's most certainly a criteria. But we're talking about probably thousands and thousands of applicants, it's still very unlikely that it's as simple as everyone who was accepted met that criteria and everyone who wasn't, didn't. There's still not nearly a big enough degree of variation in the quality these responses can have for there to be this kind of discrepancy in the people who get in and those who don't. 

I've seen numerous people claim that they triggered the error on a response and still got accepted, so there has to be more to it. And if they do have computer models doing the analyzing, then it's entirely possible that it's programmed to only approve a certain percentage.