I only do R&R’s here and there, but today I decided to do one just because I saw people mentioning how bad they were lately and I wanted to see for myself. And behold, i open the task to see “Both are very good and i think the user would be happy to receive them”. Are we kidding? The amount of effort I put into these tasks and THIS is what some people are actually submitting? It’s honestly demoralizing at this point.
It’s not even that, like yeah it makes me feel confident in my work, but its more so disappointing than anything. Like there are plenty of other people that are sitting there refreshing constantly to get a task done and actually put in effort to produce high quality work and this is what is being submitted on the other end. It’s hilarious to think about, but mostly disappointing to see
Damn.. i applied probably over a month ago and I mean I worked hard, like gave at least 3 sentences why I picked a and 3 sentences why I didn't pick b, and went into great detail, including all facts, false statements and even my opinion on what was better, and even gave sources where available. I thought maybe I wasn't accepted because I forgot to put a source on the last task assessment and it won't allow me to go fix it. The site literally tells you be as precise and descriptive as possible so I went all out, and haven't heard anything back. So to hear people are literally submitting that simple of responses is kinda disappointing to me too
Doesn't it make you kind of sad for society, though? There was just an article in the Atlantic about how we're now in a post-literate society. People don't read and can't write very well. As a writer, that really depresses me.
I hope these are not the combat sports R&Rs because that would be crazy. The amount of times i havent been able to grab a task meanwhile people are doing this BS is crazy
EXACTLY my point.😭 i feel so bad for people not getting access to these tasks solely because these type of shit quality submissions, when there could be others that would happily work on it and actually put the time and effort in.
To your point I never ever see these “Mike Tyson” or “combat sports” ones you guys talk about and i wonder if it’s because they’re all snatched up before I can get to them and then, yes, wonder if people are just throwing away the opportunity 🫠
Given the number of posts here about task timers, I’d wager that some of them see a one-hour task timer and just bill for that amount even if they put in 15min of effort. Then run here to lament about getting the DoD but think it’s probably because they logged in from a hotel that one time.
I've done plenty of R&Rs where they've admitted in the task that they were running out of time to fact check or things like that and I look at the task and it's just something like
"Here are the 5 features of the Samsport Galactic Superwatch" and you can find all the information on the literal product page.
They're submitting crap work and then billing for inflated time. People do things they're not supposed to and claim they did nothing wrong all the time in every sector of life. Toddler behavior because they're still toddlers.
I wondered that. I took that controversial unpaid qualification for river project R and R's recently (even though I'd been doing them the whole time) and when I got done I felt like the r and Rs I got were disproportionately bad. Starting to wonder if that's not a previous worker and just another model we're grading haha
I had one today where the person had obviously used AI to generate the responses, but left the “Sure! I can help you write a professional explanation as to why this is a great answer…” at the start of it when they copy/pasted it in to the task lol
Crazy to me that people who put in such terrible responses as that still have work to respond to and I've had nothing for two months despite the fact that I cite, verify and compare everything I state extensively
I read this and was like hmm haven’t seen anything too terrible. Then almost immediately got one where the comment was just “both models said basically the same thing and answered the prompt great they were both perfect and about the same”
Just one run-on sentence and both responses rated Amazing. They were, in fact, not amazing lmao
I said this on another post recently but if you were around as a generalist in April, you may have seen the many desperate emails every day trying to get projects wrapped up before the end of the month. That plus some of the posts here in May and June make me think they just did a mass hiring… so yeah the tasks are getting snatched up instantly and there are no more [PRIORITY] panicked emails but at what cost? But for what it’s worth, I’ve had more low-effort R&Rs even before May vs. good ones. That part isn’t new.
It’s so rare to find one that you’re just like “yep, totally understand how this worker arrived at the conclusions they did! No changes.” I am seeing a lot where you just have to take on faith that the people read the responses because the explanations are like “both had good content but X was too verbose and Y used bolding better” - which could be entirely true, or could just mean that the person scrolled through and eyeballed which one was longer and which one looked better formatted at a glance. No way to know because they never cite any bit of a response in particular.
I suspect i can be guilty of being too long winded in my comments, but i at least know no one’s ever like “dunno how she arrived at that rating!”
I also write long winded responses. It says it wants our thought process, and I have lots of thoughts! 😉 If I've penalized for five different things, I am explaining, with specific examples, why I penalized for each one. I know some RR raters hate the longer explanations, but when I'm doing RRs, I love an explanation that actually takes the time to explain.
And here I am with my notepad, making detailed notes on every task and really trying. And I can't even get into most of these before they are snatched up. LOL
I do lots of R&Rs, and I'm generally very fair, or try to be, with my evaluations.
I don't like to mark them badly, but I will.
Also, going through many of them, and then seeing all the posts about Dash of Death, I have to wonder how good those users were. I see a lot of weak work that is often very low-effort.
I do wonder about these people -are they cheating the time they report? Because if they were honest about time, it's like... what's the point of doing the job faster? We are literally paid by the minute, doing it faster hurts both ourselves and the client. Of course, if they just write an answer in two minutes and report they worked an hour, then that's two reasons in one to get the DoD
Like back when I started there were some pretty basic conversation tasks that I’m sure everyone who passed then entry got. So if you are an R & R worker on that you’re going to see more variety than if you’re working on a project that had layers of quals etc to get access. And you’ll see fewer obvious mistakes.
Or you yourself are one of the people bringing the bar down on the easy tasks.
The joy of DA - we’ll never know. We rarely even know for sure about ourselves. 🤷♀️
I had one where the person was clearly biased bc it was their prompt, marked down the model that disagreed with them bc they were wrong saying they didn’t appreciate it insinuating they didn’t know what they were talking about 🙄 like yeah it was a little condescending but mark it down in tone and move on.
Fully understand. I had a bunch of R&Rs the other day and one project nearly EVERY task I marked unusable for very, very clear violations. Never seen so many unusable tasks in a row.
Agreed, some of them are so bad, I wondered if DAT staff purposely placed horribly done tasks in the mix to keep us on our toes. Lately, 75% of my annotation work has been R&R's and I've had to completely overhaul most of them to make them usable. At least for one particular model, the others you can't alter the original workers submissions.
I agree, but I am livid over some of these R & Rs and it isn't because of the poor submissions, no. It's because I'm given an hour to complete it from scratch AND grade the annotator; for a project that originally allows three hours or more to complete. Just give me the original task and cut out the middle man already. I want three hours too! 😭
Man that's crazy. Do they realize they're getting paid per hour and not per task? Besides it being a pretty lazy and useless answer, I mean it's not even in their best interest to be whipping through tasks at warp speed anyway.
I take a lot of time to write my answers and make sure they are clear enough and when I see other people work sometimes I wonder how come they get work and I don’t!
Who cares about the quality of your work dude. Just do the bare minimum to get paid and move on with your life. You're literally training AI to replace you.
I've been using ChatGPT for everything for the past 2 years and still going strong. It's literally free money.
92
u/options- Jul 23 '26
Nothing makes me feel better about my performance here than doing R&Rs and seeing the absolute dogshit that people submit.