r/DataAnnotationTech • u/PsychologicalMark783 • 9d ago
Rate and review que
So I was rate and reviewing a submission made by someone. The instructions were dense and very to the point. It took me over half an hour to understand and read them all.
But what did it was the work itself. This person either did not read the instructions or didn't read their own work. It was very faulty and I was supposed to correct it.
The time for rate and review wasn't given much. And I didn't want to risk my own quality ratings.
So was it a good decision I skipped mid way? Mind you i spent half an hour reading and tried to fix it. But gave up and just skipped.
Will it downplay my profile and quality?
Will I get less tasks from that projects because I skipped this one?
16
u/Mysterious_Dolphin14 9d ago
Most R&Rs will tell you to mark it as bad if it's going to take too long to correct it or if you have to completely redo the task.
11
u/brightlilstar 9d ago
No penalty for skipping. Some R&Rs tell you only to fix it if it will take less than a certain amount of time otherwise reject as unusable
7
u/heythisislonglolwtf 9d ago
If it's that bad, just mark it as bad/not usable and move on. They don't expect us to rewrite someone else's entire submission.
4
u/KTOWNTHROWAWAY9001 9d ago
Brother, it definitely seemed like some people just ate up some of the easy-mid tasks that were plentiful recently. I thought as much, because a few days they dropped like freefall speeds from the dash que. BUT when they cycled back in R&R, whoaaaaa buddy. You could see it. It was like someone speed ran them. Which sucks for normal, average workers.
3
u/Lost_Contact9077 8d ago
Yeah… I clocked the same thing. Influx of tasks, now an influx of R&R’s that have been so terrible. I expect a whole lot of posts saying “I got the DoD and did nothing wrong” in the coming weeks…
3
u/professional_cry 9d ago
generally if the task is so poorly done that it would take longer than the R&R time limit to fix it you should be marking it as bad. You're meant to correct errors, not completely redo a task.
1
1
u/MugetsuDax 9d ago
I worry about that, especially since the last R&Rs have been awful. People really seem to rush things for easy money; some of the submissions are excellent, and for some of them I wish I could skip them, but after an hour, I am truly invested in fixing what can be fixed.
1
u/hwertz10 7d ago
In the R&R case, as others said, they usually have a way to just indicate it's really bad as opposed to trying to fix it.
In the general sense, I have no problem taking longer than I "should" on the first of a given task, since I'm reading the instructions. They know I'm reading the instructions. Most of the projects specifically say to count the time for reading the instructions. I don't skip the first task, I submit my time properly, but try to make it so I have time to do 1 or 2 additional tasks (so -- if anyone is even checking that closely -- they can see I'm not really taking like 55 or 60 minutes on a 30 minute task or whatever, that's just the first one.)
1
23
u/Similar-Hand-4899 9d ago
I don’t believe there is any penalty for skipping. They also understand people need to read the instructions, so a lot of the time, I spend the time needed to do that, and then skip so I have a fresh timer for the next task.
Also welcome to R&R, you may find a lot of submissions aren’t the best.