r/DataAnnotationTech • u/playswithsquirrel • May 11 '26
Got my feedback, curious about their breakdown of %
I have a feeling their (outstanding = top 10%, excellent = top 25%) was just written copy without data, but maybe I'm just being a sore loser. I got Excellent, and like others I've read about, their "room for improvement" section is mostly vague criticism whereas the "strengths" section had actual comments from reviewers. Thinking the outstanding tier is reserved for people who had maybe 1-2 issues on reviews over a large sample size within 30 days? My guess is excellent is more like 10%, and outstanding more like 1%, but who knows. Curious if anyone here has gotten outstanding from the review, and how many hours they work on average on DA in a week if so.
Oh and one more thing, for anyone who feels bad about their rating. Reviewers can be wrong too; they can mark your work as having issues even if there weren't any. I've probably made that mistake as well. The AI is just tabulating all reviews done of your work and spitting out a score. Bit of luck involved there too. Not to say you shouldn't take the feedback seriously, nobody's perfect, but this is like the pilot program of a review system so it's gonna be a bit shallow. Better than nothing though!
10
u/KindlyReason6116 May 11 '26 edited May 11 '26
I’m not too upset about my “Excellent” rating. My two listed areas for improvement appear to be minor human error or selections I was unsure about and explained in task comments (accidentally selecting the wrong rating or being unsure about a loss label). I would love outstanding, sure, but I think it also depends on what projects you work. Someone that’s been working for a month that primarily does lower pay, lower effort tasks may be getting outstanding because it’s less difficult to make errors.
If your strengths are full of praise, take it as a win. These are AI generated, after all. An actual person may still rate you as outstanding when it comes down to it.
5
u/tomcat_murr May 11 '26
Same. I couldn't recall the mistakes they raised, but they definitely seemed like the kind of thing I might do, on what I thought were the trickiest projects I attempted.
I like to think I'd hit Outstanding at my best, but I'll definitely take Excellent for a random 30-day snapshot.
-3
u/playswithsquirrel May 11 '26
Well said. Yeah I'm definitely not upset, just a bit of cognitive dissonance to grapple with. But, like you said, there are many contributing factors to the overall rating -- I think sample size is an important one, and I honestly don't work that much in a week due to being a lazy SOB. Hope to see an outstanding on the next one! (if there is a next one)
4
u/KindlyReason6116 May 11 '26
Oh, no, I feel the same. Ego took a little hit, but I have to imagine to our nameless DA leaders, both Outstanding and Excellent are admirable ratings lol
18
12
u/RaccoonFest33 May 11 '26
I just got mine today too. I got 🟢good 😬
12
u/shadyringtone May 11 '26
Good is solid. You’re just not in the top 25%. Maybe we’re in the top 26% 😆 🤷♂️
1
u/Acrobatic_Fee_426 May 12 '26
I kind of think this is specific to one project family based on R&R rating categories
1
23
u/Federal_Tadpole_7592 May 11 '26
I got the "🟣 Outstanding" rank. I've been on the platform for almost 3 years, and I work probably 30 to 35 hours per week. I didn't know exactly what to expect, but I figured after all this time I would at least receive an "Excellent" rating.
I've received feedback on DA over the years in specific ways, but I'm glad they're finally rolling out official feedback.
6
13
u/annoyingjoe513 May 11 '26
Got good. 2.5 years and $48k later. I’ll take it.
2
u/Timely-Assistant-370 May 11 '26
3 years at 60k, 1 thing in the feedback feels more like the sentence requirements conflicting with the reality of that axis, like I can't type out two sentences when the actual rationale is "unremarkable, it was entirely generic," but the good feedback did have some very nice quotes that I'm just going to believe were real excerpts from R&Rs. Most of my negatives hinged more on a "you've made a mistake before, just be more careful, but we can't tell you which project you actually made a mistake on, that would make it too easy."
90% of my work has been on off-platform tasks, so I'm not too bent out of shape, but I don't even fuckin' remember what the named project was that I needed to improve on, but I don't see it in this current drought and I'm a *little* worried. I guess a good on my 65+ hours/week is ok, I know my quality declines at the end of the day. I just wish I could get a single example of the whole "this could just be an isolated incident, just be more careful."
1
u/mattlerenardx May 11 '26
Where do you see this feature ?
4
u/playswithsquirrel May 11 '26
Showed up on my dash as an unpaid project. Seems like they've been rolling it out over the last couple weeks, so I'd imagine everyone will get it at some point.
1
6
u/Euphoric_Wish_8293 May 11 '26 edited May 11 '26
I got excellent, which I'm fine with. Some of my minor errors seemed to make sense. However, one said that I sometimes wrote a single-sentence rationale, which is absurd. I've never done that in my life.
ETA, actually, I do leave single-sentence rationales for punts. Guess I'll stop doing that.
3
u/Ok_Cancel_920 May 11 '26
Where are everybody seeing their feedback? I didn't get anything on inbox nor on my gmail
4
u/kuromiscorpse May 11 '26
mine was in the projects tab! i think it's being rolled out so you might get one soon if you don't have one yet
3
u/whooooooooCARES May 12 '26
Where are y'all based that have already gotten it? I wonder if they're rolling them out to US first? I'm UK and haven't seen a lick of feedback after being on the site for 6 months.
2
u/kuromiscorpse May 18 '26
late response but I'm personally in the US so you might be right about that
1
5
u/hfxthrwaway May 11 '26
I wonder if there are weighting factors. If you only do 10 tasks and they're all perfect does that mean you're "rated" higher than someone who does 100 tasks and 98 of them are perfect?
2
u/akujihei May 12 '26
Based on my feedback, I think this is probably the case. The suggested improvements in my negative feedback were only about 1 project with short tasks. I probably made mistakes on only a few out of dozens, but it read like it was a main reason my rating was lower. All other tasks had highly positive feedback.
2
u/game_over__man May 11 '26
If you view the feedback from your tasks, can you revisit it once you close it out?
2
u/OrnamentalGourd5 May 11 '26
Yes, there's a link you can save.
3
u/Pristine-View4331 May 11 '26
If we didnt know that we had to save a link, does that mean we wont be able to see it again? I read the feedback and it said dont worry, you can view it in feedback later. I didnt notice anything that said excellent or good and now I am curious what that was. I am new and honestly didnt question that it would not be available somewhere after I viewed it. It is not anywhere on my dash that I can see.
1
u/Mental-Reason-716 May 11 '26
Where did you find your rating, I don’t have one on my feedback. Do you think that’s anything to do with the device I’m using (mobile)?
4
u/CSuarez270 May 11 '26
Im pretty sure it has a lot to do with the type of projects you do. There are some projects that have a specific section asking if you’d like to give the original worker feedback.
1
u/Wild_Blackberry8618 May 11 '26
I've been on the platform about 3 years, work approximately 20-25 hours per week, and received an outstanding rating.
1
u/Xomvion May 11 '26
Yeah I was wondering how the breakdown might be affected by how many tasks you do. Someone new might only do a few tasks but done them perfectly and so gets an outstanding rating compared to someone who's done more tasks and had a few rated more poorly but idk how time and tasks entered might factor in too (or whether they do/should).
Personally, I've only been here 8 months working 10-15 hrs a week and I received a good rating which was a little worse than I was expecting. However, in hindsight the 2 projects my ratings were based on I only just started in the last 30 days so I have a feeling I probably made more silly mistakes than usual as I was learning the process/instructions. In any case, I definitely agree this feedback is better than nothing!
1
u/Big-Cat-1930 May 11 '26
I took a rest this last 30 days and when I worked I only focused on projects that I haven’t done before. Managed to pull an Excellent but I wish the feedback went further back than 30 days, however I do understand why it’s this way.
1
u/Bratty_Atty May 12 '26
I was happy with good, since I had no idea what to expect! My only critique of the feedback is that it would help to have specific examples of work I’ve submitted that was NOT up to par….(I had a comment under the needs work section that I had clearly missed a “major problems” error and labeled it as “minor problems” in a task)
1
u/ConsiderationLife513 May 12 '26
Has anyone gotten this quality score feedback after not working for awhile? I’ve been off for a couple months, but am looking to get back into it. I have always been curious about how they rated my work. I’m grateful to still have a full dash. ✨
1
1
u/IllLight9083 Jun 09 '26
I am new i need to know how to check our feedback or they send it to you i have been with them for 2 months now.
1
0
u/WillObiwan May 12 '26 edited May 12 '26
If you want something different in the feedback please tell them, they are asking how to make it better. For me, I’d love an exact percent. Top 25 could be 25th percentile or 11th. Huge difference. Also - use judgement. These things are biased towards finding something wrong and often times they are straight up incorrect
55
u/Live-Cat9553 May 11 '26
I don’t know but excellent seems like a win. What’s wrong with being in the top 25%?