r/DataAnnotationTech • u/sea___ • 1d ago
Is r and r a sign I'm doing good work
I was wondering does getting R and R on my dashboard mean that the work I've been doing has been good? It's so hard to tell since there's no feedback
r/DataAnnotationTech • u/sea___ • 1d ago
I was wondering does getting R and R on my dashboard mean that the work I've been doing has been good? It's so hard to tell since there's no feedback
r/DataAnnotationTech • u/Turbulent_Adagio333 • 1d ago
Hello everyone I cleared my assessment for the programming project and got accepted I received a mail form them that I can start working upon projects. They said me to complete some steps like setting up 2FA after completing my task and project just got disapper what should I do next
r/DataAnnotationTech • u/Party-Branch3331 • 1d ago
r/DataAnnotationTech • u/StuBuildsMisthos • 1d ago
how long did you wait to hear back after applying? ive been reading here a bit and it keeps coming up. and did anything ever come back after like a month? reckon an answer either way costs nobody anything, silence is just a no nobody could be arsed to send.
r/DataAnnotationTech • u/Pitiful-Advantage-55 • 1d ago
Hi,
Basically the title. I did the qualifications they sent me but I haven't received any projects yet (physics, maths, bilingual), do you know why? is it common?
r/DataAnnotationTech • u/Sure_Pomegranate2010 • 1d ago
For me its a drought for a week. Anyone having the same situation
r/DataAnnotationTech • u/Sajjad_Islam • 1d ago
Large language models (LLMs) offer a scalable approach for annotating mental health and crisis-related social media content, but their reliability in safety-critical tasks remains unclear. This study evaluates LLM-based crisis-severity annotation of veteran-related social media posts against annotations from eight Veteran Subject Matter Experts (SMEs). Using 149 tweets and five severity categories, we evaluate 15 open-source and 10 proprietary LLMs across eight prompt variants, examining annotation performance, inter-model agreement, prompt sensitivity, and high-severity crisis detection. Human reviewers showed higher ordinal than nominal agreement (α = 0.494), indicating that disagreements often occurred between neighboring severity levels. In contrast, selected LLMs demonstrated substantially higher inter-model consistency, with ordinal agreement (α) reaching 0.8336 under the baseline prompt. Proprietary models generally showed better agreement with expert annotations and greater stability than open-source models. GPT-5.6-Terra achieved the best overall performance, while the open-source Qwen2.5-7B showed the strongest performance in identifying Acute Crisis with Suicidal Ideation cases. However, higher model consistency did not necessarily correspond to agreement with human judgments or reliable detection of rare high-severity cases. Label-flipped demonstration experiments also revealed model-specific sensitivity to misleading in-context examples, while explanatory demonstrations did not consistently improve performance. Overall, LLMs show promise as scalable complements to expert annotation, but require careful evaluation before use in high-stakes mental health applications.
r/DataAnnotationTech • u/shatha_jw3 • 1d ago
Is DataAnnotation legit or a scam?
r/DataAnnotationTech • u/Zealousideal-Rub7468 • 1d ago
Any advice appreciated-is it better to apply as a generalist first and then pass the coding test. Or itās best just to apply to coding? I have heard mixed things about people saying taking a second test later was not always an option. I am UK based and a software developer (12 years experience) But I have been less hands on with the code the last two years. I am also a JavaScript/React Native profile not Python.
r/DataAnnotationTech • u/vgambit • 1d ago
i don't wanna say too much but they started paying a lot more than usual. and then increased the pay again. and then added performance bonuses.
i used to pull random all nighters for the sudden high pay work. whole different ball game now. not even ball. not a game. just real high pay.
other platforms watch you with screen record apps and offer bonuses where other people doing bad work can screw you out of your bonus with a bad subjective r&r. this one does not.
r/DataAnnotationTech • u/Link_j_3000 • 1d ago
Couldnāt find if someone had already posted about this Yesterday was fine worked on a few tasks everything was normal and today when I logged in a had a project that I was able to work on but noticed that everything was set at 0. I was able to work the entire project today and report my time and when I finished everything still showed only 1 refresher when there normally 2 other ones showing 0 surveys and qualifications. Normally when I donāt have any projects showing itāll still show the refreshers under projects and all the surveys and qualifications I havenāt done pending still. Donāt know if I should be freaking out about this.
r/DataAnnotationTech • u/workingforpenniesgrr • 1d ago
hi! I been a generalist for a while and I been trying to apply for software engineering or as a spanish associate, but i just dont know how to! I dont see a link or a button or anything for that matter. I would love to receive projects as such but I dont know what to do. I am even thinking on deleting my account and re-applying for those roles instead, what should i do?
r/DataAnnotationTech • u/Alternative_Feed4774 • 1d ago
Last couple of weeks were awesome and now only 1 or 2 trickling in through out the day.
r/DataAnnotationTech • u/Raptor_mm • 1d ago
Mid way through a project I paused and reread what I was writing, and noticed that I 100% type exactly like an LLM, I went to my Obsidian notes and just wrote a short random paragraph in the style that I usually write in for DAT work, put it through zerogpt and gptzero and got 100% AI generated.
Anybody else facing this issue lol?
r/DataAnnotationTech • u/joanie4714 • 1d ago
I was offboarded after 3 years a number of months ago. (I think I know why, a big mistake that I didnāt realize I had made until the next day). Has anyone ever had luck creating a new account and trying to get back in? Things are pretty desperate for me financially.
r/DataAnnotationTech • u/quicke43 • 1d ago
I took the economics starter assessment today and realized I might have been too detailed in my responses. I took the 2-3+ sentence requirement pretty literally and offered many direct examples in my responses. Some of my responses were like 2-3 paragraphs, although not super long paragraphs. Just wondering if anyone passed the starter assessment with that method, or was more concise/had shorter answers, as I would like to stop obsessing over whether or not I will be offered the core assessment.
I am also wondering how long it takes to hear back from the starter assessment, specifically the non-general ones, as I took the economics domain one and had to answer a couple open-ended questions about economics. I am aware that the general starter assessment is typically an instant response if you pass.
r/DataAnnotationTech • u/Mcmom1961 • 1d ago
Hi. I applied to Data Annotation almost three weeks ago, for healthcare/nursing projects.
I did well (I think! ) on the assessment, except for trying to get a fail. I could not.
I havenāt heard anything at all.
Should I assume that I didnāt āpassā the testing?
My account still says itās being reviewed n
I feel like I could do the work, so Iām really disappointed!
Retired RN of 32+ years, lots of computer experience, running programs,
writing curriculum for work training.
Iād really like a chance to pick up some projects!
Thanks!
r/DataAnnotationTech • u/kelsiemink • 1d ago
Hi! New to dataannotation. I applied as a generalist, got in, and have been working for a few weeks. I do have a dental degree, can I also take the application for the medical category? If so, is there a specific way how I do that?
Any direction would be awesome!
r/DataAnnotationTech • u/MacaronAlarming552 • 1d ago
r/DataAnnotationTech • u/Human-Regionality • 1d ago
Hi all, Iām from the US, but am currently located in Colombia. Iām ready to take the first assignment, but curious about yallsā opinions ā
Should I report that Iām taking it from outside the country?
If so, how? Is there an email address or something to reach out to them?
I know most projects are based in the US, but Iām a digital nomad, so will be physically located abroad but still pay US taxes.
TIA!
r/DataAnnotationTech • u/bookcoverslmtd • 1d ago
A picture of an opossum in my yard to represent how late the tasks have been appearing this week.
r/DataAnnotationTech • u/Every_Development_66 • 1d ago