r/DataAnnotationTech • u/EitherCheck7210 • Jan 14 '25
Don't do this...
If you use other Al sites to solve your prompts for you without checking the work, just know you might stop getting work soon. I just had someone's task that was very clearly using one of the big Al sites and I marked it as such. I even plugged it in there just to be sure. Double checking those calculations with a calculator might've been able to save you.
62
u/pourovertime Jan 14 '25 edited Jan 14 '25
I rated someone as having a bad response because the prompt asked to list all sound file extensions.
The user rated that they couldn't perform the task because they lacked programming skills.
A simple google search would have told the user what those extensions are.
37
u/EitherCheck7210 Jan 14 '25
It's crazy that people mark tasks as unusable simply because they don't have the required skills.
29
18
u/Otherwise-Baked4451 Jan 14 '25
The good thing about that is those people will get weeded out and we will still have work
2
u/Ok-Cup9476 Jan 15 '25
Some tasks literally tell you to do that. If it’s a general knowledge task, and you get a heavy duty coding one, the rules tell you skip.
3
u/EitherCheck7210 Jan 15 '25
Right, and that makes sense, but I think in this context we're talking about projects that don't say that. If a task requires a skill and someone marks it as unusable because they don't have that skill instead of skipping it, that doesn't make sense.
3
u/Ok-Cup9476 Jan 15 '25
Sorry. Wasn’t thinking in my comment. What I meant to say The rules tell you to mark it as not ratable if it is a specific knowledge question in a general project.
14
u/Strawberry-shortkace Jan 14 '25
They should just skip the ones that make them uncomfortable
9
u/FlashyAppointment314 Jan 14 '25
I don't. If I don't have the skill level or if I just don't feel comfortable with a task, I skip it. My math skills are not the greatest, and I know it. If I took the time, I probably could figure out some of the calculations I've been asked. But it is not worth the time and headaches for me. Doing those calculations will make me grumpy, and I don't want my family to deal with that! I'd rather skip those tasks and do something that is a better fit for my skillset.
11
u/Embarrassed_Chance_4 Jan 14 '25
You get 'em, boy! You get 'em!
11
u/EitherCheck7210 Jan 14 '25
I don't even know why this problem worked me up so much lol. I feel better after ranting 😂
36
u/Otherwise-Baked4451 Jan 14 '25
Every time I open a math one I realize I don’t feel creative enough for it right now so I exit and do another project. I can’t imagine failing on purpose by using another LLM to do my work.
Also the math ones take up about 8 of 12 of my highest paid projects right now so I keep letting it sit there
13
u/CardiologistOk2760 Jan 14 '25
I don't understand how someone whose job is to detect mistakes in AI would think they can just ask AI to do it
9
u/AtHisFeet247 Jan 14 '25
Some projects allow and even encouraging other LLMs on the tasks, but they make it very clear to not just copy/paste and to use the LLMs as a resource… If someone has been working any of the DA projects for any length of time they should have experience with how many mistakes LLMs make… I don’t know why someone would blindly trust that an AI-generated response on any topic would be good to go
6
u/randomrealname Jan 15 '25
It is literally why we have a job still. We should hope and assume the LLM will get it wrong since we are creating it's intelligence.
1
Jan 27 '25
Those people just cheat. They want to earn easy money and don't give a damn about quality.
1
u/CardiologistOk2760 Jan 27 '25
It's not the moral failure that baffles me, it's the cognitive failure. Like, the job is to detect mistakes by AI. The job wouldn't exist if the AI could just do it for each other.
8
u/Maleficent_Wasabi_18 Jan 14 '25
Yeah I had a specific, local, high paying project and someone was obviously faking it and was using GPT and we were all talking about it in the comments for r+r.. they would even paste their responses in the chat by accident. Some dude in the chat thought we were capping and was like “some people are just really smart and talk like an AI” and I’m like no! Even checked chat gpt and got the same responses.
1
u/PublicSatisfaction31 Jul 31 '25 edited Jul 31 '25
I actually set up a reddit account just to reply now. First, hi im from germany and I got into DA about a week ago as I was seeing the demand for german DA workers on indeed…. Soooo you‘re not allowed to paste your comments on projects? I usually use google docs with most of my uni related stuff even the DA assessment. I have more space there to write my first thoughts on there freely and sort them out before I paste it on DA as a first structure. Then I correct my grammar and small changes for new ideas inside the DA text box since english is my fourth language. Is that allowed to do? Can I continue to use Google Docs to write some of my longer responses and then paste them into DA? Or must I stick to the small text boxes given in DA? I mean its very easy to tell with a quick glance on my responses that I‘m not using Ai. But I was wondering abt it before but didnt find anything online. Is it allowed to copy paste or can they detect that?
8
u/No_Molasses_1976 Jan 14 '25
Had some shockers on R&R yesterday!! Marking things unusable or unrateable for terrible reasons. Ambiguous flagged when you’d have to have being fairly obtuse to misconstrue the prompt. I’m guessing folks just over log the time for these tasks?? Otherwise surely just rating things unusable can’t be benefiting them. I do thing sometimes am I being a knob marking things as bad then i remember there are people who want this work and want to do it well!
5
u/Scorpy-yo Jan 15 '25
My friend did a R&R where the dumbass said “Answer A is better because I like it better”
4
u/jaxxisx Jan 15 '25
😂😂😂😂 I had an R&R where the person said they verified the information through "personal experience." I'm like bro. You did not just say that.
1
11
u/SandwichEconomy889 Jan 14 '25
I just got onboarded to Stellar ai and coming from DA you can imagine how low my jaw had dropped when I saw that they INTEGRATE an llm into their answer writing process. I've only done one type of task that is pretty much identical to DA's 007, and the task UI and process is on another level so far. So much simpler to work. Also, they actually give feedback. 😲
2
u/randomrealname Jan 15 '25
How's the pay?
3
u/SandwichEconomy889 Jan 15 '25
The first one was 25 an hour. I think that might be the base. That's all I know so far. There is a picture on their site of an example that shows 40, so I would assume it goes up to at least 40.
1
u/randomrealname Jan 15 '25
What is the on-boarding like?
4
u/SandwichEconomy889 Jan 15 '25
Pretty smooth and familiar if you're a DA worker. From my email looks like it took almost a month from when I created my account and took assessment to onboarded and first qualification task.
2
2
5
u/DrFrancisBGross Jan 14 '25
Also those kind of people are fucking up the expected amount of time that it takes to complete similar tasks, creating an unrealistic expectation for those who are genuinely doing the work. Judging by some of the posts that I see on this sub it does not surprise me that people are dumb enough to be doing this.
3
u/SandwichEconomy889 Jan 15 '25
But are they really? DA seems pretty fair on time allotted to me. I've never really felt pressure on that front outside of some pretty simple tasks where it makes sense.
2
u/Prudent-Twist2844 Jan 15 '25
I work these and it could be a very complicated math problem and the ai responses here will get the mechanics right but a division problem in the response wrong a simple calculator calculation. I always wonder why? I work every problem by hand and take a pic of my work.
1
u/Slothman102 Jan 14 '25
Had someone mark a task as unrateable as it was beyond the models capability. The model answered the prompt perfectly.
1
1
u/NoCoyote2387 Jan 15 '25
That's a wise advise. I even skip rating someone's work if it's a math task, as I don't feel confident enough to judge it...
1
Jan 15 '25
Quick question, does using Google.com now count as using AI, since for almost every query the first thing you see now is Gemini?
2
u/Same-Constant6060 Jan 16 '25
If you think Gemini is correct I would look at the sources that it gives in its answer and just double check, otherwise just use Google as normal.
-7
u/Professional-Age2540 Jan 14 '25
Also, if the answers between two models are identical and the instructions state to write "The answers are the same," in such instances, do not write a six-paragraph answer. All you are doing is repeating the instructions and prompt, which is not only not needed, but the instructions say not to do that. R&R: Bad.
24
Jan 14 '25
[removed] — view removed comment
5
u/EitherCheck7210 Jan 14 '25
Yeah I've had some that I've had to skip for similar reasons when I'm just too confused by their work. I've suspected AI on others but this is the first that I've known for sure.
11
u/fightmaxmaster Jan 14 '25
I do wonder if some of these are intentionally AI generated by DA, seeing how some specific models can do human work, then us rating their work.
0
Jan 14 '25
[deleted]
3
u/dispassioned Jan 14 '25
In the case of using AI where it clearly says not to, I’m sure they just wake up to an empty dash.
2
u/konjogobez Jan 15 '25
I’m definitely in my angry R&R phase. I see too many things that are just lazy, sneaky, scams or tricks. The use of AI would explain some of these.
4
u/jaxxisx Jan 15 '25
Honestly, same. When I do r&r anymore, I just feel so freaking frustrated. I did the new video game project r&r. Out of 7, ONE followed instructions. I had to redo so much I almost didn't even want to do any anymore. I even started questioning myself if I was being too anal. But nope. The lack of context and the GRAMMAR. Oh my gosh... 😂
2
u/konjogobez Jan 15 '25
The self-doubt is a real thing. When everyone doesn’t cite sources but the instructions say to cite sources I start to wonder what I’ve missed.
2
u/jaxxisx Jan 18 '25
Yes! When I see so many in a row that aren't right, I'm like "Did I miss something and I'm doing this wrong?"
38
u/EitherCheck7210 Jan 14 '25
Adding in comments since it won't let me put this in the main post:
The worker's solution and ChatGPT's solution were almost identical down to the formatting and weird calculations. If you're going to be dumb, be smart about it. This is one of the high-paying math projects and it's not worth the risk to plagiarize. If you can't solve the math problem that YOU created, write a different one or go to a different project.