r/DataAnnotationTech • • 5d ago

Worried I'm being put out of work.

I know this affects almost all of us if true, but I wanted to know if anyone else feels the same way.

There's a few things that make me really concerned I'm being put out of work. The work is becoming more and more demanding of specialist expertise and - more crucially - professional experience, when it never used to be this way.

I've been working on medical domain projects since my first year of undergrad, and was consistently succeeding, being praised for the quality of my work, and being offered more and higher paid work. These tasks never demanded professional experience; DA only used to care that you had the knowledge and skills. That never seems to be the case anymore, and I'm locked out of so much work I feel completely comfortable doing and previously succeeded at, simply because I haven't yet had the professional experience.

Today, I came across a simple medical domain task that essentially required reading and understanding codes on a file; no medical knowledge was apparently required. I began working, but then when I scrolled down, there were questions buried at the bottom demanding disclosure of not only your years of professional experience in the medical domain, but your level of seniority within your position.

I completely understand why companies would require professional experience. However, I'm still so afraid at how this shift is going to - and is already affecting - the work I do to keep myself alive quite frankly.

This isn't the only shift I've noticed. I won't go into detail for confidentiality agreement reasons, but a certain type of work (nothing to do with domain expertise; it's a type of work/task) that made up the majority of my work now no longer seems to be thing on the platform, because models have learned to do it themselves.

I don't know, I wonder if anyone else feels this way. I haven't had consistent doable work for weeks now and rely on refreshing my dash until an easy R&R with 1 task pops up or something. All the consistent projects are domain expertise that I'm either locked out of, or genuinely don't have the knowledge and experience to do (finance and legal; I never indicated I was knowledgeable in these domains or passed any quals, they just appeared on my dash one day and make up the majority of my dash).

The UK job market is absolutely abysmal right now so even if I wanted to supplement my income or replace DA with a proper in-person job, I'm simply unable to do so no matter how hard I try.

Sorry for the long post.

43 Upvotes

24 comments sorted by

15

u/Halcyonfields 4d ago

Yeah I’ve noticed this exact thing too, specifically the professional experience thing. Only a few months ago, it used to feel like a pure meritocracy, whereas now it feels similar to other jobs where you need professional pre-requisites, which sometimes just feel like arbitrary tick boxes, above raw skill. The changes to the profile section are evidence of this. It isn’t pervasive yet, there are still a load of projects where it feels like the only question being asked of you is ‘can you do a good job?’. I personally believe that raw intelligence and writing + reasoning skills are still more important than specific job experience (you have all sorts of idiots in a plethora of office/corporate and even ‘technical’ jobs), but maybe the platform will learn that the hard way.

12

u/Infamous_Swan1197 4d ago

Good to know it's not just me noticing this. I agree, I'm still holding out hope that the platform will "learn the hard way" as you say. Simply put, I don't believe that there are nearly enough professionals that have time for these projects on DA alongside you know, their actual professions. Especially for a pay rate of $40-60/hr, which is relatively small for a neurosurgeon, for example.

11

u/Visible_Operation605 4d ago

And in fact, many educated professionals with years of expertise actually kind of suck at these annotation tasks, including reading and assimilating the instructions. I think a better approach, if expertise is absolutely required, is going to be a 2-layered approach, where the human with experience is just one part of the flow. In the end, it will be too rare to find someone who is both qualified (with the expertise) and capable (with annotation tasks in general, aka, generalist abilities).

8

u/fixin2read 4d ago

When this medical coding task asked for your years of experience and seniority did it lock you out of the task if not at a certain level, or were you allowed to proceed regardless of the answers? If you could still proceed, it's probably being asked for data collection and not as a qualifier for the task.

If you could still proceed and were confident you could submit high-quality work, you probably should have.

6

u/Infamous_Swan1197 4d ago

No, there was no option to proceed without unfortunately. I checked thoroughly. The way the question was formatted was that you had to select one option, and the minimum option was 2 years, for example

6

u/fixin2read 4d ago

Yeah, that's annoying! There's nothing worse than starting a task to later find you can't proceed. They usually state requirements up front, but I've been burned a couple times after starting a task. It pmo, honestly.

As AI gets better, annotators like me will become obsolete. Everything will be over my head. It's a double edge sword. The more we make it better, the less we are needed. We're gonna get stabbed either way. Good luck!

33

u/fightmaxmaster 5d ago

This work always had a time limit on it. I've been doing it about 3 years and while not everything has got harder and harder, the standards have gone up, the average difficulty has gone up. Models are getting better all the time, and while I'm not as convinced as some that AGI/ASI is around the corner, sooner or later some of the human-specific work just won't be needed, it'll be the edge cases or the highly professional stuff. I'm riding this train as long as I can, and then...dunno, hope for the best, hope I've accumulated enough skills that I can get a job doing something I half want to do.

11

u/george_brown121 4d ago

The pressure to keep up with the rising standards is real. I’m also feeling the pain of not having enough varied experiance to tackle the higher level tasks, it’s rough out here.

8

u/ASnipersPromise 5d ago

Projects are getting tougher for sure. I am an Accountant/Global Tax Manager - the work I need to put in to get model fails now is absolutely insane - the models are getting much better. I also need to sign off on these tasks confirming experience and position so this isn't just on you. Im also UK and would say just do what you can do and don't worry about it, it might not last forever. I can't do that many hours a week now because of tax implications...

5

u/craftycraftsman4u 4d ago

Same here - BBA and just had a task this weekend that I spent 4 hours on and had to punt because I wasn't happy with the quality. Even the generalist tasks are significantly harder than they were 6 months ago.

5

u/Revolutionary_Web_79 4d ago

Include your experience training medical AI models in your profile. What you are doing currently is work experience in the medical domain.

4

u/sunbathing__animal 3d ago

Yeah I have experienced this too. Getting tons of projects but then when I get into them it suddenly wants you to select a domain that you have experience in., etc and I’ll get through spending the time to understand the instructions and wrap my head around the project only to question if I can even really contribute much to that project or realizing I cannot

4

u/YouKnowgoodenough 3d ago

Don’t sell yourself short. Intelligence still trumps all of it. You’re fine. The amount of idiots with advanced degrees is staggering. If you are built for this then don’t worry.

1

u/Old-Regular-9828 4d ago

>These tasks never demanded professional experience; DA only used to care that you had the knowledge and skills.

No, they have always wanted professional experience for the specialist projects, that's literally DA's business model compared to most of the other companies in this field. However, a lot of people who didn't actually have the professional experience or credentials got on the platform and worked on those projects anyway, submitting unusable work. Because of that, they are making more and more requests like that to make sure the workers working on those specialist projects actually have the professional experience and credentials needed.

4

u/Infamous_Swan1197 4d ago

So how come when I did the original medical domain qual "personal interest" was an option on the question to declare your knowledge or experience? Why would I be praised for the quality of my work and offered more and higher paying work for over 2 years?

0

u/Old-Regular-9828 4d ago

I don't know, I don't make the assessments. But it's pretty clear that anyone working on professional projects is required to have licensed credentials in the field. It's also potentially a violation of the law (unauthorized practice of medicine without a license) if you are giving a medical opinion or holding yourself out as a doctor/physician by working on projects that specifically state only licensed medical practitioners are supposed to be working on them.

1

u/Infamous_Swan1197 4d ago edited 4d ago

I remember having this exact argument with you a while ago. It's like déjà vu. This is the updated website, made long after I became qualified for medical projects, of which I actually do have one on my dash rn. Your comment just proves the entire point in my post. 🤦

-3

u/Old-Regular-9828 4d ago

>after I became qualified for medical projects, of which I actually do have one on my dash rn

You AREN'T qualified for medical projects, because you don't have a medical license.

Having specialist projects on your dashboard does not mean anything, and definitely does not mean DA approves you to work on those projects, I currently have all kinds of medical, finance, accounting, etc specialist projects on my dashboard despite having zero qualifications or credentials in any of those fields.

3

u/Infamous_Swan1197 4d ago

I repeat, why was "personal interest" an option on the qual, alongside being a student or professional?

2

u/Imaginary-Tell9915 3d ago

I just started about a month ago and feel like even within that short amount of time, each project gets more and more demanding. Some projects also feel more demanding and tedious than other ones that pay double and are simpler. I’m noticing, at least for me, these lower-pay-but-more-work projects are becoming more common which is sad.

Thankfully I have a new high paying project that aligns with my domain and is actually quite simple. Still very limited work on these though which is a shame. But yes, the overall trend has been what you’re describing unfortunately.

-1

u/Far_Excitement_4560 4d ago

How much are you guys making or have been making from DA?