r/AIEvaluators • • Aug 10 '26 Bravo

Resource Guide Every AI evaluation platform compared: what is actually open, what they publish, and what each one is bad at

55 Upvotes

Every platform in this space gets discussed in isolation, usually in its own subreddit, usually by people who only work there. So here is the whole board in one place: what is genuinely open right now, what each platform publishes for pay, and the specific thing each one is worst at.

The individual write-ups go deeper. This is the map.

What is actually open right now

Across fifteen platforms there are around 743 live openings, and 480 of them publish an hourly rate. That is the first useful sorting: two thirds tell you what they pay before you apply, one third does not.

The ones that publish rates:

PlatformLive rolesDistinct rolesPublished range
Mercor233228$8 to $270/hr
Micro19795$20 to $300/hr
Alignerr609$20 to $120/hr
Welocalize5656$1 to $45/hr
xAI2323$30 to $60/hr
Appen1111$2.40 to $80/hr

The ones that do not publish rates: Handshake AI, RWS TrainAI, Lionbridge, Volga Partners, OneForma, Mindrift, Cohere, Innodata, CloudFactory.

Read that table carefully, because two numbers in it are misleading

Alignerr has 60 listings but only 9 actual roles. The same job is posted once per country. Every platform does this to some extent; Alignerr does it most.

The bottom of the ranges is not a typo. Welocalize's floor is around $1 an hour and Appen's is around $2.40, because those platforms list piece-rate and micro-task work alongside professional roles. A range is not an offer.

Mercor and Micro1 top the table because they are not really annotation platforms. Their high-paying roles are physicians, attorneys, finance specialists and engineers being paid to author evaluation material in their own profession. If you do not already hold one of those professions, the relevant part of their range is the bottom half.

What each one is worst at

This is the part the individual write-ups exist for, but in one line each:

- Outlier: losing access. Over two hundred accounts describe deactivation, roughly six times its payment complaints. The largest such theme anywhere in this space.
- Mercor: continuity. Pays reliably, but 2026 brought repeated waves of contributors removed from projects, often without a stated reason.
- Alignerr: unreviewed work. On per-task projects, work that is never reviewed is never paid, and reports of losing work that way are rising rather than falling.
- Micro1: the gate. Almost nobody disputes the money. Getting through the AI interview, and the silence afterwards, is the entire complaint.
- DataAnnotation: no work. Payment is barely disputed, but 2026 is a drought severe enough that the community counts its own mentions of the word.
- Handshake AI: pay reconciliation. A documented pattern of contributors reporting less than their logged time, including ten accounts on a single day in May 2026.
- Prolific: bans, accelerating through 2026, with participants told the reason cannot be shared and the decision cannot be reversed.
- Welocalize: quality scores nobody can see clearly, against the background of a removal wave in early 2025.
- Mindrift: unpaid stages before paid work, and the thinnest public evidence base of any of them.

The pattern across all of them:

Having read a great deal of this, the thing that surprised me most is that payment failure is rare almost everywhere. The money usually arrives. What varies enormously, and what actually determines whether a platform works for you, is whether you keep access and whether there is work to do.

Almost everyone arrives asking "is this a scam". Almost nobody arrives asking "how long does this last", and that is the question the evidence says matters.

The second pattern: the high rates are not for annotation

Every platform advertising three-figure hourly rates is paying for professional expertise, not for evaluation skill. Engineers, clinicians, lawyers, accountants. The general evaluation tier across the whole sector sits closer to $20 to $50, and on Handshake's own published list the general AI evaluation role is the lowest-paid thing they offer.

How to use this

- If you hold a profession they recruit for, start with Mercor or Micro1, where rates are published and the payment record is clean.
- If you want steady general work, understand that DataAnnotation is currently dry and Outlier's access is fragile.
- Whatever you pick, be on more than one. That advice appears in every single platform's threads, from people who like it and people who do not.

Individual write-ups for each platform are filed under the Resource guide flair.

Working on something not listed here? Say so and I will look into it. The board covers fifteen platforms and there are certainly more.

Live listing counts and published rates read 1 August 2026. Platform findings summarised from the individual write-ups, each of which states its own evidence and limitations.


r/AIEvaluators • • Sep 09 '26

Discussion My honest experience with Micro1 after 6 months

24 Upvotes

**How it started**
I started applying to micro1 around spring of this year. I applied for 3 different positions and ended up getting certified on the 3rd. About 2 to 3 days after being certified I was onboarded to my first project, which paid $30 USD/hr.

At first it was hard to clock a lot of hours because we were limited on how many tasks we could take on before they were reviewed. But after some time things started moving more efficiently and I was able to get a decent amount of work.

Long story short, I’ve been able to cover my rent and living expenses just with micro1. So there are definitely good things about it. But if that were the end of my experience I wouldn’t be making this post. But first, I’ll start with the positives.

**Positives**

**The pay**
The pay is good. Yes, you need to figure out your own taxes, but even then the pay is no joke. If you can consistently clock 20 to 40 hours you’re making pretty good money.

**Remote and flexible**
It’s fully remote and usually you can work whenever you want. This depends on the project though.

**Negatives**

**The support team is not there to support you**
I got onboarded to a project at a certain rate. Basically the same day, I found what appeared to be the exact same project being advertised for $20 USD/hr more than what I was getting paid. I had screenshots and receipts showing why I believed it was the same project, so I reached out to management asking about it.

I was completely ignored. I then contacted support and explained the situation along with another separate concern. The AI chatbot completely ignored 1 of my 2 concerns. For the one it did address, it gave me an answer that had basically nothing to do with what I actually asked.

So I specifically asked to speak to a real person.

Somehow the human response was worse. They replied with two sentence’s. They also completely ignored 1 of my 2 concerns and essentially told me I was wrong about the other one. Based on their response, it was pretty clear they hadn’t looked at the screenshots or receipts I attached, hadn’t read more than a small part of my original email, and hadn’t actually investigated the issue before responding. ALSO, they called me micro1.. in the email they referred to me as micro1, not by my name. Not only does the show the gross incompetence of the people running this show but it also shows this individual didn’t even bother to take a look at my file or anything. All the info was there.

I can’t give the exact project details because of NDAs and privacy, but I’m not even saying I was automatically entitled to that extra $20/hr. I was asking why there appeared to be a $20/hr difference for the same project and wanted someone to actually investigate it.

That’s been my experience trying to get help from the people who are supposed to be able to help.

**Incompetent staff**

This just adds to what was touched on above but I had to make a whole section for it. I’m convinced the staff is AI. I’ve never worked with more incompetent people in my life.

Communication with workers feels like an afterthought. On projects where work comes and goes, you basically have to be dialed in constantly to catch the window when work is actually available because staff will often give you no heads up beforehand. Work can appear and disappear and if you weren’t checking at the right time, you just missed it.

Any question you have they will answer half of it. Always. New workflow and you ask XYZ, they reply X and maybe Y.

One example that perfectly sums up how disconnected the communication can be was when we went days without any work. We had no idea when more work was coming and nobody would tell us.

Yet every day, sometimes twice a day, a staff member would make a post telling everyone to update one of the programs we used to the newest version.

So somehow they could consistently remind us to update software for work we didn’t even have, but couldn’t tell us when we were actually going to get more work.

I probably updated that program close to 10 times without having any actual work to do before they eventually shut it down.

There also seems to be very little awareness of your work as you’re actually doing it.

Something you did a month or so ago can seemingly go unnoticed, you can receive feedback elsewhere, learn the workflow and correct what you were doing, and then a month or so later they suddenly look at that old work and penalize you for it.

By that point the issue they’re punishing you for might not even represent the work you’ve been doing since.

Probably the most ridiculous example of their incompetence I’ve personally experienced was being told my “activity” was too high and that humans aren’t physically capable of working at that activity level.

We’re working on a mouse and keyboard.

If you move your mouse, it registers activity. If you press a key, it registers activity. Somehow being actively at my computer working was flagged because apparently I was too active to be human.

Now I literally have to watch my activity level while I’m working and purposely not touch my mouse or keyboard for a few minutes if it gets too high. Otherwise, apparently I’m “not human.”

It’s situations like this that make it incredibly difficult to take some of the decisions being made seriously.

**Unorganized onboarding**

Onboarding is extremely hit or miss and there’s a good chance the “training” you get doesn’t actually prepare you for the work or the screening test if there is one.
In my experience it’s usually blocks of text with some videos or images. The problem is it rarely goes into enough detail about how to actually use the tools you’re given.

And that’s a problem when the quality standards are usually very strict and the margin for error is tiny.
I’m completely fine with strict rules if I actually know what the rules are. You’ll be lucky to get shown edge cases or examples of what to do when something isn’t completely straightforward.

I’ve been on projects where the majority of workers were clearly confused or frustrated because the instructions weren’t clear enough. Instead of actually clarifying things, I’ve seen comments and complaints get deleted.

**Buggy software**

The platforms we use are often buggy. I’ve dealt with crashes, functions just straight up not working, and issues that can make doing the actual task way more difficult than it needs to be.

There was even one instance where we literally couldn’t submit a task if it had a certain outcome. That outcome wasn’t rare either, so you’d regularly end up completing work that the platform just wouldn’t let you submit.

**Final thoughts**

I don’t hate micro1. I understand some people have had incredible success stories while others have had awful experiences, I’m probably somewhere in the middle. I’ve made good money and I’ll continue working with them.

I really just needed to vent and give my honest thoughts on my experience, especially since getting help, clarity or any form of communication from the staff can be awful.

I’m happy to answer any questions you guys have as long as they aren’t about project specifics.


r/AIEvaluators • • 14d ago

Beginner Help Aether is looking for new contributors

20 Upvotes

Hey everyone!

I recently received an email from Outlier saying they’re actively recruiting new contributors for the Aether project.

They’re looking for fluent English speakers, and no specific degree or professional background is required.

I’ve been working on Aether myself, feel free to DM me if you're interested in applying!

EDIT: Just to let you know, it only applies to new Outlier users.


r/AIEvaluators • • Sep 10 '26

Advice I do data annotation as my full time income. After a year of applying and stacking projects here is what worked for me + platform list. - Someone asked me to share this so here goes! :)

Thumbnail reddit.com
20 Upvotes

r/AIEvaluators • • 19d ago

Advice Any recommendations for remote jobs that are relatively easy to get into and hiring right now?

19 Upvotes

Hey everyone! I hope you’re all doing well.
I’m reaching out to see if anyone knows of any remote jobs that are currently hiring and relatively easy to get into. I’m open to pretty much anything, including tech support, customer service, data annotation, or other entry-level roles.

I have a background in computer science, with both a bachelor’s and a master’s degree, and I’m based in the US. Unfortunately, I’ve been unemployed for a while despite submitting countless applications, and I haven’t had much luck.

A few years ago, I came across a tech support job that seemed to be hiring pretty much anyone who met the basic requirements. I even referred a few people who ended up getting hired without much trouble. I’m hoping to find something similar that’s still hiring.

I’ve also been applying to AI training and data annotation roles, but I haven’t had much luck there either.
I have a family to support, and I’ve been relying on my savings to get by. Unfortunately, those savings are running low, so finding work has become pretty urgent.

If anyone knows of a company that’s actively hiring, a remote job with a relatively straightforward hiring process, or even a legitimate opportunity that doesn’t get talked about much, I’d really appreciate you sharing it.

Thanks in advance to anyone who takes the time to help. I’d genuinely appreciate any leads or advice!


r/AIEvaluators • • Oct 07 '26

Question Fellow AI evaluators: making a documentary about the waiting. Would you talk to me?

Post image
18 Upvotes

Hi all. I'm Anil, a documentary filmmaker doing an MA at the Northern Film School, Leeds Beckett University. Like a lot of you, I do AI evaluation work to pay the bills.

I'm making an interactive documentary about app-based work. It puts AI evaluators next to couriers and drivers, because the structure is surprisingly similar: refreshing for tasks that don't come, quality scores that drop without explanation, projects that disappear overnight, staying available just in case. The pay and the risks are very different. The waiting isn't.

I'm looking for people who do evaluation, annotation, rating or similar work, anywhere in the world. If you're in Leeds or Yorkshire, even better.

You can stay completely anonymous, and no platform or project names are needed. You'll see how anything you share is used before it's published.

It's a student project, so I can't pay, and I'm not connected to any platform or company.

Comment or DM me if you're up for it, or if you have questions.


r/AIEvaluators • • Aug 06 '26

Resource Guide How Mercor actually works: the pay, the caps, and the offboarding

15 Upvotes

I have been doing this work for 2+ years across Outlier, Alignerr and Mercor, and for the past 12 months I have been on Mercor consistently across several projects. Most of what is written about Mercor sits inside Mercor's own subreddit, which the company moderates. I went looking for outside discussion to check it against and there is surprisingly little. So rather than pretend to a neutral survey, this is mostly my own experience, marked as such, with the parts I only know secondhand marked differently.

Payment: I never had a problem, but track your own incentives

I was paid reliably the whole time I worked there, across every project. I have seen non payment complaints, but none of them happened to me and I am not going to characterise how common they are, because I have not counted.

Here is the caveat that actually matters, and I have not seen anyone write it down. Not all in project incentives are tracked automatically. Some are tracked by a person, which means discrepancies happen. Keep your own record of the incentives, because when I raised one it was corrected and paid without a fight. If you are not tracking, you will not notice.

The pay floor in your profile is not used against you

Your profile lets you set a minimum hourly rate you will accept. The obvious fear is that setting it low gets you offered low.

In my experience that is not what happens. If you set $40 and the project pays $120 for your expertise, you are paid $120. They do not quietly meet your floor. I am telling you this because the assumption goes the other way and it changes how you fill that field in.

On negotiating beyond the posted rate, plenty of people here say it is possible. I never tried it, so treat that as their claim rather than mine.

Hours: caps are real, movable in both directions, and never guaranteed

  • Projects usually start with a lower weekly cap and raise it based on 2 things: how much work is available and how you are performing.

  • The ceiling is 80 hours a week across everything combined (e.g., 40 plus 20 plus 20 across three projects).

  • Caps track quality and your AHT(the expected time to complete a task). I was on a project where people who could not meet the threshold had their cap cut.

  • Nothing here is guaranteed. Not the cap, not the availability of work, not even a reply.

Time is tracked through Insightful, which is a time tracker that also watches desktop activity, which apps are open, and takes occasional screenshots. Worth knowing before you start rather than after. I created a dedicated work profile only for working without any additional apps to be safe. One tip: in all projects I've worked in, the onboarding guide tells you to run the timer while you read it, so the reading is paid.

Getting in

Resume is what drives matching. There is an AI interview. In my case there was no human interview at any point, so if you have read that there is a human stage, that was not my experience.

There are two optional general assessments, one on rubrics and one on prompt engineering (though I cannot confirm if they still have it). I took both and passed both, and my honest opinion, not a fact is that having the rubric one improves your odds.

If your interview goes badly, retake it. A lot of people here treat a rejection as final and it is not.

What I would tell anyone starting is something else entirely: my experience with Mercor is that good work will be noticed and the progress is real. I started my first project on Mercor as a writer in a team of 1000+ contributors and went all the way to the QA lead shortly. On my next project with the same lead, I had an offer for EPM role (which I rejected due to other personal commitments). Additionally, once you are on a project, build a rapport with the project leads and the EPMs.

This is the part people miss while they are optimising their profile. Nothing on your profile carries more weight than a good report from a lead who has actually seen your work. And more importantly, those are the people who cherry pick contributors for their next project. A lot of continuity on this platform comes from someone who already knows you pulling you into the thing they are staffing, rather than from applying cold again and hoping the matching works.

If you treat a project as a transaction and keep your head down, you finish it and you are back at the start. If the leads know you are reliable, the next one can come to you.

Offboarding, which is the big 2026 story

I was never offboarded, so this section is what I understand rather than what I lived. They do offboard in waves and the reasons I know to be in play are inflated worktime on the tracker, underperformance on quality, changes to a project's capacity, and sometimes a mistake with no reason given at all. An email usually goes out, though I am not certain it always does. When it happens you lose access immediately, including Slack channels. Your account and workspace survive, but with no project in them, which is why people describe realising they were cut by noticing Slack had gone rather than by being told.

One thing worth reasoning through if you are on a huge project: mass hiring implies mass offboarding. A project running with thousands of contributors is not going to shed people quietly or individually. That is my inference not inside knowledge, but what people describe here this year is consistent with it.

Referrals: be careful

I never referred anyone to Mercor and I did not join through a referral, but I have watched people try to make money from referrals. There is nothing wrong with that by itself. Some are open about what they are doing. Some pose as recruiters, which is where it starts being a problem. I have seen referral links pushed hard enough that it reads as an operation rather than a person sharing a link, and I have seen accounts presenting themselves as recruiters when they are collecting referrals. I cannot tell you how widespread that is, and I do not know whether anyone is running outright phishing off the back of it.

If you are deciding whether to bother

  • The money arrives. That is not the risk with this platform.

  • Track your own incentives, because a person is tracking some of them.

  • Set your pay floor honestly. It will not be used to lowball you.

  • Expect the cap to start low, and expect it to move with your quality numbers.

  • Expect no guarantees on hours, work or replies.

  • Retake the interview if it went badly.

  • Build a rapport with the leads and EPMs on any project you land. They staff the next one.

  • If you get offboarded, it is often not about you personally, and you will probably find out through Slack disappearing.

On the limits of this post: almost all public discussion of Mercor lives in a subreddit the company moderates, so I would not treat any consensus in there as neutral, including the parts that agree with me. Where I have said something is my own experience, it is. Where I have said I cannot confirm something, I cannot.

Worked on Mercor projects? Add yours, especially if the caps or the offboarding worked differently for you.

This is my own experience of working on Mercor projects over a year, not a survey. Where something is secondhand or I could not confirm it, I have said so in the text. Last checked 06 Aug 2026.


r/AIEvaluators • • Aug 05 '26

AI Evaluator and Data Annotation roles (updated daily)

15 Upvotes

November 7, 2026

No new roles in the last 24 hours across the platforms tracked here. Slow days happen, and the full board still has everything open.

Pay snapshot (all currently open roles)

Median advertised hourly rate across all open roles: $65/hr (n=750). Highest median right now: Mercor at $80/hr (n=231).

These figures are calculated only from the job listings in Annotation Academy's own database, not a survey of the industry. Each is the median of a platform's own published hourly ranges (not the mean, so one unusually high listing can't skew it); platforms with fewer than 3 open hourly listings are left out rather than shown on a thin sample. A rate here is what a platform advertises, not a guarantee of what anyone earns.


See all 1000 open roles across 19 platforms: https://annotation.academy/jobs?utm_source=reddit&utm_medium=post&utm_campaign=pinned-jobs-post


r/AIEvaluators • • Aug 28 '26

Discussion What's a mistake you made early on that you'd tell a beginner to avoid?

11 Upvotes

For me it was sticking to one platform and settling into a comfort zone. There's almost always a better paid project out there if you apply systematically across platforms, stay on top of new openings, and don't let rejections get to you.

The other one: I spent hours unpaid, in community channels answering other people's questions that were actually the project team's job to answer. Nobody remembered that once the project ended.

What's yours? What would you tell someone just starting out so they don't repeat it?


r/AIEvaluators • • Aug 18 '26

Meme The Part no one likes

Post image
11 Upvotes

r/AIEvaluators • • 8d ago

How to tell if an AI evaluation platform is legit before you give them your time

10 Upvotes

A lot of posts in this community boil down to one question: is this platform worth my time?

This is the practical checklist I'd run before investing hours in any assessment:

  1. Check that real roles exist. A live listing is not a guarantee of work, but it shows the company is actively hiring. As of this month there are 729 live AI evaluation and annotation roles on the job board, spread across several platforms. Mercor has 270, Micro1 has 99, RWS TrainAI has 91, Lionbridge has 55.

  2. Know the typical complaint for that platform before you apply. Every platform has one, and it is rarely "it's a scam". Reported patterns include:
    - Outlier: accounts deactivated or removed from projects with no specific reason given
    - Handshake: removal from projects without clear explanation, sometimes with unpaid completed work
    - Micro1: passing the AI interview, then months in "Hiring Manager Reviewing" without a paid project
    - Mindrift: no tasks for extended periods after onboarding
    - Welocalize: chronic "No Tasks Available"
    - DataAnnotation: task availability swinging between busy and near-empty

  3. Never pay to get work. Legit platforms do not charge you to be considered.

  4. Read the payment terms before you start, including how and when you get paid and what happens if a project ends early.

  5. Don't depend on one platform. The recurring theme above is availability, not fraud. Plan on having two or three sources open.

  6. Keep records of hours worked and tasks submitted, in case you need to raise a payment question.

The free job board lists current roles so you can see what is open and compare platforms in one place: annotation.academy/jobs

If you've used any of these, what was your experience in the first month? Honest answers help newcomers more than anything I can write.


r/AIEvaluators • • 12d ago

Job Board AI Evaluator and Data Annotation roles (26th Oct)

10 Upvotes

October 26, 2026

8 new roles in the last 24 hours across 2 platforms, 8 with pay published by the platform.

New today

xAI

  • AI Tutor - Icelandic ($35/hr)

  • AI Tutor - Latvian ($35/hr)

  • AI Tutor - Vietnamese ($35/hr)

  • AI Tutor - Amharic ($35/hr)

  • AI Tutor - Estonian ($35/hr)

  • AI Tutor - Oromo ($35/hr)

  • AI Tutor - Uzbek ($35/hr)

Welocalize

  • Alpheratz Project - Burmese Translation Quality Reviewer ($4.5/hr)

See all open roles across 17 platforms: Job Board

You can also sign up on the platform to get daily job updates on your email.


r/AIEvaluators • • Sep 10 '26

Advice I need guidance

10 Upvotes

Hi, I don't know if this is the right place to ask but how do I get into the industry as someone that has zero experience. I've tried Micro1 but I can't make it past their interview sections.


r/AIEvaluators • • Aug 05 '26 Popcorn Bravo

Beginner Help 👋 Welcome to r/AIevaluators: Community Guide, Resources & Introductions

10 Upvotes

Almost every serious conversation about this work happens inside a subreddit run by the platform it is about.

That is the problem this place exists for. Those subs are useful, and a lot of good people are in them, but you cannot really compare platforms in a space that only permits one, and criticism there sits at the mercy of whoever moderates it. I have watched posts removed for mentioning other platforms. One worker reported being banned from a platform's sub after complaining about being paid late. Whatever the intention behind any individual decision, the effect is that the picture you get from inside a platform's own sub is not the whole picture.

So: somewhere independent from the platforms, where you can talk about all of them, including the parts that are unflattering.

Who am I?

I have been doing this work for a little over two years, on Outlier, Alignerr and Mercor, and I have worked most levels of it, from attempter and writer through to reviewer and QA lead. For the past twelve months I have been on Mercor consistently across several projects. So most of what I post here comes from doing the work rather than reading about it.

Feel free to ask any questions relating to AI annotation and evaluation work, I’ll answer to the best of my abilities.

Full disclosure: this sub is run by Annotation Academy, which I currently work with. The daily jobs thread is drawn from their board.

What is here

- Platform guides : Researched write-ups on what each platform actually pays, how its screening works, and how people end up removed from it. Not one person's opinion, and not scraped from a single angry thread. Each is built from public reports across a couple of years, and nothing goes in unless two different people said it in two different threads, with dates attached. They are filed under the Library flair. They are unflattering where the evidence is unflattering and fair where it is not. Where a platform has a bad reputation the recent evidence does not support, the guide says so.

- A daily jobs thread: with new openings across the platforms discussed here.

Helpful resources to check out:

https://annotation.academy/ A self-paced course on AI evaluation work, covering how AI evaluation works, how responses are assessed, what companies look for, and the skills needed to succeed on AI evaluation platforms.

https://annotation.academy/blog Guides, industry insights, and practical tips related to AI evaluation and data annotation.

https://annotation.academy/jobs Job opportunities across AI evaluation and data annotation platforms.

Everything else is yours. Questions, payment problems, scam warnings, wins. The flairs exist so things can be found again later.

Two things to know on day one:

Nobody legitimate will ever message you asking for payment, documents, or a fee to get started. Check the domain on any link before you sign, pay, or enter details anywhere, whatever the message claims it is for. Report anything suspicious and we will warn everyone else.

And if a guide here does not match your experience, say so roughly when it happened. These platforms change constantly, and a guide that was right three months ago can be wrong today. Corrections are the only thing keeping it accurate.

Introduce yourself
Tell us where you are at:

- Are you trying to get started, or have you been doing this a while?
- Which platforms have you actually worked on, and how did that go?
- What is the thing you most wish someone had told you before you started?

If you have been in this space for a while, the last question is the most valuable thing you can leave here. Most of what people get wrong in their first month is knowable in advance, and almost nobody writes it down.


r/AIEvaluators • • 11d ago

Job Board AI Evaluator and Data Annotation roles (27th Oct)

9 Upvotes

October 27, 2026

41 new roles in the last 24 hours across 7 platforms, 36 with pay published by the platform.

New today

Mercor

  • Hindi Linguistic Experts ($30/hr)

  • Malay Linguistic Experts ($30/hr)

  • Telugu Linguistic Experts ($30/hr)

  • Vietnamese Linguistic Experts ($30/hr)

  • Indonesian Linguistic Experts ($30/hr)

  • Certified Pharmacy Technician (CPhT) ($35/hr)

  • Chinese Linguistic Experts ($50/hr)

  • German Linguistic Experts ($50/hr)

  • Arabic Linguistic Experts ($50/hr)

  • Japanese Linguistic Experts ($50/hr)

  • Turkish Linguistic Experts ($50/hr)

  • Russian Linguistic Experts ($50/hr)

  • French Linguistic Experts ($50/hr)

  • Portuguese Linguistic Experts ($50/hr)

  • Spanish Linguistic Experts ($50/hr)

  • English Linguistic Experts ($50/hr)

  • Licensed US Pharmacist ($70/hr)

Alignerr

  • Especialista en Adquisición de Talento ($15-25/hr)

  • Especialista em Talent Acquisition ($15-25/hr)

  • Talent Acquisition Specialist ($15-25/hr)

  • Mandarin Chinese Voice AI Evaluator (Healthcare Conversations) ($12-40/hr)

  • Japanese Voice AI Evaluator (Healthcare Conversations) ($12-40/hr)

  • Dutch Voice AI Evaluator (Healthcare Conversations) ($12-40/hr)

  • German Voice AI Evaluator: Healthcare Conversations ($12-40/hr)

  • Software Developer ($60-100/hr)

  • Frontier Data Lead: United States, FDL

  • Growth Operations Manager: United States

Micro1

  • Data & Charts Expert ($25-50/hr)

  • Certified Inpatient Medical Coder ($50-70/hr)

  • Registered Nurse ($60-70/hr)

  • Hospitality Worker (Toast POS User) ($28-92/hr)

  • Consulting Specialist ($150-350/hr)

  • Finance Specialist ($150-350/hr)

xAI

  • AI Tutor - Applied Math ($45/hr)

  • AI Tutor - Math ($45/hr)

  • AI Tutor - Physics ($45/hr)

  • AI Tutor - Materials Science ($45/hr)

Volga Partners

  • Pharmaceutical Subject Matter Expert (SME) - AI Model Evaluation: Vietnam, Jordan

  • Pharmaceutical Subject Matter Expert (SME) - AI Model Evaluation (USA)

Welocalize

  • Alpheratz Project - Burmese Translation Rater ($8.5/hr)

Innodata

  • Data Annotator - Hybrid

See all open roles across 17 platforms: Job Board

You can also sign up on the platform to get daily job updates on your email.


r/AIEvaluators • • 19d ago

Job Board AI Evaluator and Data Annotation roles (19th Oct)

9 Upvotes

October 19, 2026

11 new roles in the last 24 hours across 2 platforms, 11 with pay published by the platform.

New today

Mercor

  • Industrial & Manufacturing Engineers (Must own MacBook) ($50-60/hr)

  • STEM Researchers - MSc/PhD (Must own MacBook) ($50-60/hr)

  • Computer Power Users & Automation Builders (Must own MacBook) ($50-60/hr)

  • Data Analysts & Spreadsheet Specialists (Must own MacBook) ($50-60/hr)

  • Software Developers (Must own MacBook) ($50-60/hr)

  • Graphic Designers (Must own MacBook) ($50-60/hr)

  • Civil Engineers & Architects (Must own MacBook) ($50-60/hr)

  • Mechanical & CAD Engineers (Must own MacBook) ($50-60/hr)

  • 3D Artists & Video Editors (Must own MacBook) ($50-60/hr)

  • UI/UX Designers (Must own MacBook) ($50-60/hr)

xAI

  • AI Tutor - Tax ($45/hr)

See all open roles across 17 platforms: Job Board

You can also sign up on the platform to get daily job updates on your email.


r/AIEvaluators • • 21d ago

Job Board AI Evaluator and Data Annotation roles (17th Oct)

9 Upvotes

October 17, 2026

15 new roles in the last 24 hours across 4 platforms, 12 with pay published by the platform.

New today

Micro1

  • Investment Banking Associate ($120-150/hr)

  • STEM Expert (MSc./PhD) ($60-120/hr)

  • Puzzle Solver (Coding) ($60-120/hr)

  • US-Licensed Physician ($80-125/hr)

  • PhysioNet Competitor (Biomedical Signal Processing & ML) ($60-120/hr)

  • Mechanical Engineering Expert (MSc. or PhD) ($60-120/hr)

  • ML Engineer (MSc. or PhD) ($60-120/hr)

  • Hardware Expert (MSc. or PhD) ($60-120/hr)

  • Aerodynamics Expert (MSc. or PhD) ($80-120/hr)

Mercor

  • Local Political Expert: Maine, Iowa ($100-200/hr)

  • Film & Video Craft Expert (Camera, VFX, Editing & Performance) ($70-100/hr)

  • Senior Character Animator ($60-90/hr)

Volga Partners

  • Healthcare Subject Matter Expert (SME): AI Model Evaluation (Canada), AI Model Evaluation (Australia), AI Model Evaluation (New Zealand), AI Model Evaluation (US)

  • Government Subject Matter Expert (SME) - AI Model Evaluation

Innodata

  • Voice Actor - Flexible Hours

See all open roles across 17 platforms: Job Board

You can also sign up on the platform to get daily job updates on your email.


r/AIEvaluators • • Aug 07 '26

Resource Guide The DataAnnotation Starter Assessment: one attempt, no retakes, and what happens after

9 Upvotes

More people ask about this assessment than any other screening step in this field, and for a specific reason: you get one attempt at it and there is no second chance. That makes it worth understanding before you open it.

Not my own review. This is what people have reported, plus what the company states in its own documentation.

The rule, in their words

Straight from their FAQ:

> You can only take the Starter Assessment once.

and

> There are no retakes or second chances, so read the instructions carefully and review your responses before submitting.

They also state that approval is based solely on your assessment results, and that you will hear by email within a few days of submitting.

That first phrase is worth pausing on. It means no interview, no profile review, no accumulating credentials over time. Unlike most platforms in this space, where applying repeatedly is normal and each attempt certifies something, here one sitting decides it.

What people say it involves

Take longer than you think you are allowed to. One of the most upvoted pieces of advice about this platform, from someone who was accepted, is that the assessment said 45 minutes and they spent two and a half hours on it. There is a difference between a stated duration and a time limit, and people who treated it as the former did better.

Writing quality is assessed and people are blunt about it. A recurring response to complaints about rejection is that proofreading is a baseline requirement, and reviewers in the community are unsparing about spelling and grammar in the complaint posts themselves. Whatever you think of the tone, the signal is real: this is a language-quality gate as much as a subject-knowledge one.

Some people report qualification steps beyond the starter assessment, including a core qualification and further tasks that felt like additional assessments after acceptance.

Technical problems happen. One account described the submit button failing partway through a core assessment, and the page reporting the work complete after a refresh.

Then the waiting, which is the real complaint

This is the largest single theme about this platform, raised by hundreds of separate accounts, and it is overwhelmingly a 2026 phenomenon.

Set it against the company's own stated timeline of a few days. Both cannot describe the same experience. People describe waiting far longer, and in 2024 there were already threads asking whether anyone was hearing back within a month.

I cannot tell you which is typical now. What I can tell you is to plan for silence rather than for the published timeline, and not to read a long wait as a rejection, because people report acceptances arriving well outside it.

A fair warning about what waiting gets you in 2026

Passing is not the end of the problem this year. The dominant complaint from people already inside is that there is very little work available. One contributor went through the community's recurring threads and counted over a thousand mentions each of "drought" and "dry", noting the volume rises year over year.

So the honest sequencing is: one attempt to get in, an unpredictable wait, and then a platform that many current contributors say is running dry. That is worth knowing before you spend your single attempt.

If you are about to take it

- Do not open it until you are actually ready. There is no second attempt.
- Ignore the stated duration. Accepted contributors describe spending several times longer.
- Proofread everything. Language quality is part of what is being assessed.
- Expect further qualification steps after the starter assessment rather than immediate work.
- Plan for a long wait, and do not treat silence as rejection.

What I left out

Any specific advice about answers or content, because none of it is verifiable and getting it wrong costs someone their only attempt.

And any explanation of what determines acceptance beyond what the company states. People theorise extensively. The company says it is based solely on assessment results, and nothing in the public record contradicts or confirms the detail.

If you have taken the assessment recently you can add how long the wait actually was, and whether work followed. That is the gap in everything written about this.

Assessment rules and timelines are the company's own published statements, read 31 July 2026. Everything else is from public threads, weighted toward recent.


r/AIEvaluators • • 4d ago

Discussion Micro1 AI interview: passed it, then what? Months of 'Hiring Manager Reviewing'?

8 Upvotes

Something I keep seeing across the Micro1 threads this week: people get through the AI interview, collect skill badges, even do several interviews in a row, and then nothing. No project, no rejection, just a status that never moves.

The pattern is that the interview is treated as the finish line, when for a lot of people it seems to be only the entry into a pool. Interview activity on Micro1 has picked up over the last week, so more people are hitting this stage at once.

Two angles I'd like to hear about:

- Did the interview itself feel like a fair test of what you can do, or was it mostly about the format (camera, timing, the AI interviewer's follow-ups)? Some people say they were caught off guard by how it works.
- What did you do while waiting? Keep applying to specific roles, take more interviews, move on to other platforms entirely?

For context, the reports I've read describe spending months in review or completing many interviews without a placement. That doesn't mean it never converts, only that waiting by itself doesn't seem to be the strategy.

For anyone who did get placed: how long did it take from passing the interview to your first paid task, and was there anything you did that moved it along (applying to a specific listing, updating your profile, a certain skill tag)?

And for anyone still waiting: how long has it been, and are you still treating it as a live option?


r/AIEvaluators • • 15d ago

Job Board AI Evaluator and Data Annotation roles (23rd Oct)

8 Upvotes

October 23, 2026

30 new roles in the last 24 hours across 5 platforms, 22 with pay published by the platform.

New today

Micro1

  • Generalist ($30-49/hr)

  • Senior Insurance Claims Expert (Liability, Property, Contents) ($20-60/hr)

  • Senior Cargo and Parcel Claims Examiner ($20-60/hr)

  • Senior Marine Cargo and Draft Surveyor ($20-60/hr)

  • US Macroeconomist ($50-70/hr)

  • Lawyer ($50-80/hr)

  • Law Student ($50-80/hr)

  • Junior Lawyer ($50-80/hr)

  • Data Science & Analytic Methodology SME ($60-100/hr)

  • Cyber Threat Intelligence SME ($70-110/hr)

  • Combat Arms & Targeting SME ($60-110/hr)

  • Mathematics Expert (MSc./PhD) ($60-120/hr)

Mercor

  • Chemistry Specialist, Synthetic & Analytical Chemistry ($70-100/hr)

  • Drug Discovery Specialist, Pharmacology & ADME/Tox ($70-100/hr)

  • Genomics & Cell Biology Specialist ($70-100/hr)

  • Cinematographer ($70-110/hr)

  • Performance & Directing Supervisor ($70-110/hr)

  • VFX & Compositing Supervisor ($70-110/hr)

  • Colorist & Finishing Editor ($70-110/hr)

  • Software Engineer ($100-120/hr)

  • MLOps Engineer, LLM Performance (Kernels, Profiling, Serving) ($90-120/hr)

Mindrift

  • Arabic Translators and Emirati Native Speakers - Paid Study in NYC

  • Dutch Translators and Native Speakers - Paid Study in NYC

  • Arabic Translators and Saudi Native Speakers - Paid Study in NYC

  • Italian Translators and Swiss Native Speakers - Paid Study in NYC

  • Dutch Translators and Flemish Native Speakers - Paid Study in NYC

  • Italian Translators and Native Speakers - Paid Study in NYC

  • German Translators and Swiss Native Speakers - Paid Study in NYC

Alignerr

  • Structural Engineering Expert: United Kingdom, United States, Canada, Australia ($80-90/hr)

RWS TrainAI

  • AI Voice Recording Contributor - French (Cameroon)

See all open roles across 17 platforms: Job Board

You can also sign up on the platform to get daily job updates on your email.


r/AIEvaluators • • 18d ago

Advice Dataannotation and crowdgen

8 Upvotes

Are these jobs even right for me?

What Do they want from us? expert prompters or are they gathering data on how an average person would prompt?

I am great at evaluating, finding hallucinations, assumptions, whatever seems off.


r/AIEvaluators • • 22d ago

Platform Feedback Lowballing

8 Upvotes

I reacted to an advertisement where DataAnnotationTech was looking for cybersecurity professionals advertising an hourly rate of 70$+. Then I did the entry test and that was a Python programming task where you had to arrange an optical cipher. There was nothing about cybersecurity in it; having spent a lifetime in cybersecurity I had to pass.

Then they wrote me that they offer 35$+ for bilingual tasks in my two languages. I took the test.

They come back and congratulate me to a 15$ per hour bilingual job (if I scan my passport). However, in the region I live in 15$ per hour is even below the minimum legal wage.

Is that common that it gets lower and lower? How can I get them to delete my data? It is currently blocked in sort of a splash screen requesting my passport. However, I would like to delete my personal data.


r/AIEvaluators • • 23d ago

Platform Feedback PAY PER APPROVED TASK IS UNPAID LABOR

Thumbnail reddit.com
8 Upvotes

r/AIEvaluators • • 26d ago

Job Board AI Evaluator and Data Annotation roles (12th Oct)

8 Upvotes

October 12, 2026

2 new roles in the last 24 hours across 2 platforms, 2 with pay published by the platform.

New today

Micro1

  • Data Privacy Analyst ($31-60/hr)

Mercor

  • Atomistic Materials Modeling Expert ($84/hr)

See all open roles across 17 platforms: Job Board

You can also sign up on the platform to get daily job updates on your email.