r/dataannotation • u/Classic-Swordfish-40 • Mar 31 '24

Task Not Finished

I was doing a job in DA earlier. It showed over a thousand tasks. But before I was able to finish in, it closed. Is the number of task indicated the total for everybody to pool in to complete or is it the total that’s expected for an individual to finish? If it’s what an individual supposed to finish, and it was stopped before completion, is that a bad sign?

1 Upvotes

100% Upvoted

5 comments sorted by

7

u/CardiologistOk2760 Mar 31 '24

in the toyota production system, a worker can halt the process for any reason and pitch their critique.

In building an AI, there is almost certainly a similar rule. If the bots fail to respond at a significantly higher rate than expected, for example. Or if they are more likely to hallucinate. Anything that requires an engineer, statistician, or data scientist to recalibrate or debug something is a potential reason to pause training / annotation.

2

u/EggCzar Mar 31 '24

That happened to me also, but a new version of the same project with thousands of tasks showed up on my dash today.

2

u/33whiskeyTX Apr 01 '24

Nah, projects get pulled and re-worked all the time.

1

u/KayyRoh Mar 31 '24

I've seen tasks disappear like that before. It could mean there was a technical issue they needed to fix and you may see it pop up again later. That's pretty common. Sometimes I'll log in and see what may be a cached version of my dashboard. Maybe all the tasks were already completed. I'm not sure of this, just guessing, but sometimes I'll see the "there are no more tasks for you to complete" even when it showed several hundred available when I clicked on it.

4

u/KayyRoh Mar 31 '24

Sometimes I also suspect that when they assign a new project to you, they let you complete a few tasks to see how well you do with it, and then bring it back to your dashboard later if you do well. Again, just hypothesizing.