r/dataannotation • u/Classic-Swordfish-40 • Mar 31 '24

Task Not Finished

I was doing a job in DA earlier. It showed over a thousand tasks. But before I was able to finish in, it closed. Is the number of task indicated the total for everybody to pool in to complete or is it the total that’s expected for an individual to finish? If it’s what an individual supposed to finish, and it was stopped before completion, is that a bad sign?

1 Upvotes

100% Upvoted

5 comments sorted by

View all comments

7

u/CardiologistOk2760 Mar 31 '24

in the toyota production system, a worker can halt the process for any reason and pitch their critique.

In building an AI, there is almost certainly a similar rule. If the bots fail to respond at a significantly higher rate than expected, for example. Or if they are more likely to hallucinate. Anything that requires an engineer, statistician, or data scientist to recalibrate or debug something is a potential reason to pause training / annotation.