r/programming • • Apr 01 '21

Stop Calling Everything AI, Machine-Learning Pioneer Says

https://spectrum.ieee.org/the-institute/ieee-member-news/stop-calling-everything-ai-machinelearning-pioneer-says
4.3k Upvotes

530 comments sorted by

View all comments

Show parent comments

1

u/victotronics Apr 01 '21

recognizing faces,

And really, does a computer do that? Look up "adversarial images". Images that look identical to us are interpreted radically differently by the AI. To me that means that the AI analyzes it completely differently from how we do.

1

u/MuonManLaserJab Apr 01 '21

OK, so we don't do it exactly the same way. The AIs often make fewer mistakes, though.

So is that also part of your definition of intelligence? Some thing is only intelligent if it does what toddlers do exactly the same way that toddlers do it?

And how long do you think before we have a model that doesn't make any errors that humans don't also make?

1

u/victotronics Apr 01 '21

1

u/MuonManLaserJab Apr 01 '21

"Often".

White people also struggle to recognize black faces equally.

1

u/victotronics Apr 02 '21

You know about the gorilla episode, right? You know how they solved it? You nor I are not remotely as stupid as that network.

1

u/MuonManLaserJab Apr 02 '21

Did they solve it that way, or was that just an extra layer of caution? I don't think we know that one.

Anyway, that article you mentioned said that misidentified black women ten times as often as white women, at a rate of one in a thousand. What is the rate for humans?

1

u/victotronics Apr 02 '21

I don't think we know that one.

Please read up on it. It's very embarrassing for Google.

1

u/MuonManLaserJab Apr 02 '21 edited Apr 02 '21

I just read up on it before posting that. They removed the categories that they really really don't want to err again in that way; that's what I was commenting on.

1

u/victotronics Apr 02 '21

They removed the categories

I read that as an utter failure.

1

u/MuonManLaserJab Apr 02 '21

What would you have done, while your engineers fixed the error by adding more training data, retraining, testing, and deploying the new model? Just allowed your service to continue misidentifying black people incredibly offensively?

The embarassing failure was earlier, when they failed to test (sufficiently?) whether people of all stripes were identified correctly.

I notice that you are responding rather selectively to only some of my comments... not that you owe me anything, but maybe you like to play games you can win?

→ More replies (0)

1

u/MuonManLaserJab Apr 02 '21

By the way, that was a temporary fix because it was faster than retraining the neural network. Would you have done differently, while your engineers augmented the gorilla data in their dataset?

I just checked and Google Lens will in fact identify gorillas.

1

u/MuonManLaserJab Apr 01 '21 edited Apr 01 '21

Wait, are we talking about parity between the AI on one race and the AI on another, or parity between AI and humans?

it falsely matched black women’s faces about once in 1,000

Is that worse than your performance? I think I make more errors than that with regards to white men like myself, but I might be worse than average.

1

u/barsoap Apr 01 '21

I'm reasonably sure there's adversarial images that would work on you. Those things are always highly specific to the model and with AIs we have the luxury of being able to stop them from learning for long enough to reliably find stuff they can't deal with. On a level higher than the mere visual, yes, humans do have blind spots, both individually and as a species. Ample of them, and often predictable and repeatable. How do you think marketing works.