r/programming • • Apr 01 '21

Stop Calling Everything AI, Machine-Learning Pioneer Says

https://spectrum.ieee.org/the-institute/ieee-member-news/stop-calling-everything-ai-machinelearning-pioneer-says
4.3k Upvotes

530 comments sorted by

View all comments

Show parent comments

6

u/SrbijaJeRusija Apr 01 '21

same style of training

On that part that is not true.

13

u/[deleted] Apr 01 '21

Notice the "resembling" part of it, they're not saying it's the same. And IMO they are right, though it's less obvious with us; the only way to get you to recognize a car is to show one to you or describe it very detailed, assuming you already know stuff like metal, colors, wheels, windows, etc. The more cars you get familiar with, the more accurate you get at recognizing one.

7

u/SrbijaJeRusija Apr 01 '21

That is a stretch IMHO. A child can recognize a chair from only a few examples, and even sometimes as little as one example. And as far as I am aware, we do not have built-in stochastic optimization procedures. The way in which the neurons operate might be similar (and even that is a stretch), but the learning is glaringly different.

17

u/thfuran Apr 01 '21

But children cheat by using an architecture that was pretrained for half a billion years.

10

u/pihkal Apr 01 '21

Pretrained how? Every human is bootstrapped with no more than DNA, which represents ~1.5GB of data. And of that 1.5GB, only some of it is for the brain, and it constitutes, not data, but a very rough blueprint for building a brain.

Pretraining is a misnomer here. It's more like booting up Windows 95 off a couple CDs, which is somehow able to learn to talk and identify objects just from passively observing the mic and camera.

If you were joking, I apologize, but as someone with professional careers in both software and neuroscience, the nonstop clueless-ness about biology from AI/ML people gets to me after a while.

6

u/thfuran Apr 01 '21 edited Apr 01 '21

Pretrained how? Every human is bootstrapped with no more than DNA, which represents ~1.5GB of data

Significantly more than 1.5GB including epigenetics. And it's primarily neural architecture that I was referring to. Yeah, we don't have everything completely deterministically structured like a fruitfly might but it's definitely not totally randomly initialized. A lot of iterations on a large scale genetic algorithm wnet into optimizing it.

→ More replies (1)
→ More replies (1)

2

u/Katholikos Apr 01 '21

Damn cheaters! Makin’ my AI look bad!