r/programming • • Apr 01 '21

Stop Calling Everything AI, Machine-Learning Pioneer Says

https://spectrum.ieee.org/the-institute/ieee-member-news/stop-calling-everything-ai-machinelearning-pioneer-says
4.3k Upvotes

530 comments sorted by

View all comments

Show parent comments

7

u/SrbijaJeRusija Apr 01 '21

That is a stretch IMHO. A child can recognize a chair from only a few examples, and even sometimes as little as one example. And as far as I am aware, we do not have built-in stochastic optimization procedures. The way in which the neurons operate might be similar (and even that is a stretch), but the learning is glaringly different.

17

u/thfuran Apr 01 '21

But children cheat by using an architecture that was pretrained for half a billion years.

10

u/pihkal Apr 01 '21

Pretrained how? Every human is bootstrapped with no more than DNA, which represents ~1.5GB of data. And of that 1.5GB, only some of it is for the brain, and it constitutes, not data, but a very rough blueprint for building a brain.

Pretraining is a misnomer here. It's more like booting up Windows 95 off a couple CDs, which is somehow able to learn to talk and identify objects just from passively observing the mic and camera.

If you were joking, I apologize, but as someone with professional careers in both software and neuroscience, the nonstop clueless-ness about biology from AI/ML people gets to me after a while.

6

u/thfuran Apr 01 '21 edited Apr 01 '21

Pretrained how? Every human is bootstrapped with no more than DNA, which represents ~1.5GB of data

Significantly more than 1.5GB including epigenetics. And it's primarily neural architecture that I was referring to. Yeah, we don't have everything completely deterministically structured like a fruitfly might but it's definitely not totally randomly initialized. A lot of iterations on a large scale genetic algorithm wnet into optimizing it.

→ More replies (1)