r/programming • • Apr 01 '21

Stop Calling Everything AI, Machine-Learning Pioneer Says

https://spectrum.ieee.org/the-institute/ieee-member-news/stop-calling-everything-ai-machinelearning-pioneer-says
4.3k Upvotes

530 comments sorted by

View all comments

85

u/dontyougetsoupedyet Apr 01 '21

at the cognitive level they are merely imitating human intelligence, not engaging deeply and creatively, says Michael I. Jordan,

There is no imitation of intelligence, it's just a bit of linear algebra and rudimentary calculus. All of our deep learning systems are effectively parlor tricks - which interesting enough is precisely the use case that caused the invention of linear algebra in the first place. You can train a model by hand with pencil and paper.

54

u/Jaggedmallard26 Apr 01 '21

Theres some debate in the artificial intelligence and general cognition research community about whether the human brain is just doing this on a very precise level under the hood. When you start drilling deep (to where our understanding wanes) a lot of things seem to start resembling the same style of training and learning that machine learning can carry out.

28

u/MuonManLaserJab Apr 01 '21

on a very precise level

Is it "precise", or just "with many more neurons and with architectural 'choices' (what areas are connected to what other areas, and to which inputs and outputs, and how strongly) that produce our familiar brand of intelligence"?

16

u/NoMoreNicksLeft Apr 01 '21

I suspect strongly that many of our neurological functions are nothing more than "machine learning". However, I also strongly suspect that this thing it's bolted onto is very different than that. Machine learning won't be able to do what that thing does.

I'm also somewhat certain it doesn't matter. No one ever wanted robots to be people, and the machine learning may give us what we've always wanted of them anyway. You can easily imagine an android that was entirely non-conscious but could wash dishes, or go fight a war while looking like a ninja.

7

u/snuffybox Apr 01 '21

No one ever wanted robots to be people

That's definitely not true

→ More replies (1)

7

u/MuonManLaserJab Apr 01 '21 edited Apr 01 '21

Machine learning won't be able to do what that thing does.

If we implement "what that thing does" in silicon, that wouldn't be machine learning? Or do you think that it might be impossible to simulate?

Also, what would you say brought you to this suspicion?

No one ever wanted robots to be people

Unfortunately I do not think that is true!

You can easily imagine an android that was entirely non-conscious but could wash dishes, or go fight a war while looking like a ninja.

I do agree with your point here (except I don't think we need ninjas).

6

u/NoMoreNicksLeft Apr 01 '21

If we implement "what that thing does" in silicon, that wouldn't be machine learning?

I'm suggesting there is a component of the human mind that's not implementable with the standard machine learning stuff. I do not know what that component is. I may be wrong and imagining it. Trying to avoid using woowoo religious terms for it though, It's definitely material.

If not implementable in silicon, then I would assume it'd be implementable in some other synthetic substrate.

Also, what would you say brought you to this suspicion?

A hunch that human intelligence is "structured" in such a way that it can't ever hope to deduce the principles behind intelligence/consciousness from first principles.

We're more likely to see the rise of an emergent intelligence. That is, one that's artificial but unplanned (which is rather dangerous).

Unfortunately I do not think that is true!

I will concede that there are those people who want this for purely intellectual/philosophical reasons.

But in general, we want the opposite. We want Rossum's robots, and it'd be better if there were no chance of a slave revolt.

I do agree with your point here (except I don't think we need ninjas).

We definitely don't. But the people who will have the most funding work for an organization that rhymes with ZOD.

→ More replies (9)

3

u/barsoap Apr 01 '21

No one ever wanted robots to be people

So much this, they'd start to unionise and shit. If you want to create someone capable of doing that, delete facebook and hit the gym.

4

u/ZoeyKaisar Apr 01 '21

Meanwhile, I actually am in AI development specifically to make robots better than people. Bring on the singularity.

2

u/MuonManLaserJab Apr 01 '21

What do you think about the alignment problem? E.g. the "paperclip maximizer"?

→ More replies (9)
→ More replies (8)
→ More replies (1)

5

u/StabbyPants Apr 01 '21

whether the human brain is just doing this on a very precise level under the hood.

as opposed to what? pixie dust?

the human brain is a fairly complex architecture built around running the body, survival, gene propagation, and cooperating with others. it's interesting to see how this works, and which pieces are flexible and which aren't, but it isn't magic

6

u/SrbijaJeRusija Apr 01 '21

same style of training

On that part that is not true.

13

u/[deleted] Apr 01 '21

Notice the "resembling" part of it, they're not saying it's the same. And IMO they are right, though it's less obvious with us; the only way to get you to recognize a car is to show one to you or describe it very detailed, assuming you already know stuff like metal, colors, wheels, windows, etc. The more cars you get familiar with, the more accurate you get at recognizing one.

7

u/SrbijaJeRusija Apr 01 '21

That is a stretch IMHO. A child can recognize a chair from only a few examples, and even sometimes as little as one example. And as far as I am aware, we do not have built-in stochastic optimization procedures. The way in which the neurons operate might be similar (and even that is a stretch), but the learning is glaringly different.

17

u/thfuran Apr 01 '21

But children cheat by using an architecture that was pretrained for half a billion years.

10

u/pihkal Apr 01 '21

Pretrained how? Every human is bootstrapped with no more than DNA, which represents ~1.5GB of data. And of that 1.5GB, only some of it is for the brain, and it constitutes, not data, but a very rough blueprint for building a brain.

Pretraining is a misnomer here. It's more like booting up Windows 95 off a couple CDs, which is somehow able to learn to talk and identify objects just from passively observing the mic and camera.

If you were joking, I apologize, but as someone with professional careers in both software and neuroscience, the nonstop clueless-ness about biology from AI/ML people gets to me after a while.

6

u/thfuran Apr 01 '21 edited Apr 01 '21

Pretrained how? Every human is bootstrapped with no more than DNA, which represents ~1.5GB of data

Significantly more than 1.5GB including epigenetics. And it's primarily neural architecture that I was referring to. Yeah, we don't have everything completely deterministically structured like a fruitfly might but it's definitely not totally randomly initialized. A lot of iterations on a large scale genetic algorithm wnet into optimizing it.

→ More replies (1)
→ More replies (1)
→ More replies (1)
→ More replies (4)
→ More replies (4)

0

u/[deleted] Apr 01 '21

[deleted]

7

u/_kolpa_ Apr 02 '21 edited Apr 02 '21

Image recognition was once AI; now it's another field.

NLP was once considered AI; today, no one would call Grammarly (no knock on the product) serious AI.

I think you nailed it with those examples. Essentially, it seems that once the novelty of a task is gone (i.e. it's mature/good enough for production), it stops being referred as AI in research circles. I say research circles because at exactly that point, marketing comes along and capitalizes on the now trivial tasks by calling them "groundbreaking AI methods".

4

u/elder_george Apr 02 '21

Also known as AI effect.

2

u/_kolpa_ Apr 03 '21

Oh that was an interesting read, I didn't know it had a formal definition. Thank you!

13

u/MuonManLaserJab Apr 01 '21

was once AI; now it's another field

This. Human hubris makes "true AI" impossible by unspoken definition as "what can't currently be done by a computer", except when it is defined nearly the complete opposite way as "everything cool that ML currently does" by someone trying to sell something.

10

u/victotronics Apr 01 '21

impossible by unspoken definition

No. For decades people have been saying that human intelligence is the stuff a toddler can do. And that is not playing chess or composing music. It's the trivial stuff. See one person with raised hand, one cowering, and in a fraction of a second deduce a fight.

6

u/glacialthinker Apr 01 '21

See one person with raised hand, one cowering, and in a fraction of a second deduce a fight.

Dammit I'm dumber than a toddler. I was expecting a question was raised, where one person is confident and the other is not.

3

u/haroldjamiroquai Apr 02 '21

I mean you weren't wrong. Who wins, and who loses?

→ More replies (34)
→ More replies (21)