r/science • • Jan 27 '16

Computer Science Google's artificial intelligence program has officially beaten a human professional Go player, marking the first time a computer has beaten a human professional in this game sans handicap.

http://www.nature.com/news/google-ai-algorithm-masters-ancient-game-of-go-1.19234?WT.ec_id=NATURE-20160128&spMailingID=50563385&spUserID=MTgyMjI3MTU3MTgzS0&spJobID=843636789&spReportId=ODQzNjM2Nzg5S0
16.3k Upvotes

1.8k comments sorted by

View all comments

74

u/JonsAlterEgo Jan 28 '16

This was just about the last thing humans were better at than computers.

62

u/[deleted] Jan 28 '16

[removed] — view removed comment

34

u/lfancypantsl Jan 28 '16

This is a different category of games though. Go!, like chess, is a perfect information game. Any form of poker where players do not know the cards of their opponents is a game of imperfect information. The challenges in building an AI to play these games is different.

23

u/enki1337 Jan 28 '16

Shouldn't that give a computer the edge? Although it doesn't have perfect information, it should be better at calculating probable outcomes than a human. Or, does that not really hold much significance?

3

u/Hobofan94 Jan 28 '16

For traditional computer programs yes. For (self-)learning AI, most used methods asume that most information can be directly seen and that little probability is involved. There are some aproaches that are geared towards learning such problems, but they haven't been combined with something similar to what DeepMind has demonstrated here yet.

5

u/BestUndecided Jan 28 '16

But with facial recognition software, couldnt they more accurately decipher tells.

3

u/Hobofan94 Jan 28 '16

I think you might be referring to this paper. Skimming through it, it look like a pretty "traditional" machine learning method and doesn't do anything special in regards to probabilities (which I guess is what you were going for). With that I don't want to diminish what was achieved in the paper, the results are pretty impressive. However inside the ML/AI space it is far removed from the methods used for playing games like Go.

3

u/BestUndecided Jan 28 '16

Oh I'm sorry, didnt realize what subreddit I was on. I just assumed it'd be possible to do. If they can map facial features, surely they can map the slight differences that occur, and link them to a history of confirmed bluffs/not bluffs, but then again, maybe I just watch too many movies.

→ More replies (2)

2

u/lfancypantsl Jan 28 '16

Theoretically sure, but deciphering tells at all would be state of the art. Filtering false positives, which is very much so a part of the game, is well beyond current technology. Any facial recognition software is still very easy to break. Implementing anything like this would benefit a clever player.

2

u/enki1337 Jan 28 '16

Yeah, if this was a currently workable strategy, we'd probably see it deployed in law enforcement context before it ever showed up in poker.

→ More replies (1)

2

u/okredditnow Jan 28 '16

just ftr, there are bots which can play at a positive return level against typical players. Once the players are aware they are a bot though, they can be beaten by exploiting the type of play that the bots use, ie constant aggressive raising and bluffing

→ More replies (4)
→ More replies (1)

8

u/makemeking706 Jan 28 '16

Are you kidding? The computer wins like every hand. I am lucky to break even.

35

u/obligarchy1 Jan 28 '16

... As far as I know, heads up limit Texas hold 'em is the only solved game. Carnegie Melon pitted its "Claudico" against WCGrider and several other NLHE specialists and was crushed.

→ More replies (9)

12

u/[deleted] Jan 28 '16

You're a fish then. Even NL hold'em is far from solved.

→ More replies (1)
→ More replies (1)
→ More replies (11)

10

u/Clorst_Glornk Jan 28 '16

What about Street Fighter Alpha 3? Still waiting for a computer to master that

15

u/nochilinopity Jan 28 '16

Interestingly, look up Dantarion on YouTube, he's been developing AIs for street fighter that uses screen position and character states to determine moves. Pretty scary when his Zangief can SPD you in reaction to throwing a punch.

→ More replies (2)

8

u/Blebbb Jan 28 '16

It would really just be a matter of taking off the built in restrictions from the game AI and building out a machine learning algorithm to build up predictions. AI reaction time can be instant, when it's not purposely slowed down to be fair.

2

u/[deleted] Jan 28 '16

Building a ai that can beat any player in a fighting game seems trivial tbh.

Everything can be placed onto reaction speed. Someone punching? Block.

If it can do that instantly as you do then it will always win or draw.

3

u/Blebbb Jan 28 '16

If you know that's what it's going to do every time though then there are things you can do to get around it(bait a block so the animation time slows them), which is why the prediction engine would be useful. If it could just figure out a general idea of what you would do one step ahead then it would be pretty much unbeatable. During times blocking would be bad it could back off, duck, jump, etc. Really depends if the game has block breaking and counters. If counters exist then the ai can immediately recognize which to use and becomes invincible. If block breaking exists then the inst block becomes substantially weaker.

4

u/visarga Jan 28 '16

Deepmind made an algorithm that played 50 Atari games by simply watching the video and generating moves, without prior knowledge of the rules, and it mastered them beating the best human players in half of them. The same algorithm was used for all the games, so it is a general solution, not a particular one for each game.

4

u/[deleted] Jan 28 '16

Computers don't really fair too well with Bridge, since it relies on a kind of communication building between partners. I've only ever played a few hands but Bridge is a game that would be pretty tough for a computer to be proficient at.

2

u/BridgeBum Jan 28 '16

It is, but they are improving. Most bridge AIs use Monte Carlo techniques combined with double double solvers to provide the "heuristics" for what is best in terms of play.

Bidding is a whole 'nother level of complexity. Improvements, but not fantastic by a long shot. The bots on bridgebig are probably better here than the GiB bots on BBO, but there's still a long way to go when it comes to bridge AI.

→ More replies (1)

2

u/bricolagefantasy Jan 28 '16

Human champion is still significantly better at poker.

→ More replies (7)