It's intensely contemplative. It is almost hypnotic. It's like putting your hand on the third rail of the universe. If you play go seriously, there is a chance that you will get exposed to this experience. That is kind of like nothing else on the planet. Go is putting you in a place where you're always at the very farthest reaches of your capacity.
There's a reason that people have been playing go for thousands and thousands of years. Right, it's not just that they want to understand go, they want to understand what understanding is, and maybe that is truly what it means to be human. When I was a kid, I loved playing games. I started off with board games like chess, and then I bought my first computer when I was 8, with winnings from a chess tournament. Ever since then, I felt that computers with a sort of magical device that could extend the power of your mind, virtual environments and games.
We think they're the perfect platform for developing and testing AI algorithms. Games are very convenient in that a lot of them have scores, so it's very easy to measure incremental progress. So I'm going to show you a few videos of the agent system, the AI. So let's start off with breakout. So here, you control the batten ball and you're trying to break through this rainbow-colored wall. The agent system has to learn everything for itself just from the wall pixels. It doesn't know what it's controlling. It doesn't even know what the object of the game is. Now the beginning. After a hundred games, you can see the agent is not very good. It's missing the ball most of the time, but it's time to get the hang of the idea that the bat should go towards the ball. Now, after 300 games, it's about as good as any human can play this and we must gets the ball back. Every time we thought, well, that's pretty cool, but we left the system playing for another 200 games and it did this amazing thing. They found the optimal strategy was to dig a tunnel round the side and put the ball around the back of the wall. The researchers working on it's amazing AI developers, but they're not so good at breakout and they didn't know about that strategy. So they learned something from their own system, which is, you know, pretty funny and quite instructive, I think, about the potential for general AI. So for us, what's the next step now? Go is the most complex game pretty much ever devised by man. Beating a professional player at go is a long-standing grand challenge of AI research. [music]. [applause]. [music]. [music].
Wow, I'm on the trail. I'm go Papa. She no player. I'm also European champion. Allah moving of it physically possible to that element. I like the positive chip a little bit closer shop. All our own shitty Hulk on the fellas are licked. Why it requires a shock to rock. I brought in China when I was 18. I won't change my life. This is why I go to fraction. I won't try to forget the goal, but it's impossible, because all the thing I learned in my life with his visco it's: look like Mira Isis go. I also seen myself, for Miko is a real life. [music]. Dear mr Pham, my name is demis hassabis. I run an artificial intelligence company based in London called deep mind. As the strongest go player in Europe, we would like to invite you to our offices in London, both to meet you in person and to share with you an exciting go project that we are working on. If you would be interesting coming to visit us, please let us know. Many thanks, kind regards, demos. When I see this email I don't know it's true or not. Well, I accept about this. Why not, Thomas? Are I receive a venture? I want to go to visit him and to know what is this Koch project?
[music] the first visit, I think. Maybe I want me sit in the special room, push many-many, where my hand, also my body, let me play, to scan my spring, I don't know- to make some research. We needed to get found way too deep mind to see we were a serious operation and we were serious people doing proper research. And the search time is getting better and better as we go from, for example, 1 to 8 and any one of these it always go, it goes up. We think of deepmind as kind of like an Apollo program effort for AI. I mission is to fundamentally understand intelligence and we created artificially and then, once we've done that, we feel that we can use that technology to help society solve all sorts of other problems.
If you said, from the actual game we can see kind of illogical things. What's the most likely variation that it things will happen? We've been working on alphago now program to play go- for just under two years now. All the little patterns cascade together, layer after layer after layer after layer. I started talking about the game of go with Denis more than 20 years ago and so this has been a really long journey. The game of go is the holy grail of artificial intelligence. For many years. People have looked at this game and they've thought: well, this is just too hard. Everything we've ever tried in AI, it just falls over when you try the game of go, and so that's why it feels like a real litmus test of progress. If we can crack go, we know we've done something special. So with family, we started talking around what the real purpose of the visit was. It wasn't just a go project. We wanted him to help with that. Actually, we wanted to play him and we had a very strong program. That's okay. Just the program is so easy. A lot of people have thought that it was decades away. Some people thought it would be never because they felt that to succeeded go you needed human intuition. Go is the world's oldest continuously played board game and in some sense is one of the simplest and also most abstract. There's only one type of piece. There's only one type of move. You just place that piece on the board and then your goal is to create a linked group of your stones that surrounds some empty territory, and when you surround enemy stones, you capture them and remove them from the board. You earn points by surrounding territory and at the end of the game the person with the most territory wins. It seems really simple, but then you sit down to play and you realize right away it's like: well, I technically know what I'm allowed to do, but I have no clue what I should do. It, guy, is incredibly challenging for computers to tackle because compared to, say, chess, the number of possible moves in a position is much larger. In chess it's about 20 and go it's about 200, and a number of possible configurations of the board is more than the number of atoms in the universe. So even if you took all the computers in the world and ran them for a million years, that wouldn't be enough compute power to calculate all the possible variations. If you ask a great go player why they play the particular move, sometimes they'll just tell you it felt right. So we have to come up with some kind of clever algorithm to mimic what people do with their intuition. So we found away, we agreed a best-of-five match and we agreed would be filmed. You know we would treat as a serious match. I play with alphago idea. Wong pushed stone for alphago and of course I think I will win. The game is Africa, because it's just a program. [music]. The first: again I make some mistake and I lose the game. Didn't that first match? I think something clicked for him that this wasn't an ordinary go program, we weren't just doing the the same as everyone else, that something new was happening. The second game: I tried change my scale, but does. The problem is also I lose a second game and also for a third game, first game, even the last game, I lose five zero. Allah forego win all the game. After losing, losing, losing. You can feel his pressure is getting heavier and heavier and several times after the game he said he wanted to go out for fresh air. I said, oh, I can go with you and have a chat. He said, no, I want to go myself. I feel something very change. I lose with program and I don't understand myself anymore. I worried whether he'll even come back. You know he seemed very low and he spent about an hour away from the office. He came back completely changed. I thought, Maddie, this is the first time in the history, the human portion of go player blues with the program. She tell me: yes, we know, but for your Israel to I? Okay. I told her not and yes, I am not happy to lose again, but- and we will be happy for play in the story- artificial intelligence researchers has solved the game of go.
A decade earlier than expected, the computer named alphago was able to beat the European human champion. Artificial intelligence researchers have made a significant breakthrough. It really is a big leap forward. It was a big difference between the way the IBM computer beat Kasparov, which was programmed by expert chess players, and the way the köppen computer more or less learned itself.
The way we start off training alphago is by showing it a hundred thousand games that strong amateurs are played, that we've downloaded from the internet, and we first initially get alphago to mimic the human player and then, through self playing, reinforcement learning.
It plays against different versions of itself many millions of times and learns from its errors. These specific ideas that are driving alphago are gonna drive our, our future. The technologies at the heart of alphago- they're what are called deep neural networks, which essentially mimic the well of neurons in the human brain. It's a very old idea, but recently, due to increases in computing power, these neural networks have become extremely powerful almost overnight. Big neural networks that operate on big data can achieve surprising things.
Alphago found a way to learn how to play go. Learning is the key thing here, it's machine learning. The whole beauty of these types of algorithms is that because they're learning for themselves, they can go beyond what we as the programmers know how to do and allow us to make new breakthroughs in areas of science- medicines. So alphago is one significant step towards that ultimate goal. [music]. My wife called me. She told me: don't see internet, don't connect internet because people talk terrible thing about you.
Match with alphago. Funny way it's living so long time in Europe. It's not real professional, it just amateur player. This is so hard for me, so hard. The go world were skeptical about how strong really was alphago and how much further did it need to get to be the top professionals. So our program is improving over time and we want to push the AI algorithm to the limit and see how far is kind of self improving process can go. So we needed to look for an even greater challenge. Much like no other is about to get underway in South Korea. Lee sedol belonged reigning global. This guy is a genius. Will take on artificial intelligence program alphago and the ultimate human versus machine smackdown. This is a huge moment for both the world of artificial intelligence and, i think, the world of go. So far, alphago has beaten every challenge we've given it, but we won't know his true strength until we play somebody who is at the top of the world, like Lisa doll. We chose Lisa doll because you wanted a legendary, historic player, somebody who has been acknowledged as the greatest player of the last decade human Kingdom corridor artisan greatest, i gotta say.
I think, kappa, i will not be too arrogant, but i don't think that it will be a very close match. Level of the play that Africa went against in October is not the same level as me. So, given that a couple of months was only passed, I don't think that it is enough for it to be able to catch up with me. I hope is that it would be either 5-0 for me or maybe 4 to 1. So the critical point for me is to make sure I do not lose one. We don't know how well our system will play against someone as creative as Lisa Norton. Also, he's very famous for very creative play. Yeah, so this could be difficult for us, but we all see maybe in some ways he's the most difficult opponent- we. There was still so much of a question about whether or not they could be. Someone like Lisa doe fun way is a good player, but he's nothing like the very top players. He said: all is a nine down professional kind. Unprofessional is the highest rank that you can achieve and go the ranking system- fine, wait, who is the European champion is just a - Don professional. On the other hand, at the very top, he said: all is nine Don professional. Least at all is to go. What Roger Federer is - tennis. He's playing in Wimbledon to win the Grand Slam and it's not just this year. He'll be there next year and the year after that and the year after that. Of course, internet and all the coke community, everyone, maybe not about 100 percent, maybe 99.99%- sink listener. We win very easily. [music]: go, look it up tomorrow. Okay, pick it up. Go is taken seriously in Korea. It's so much part of the culture, like breathing or, you know, like taking swimming lessons or something. On the surface is a game, but inside had a very deep philosophy. Go board reflects the individual who's playing. The true gonna show itself on the board. You won't be able to hide it. In ancient China, Japan, Korea, go is one of the four noble things, like for accomplishment, for literati with music, poetry and painting.
So people think the goal players are very smart and very noble. Master Kwan started to disco so that he could produce great prayer in Korea, he said. Or when he was age of eight he came in here attending class 9:00 am to 9:00 pm, seven days and then he stayed with a master con all Rudy, are you hungry? Nagano, mu, gamma, Co the case homies who want one on Iran, J mmm Takeo Genghis, I'll renounce. Indonesian Aaron wasn't protein, even a driver on target. It has a larger picture. He said: all was a little boy that I remember when I was a student studying go. He was very young and rural enough to think that pizza grew on trees. Keisha, Oriole, 3900, really keen. And Jamie, a great queer. Caillou, Ronan, mm-hm, the poor, abandoned. Ah, a rotten person. Jump at him. But to jockey my name from longer, do you think our cousin would take them Wonka? He said: all plays things that are interesting where you felt like he's beyond winning and losing. He wants to do something that's innovative or takes things to the next level. So every go player, study his game for sure. Roughly ten years he dominates the professional world in wing. 18 world championships. He'd been union born now alkmaar. Concurrent ginger in there signaling Aikido the Ranjha manioc, amethyst, a Joe, definitely. Litter is gonna win the game. Five, oh yeah, or game, he's gonna win all game. We had our evaluation match last week. We won a game and we lost a game, and we lost a game in a way that would have made us look extremely foolish if that happened publicly.
It means that we still have work to do and we need to take this really seriously. There's just too much risk that actually we could. We could lose overall. Not only that, but we could lose in a way that makes us look rather silly. So I guess, Sam, yeah, did you want to say anything about what you're trying? [music]. We're working around the clock at the moment, training our algorithms further, trying to incrementally keep on improving right up to the moment where we have the match. We've collected together people with different skill sets onto the same team, so we have researchers, engineers, valuation guys. But you mean what happens? Actor is the lead program around, built the original search engine. So, hydras, responsibility is quite a big one. He will be the one sitting opposite Lisa doll and actually playing the moves alphago makes. I'm feeling you.
Thank you, yeah, at least I know he's a great player and I feel honored to play with him. Many of my friends- they are very excited about the match. They keep telling me that the full world is watching just prepare. Oh my god, yes, I can hear you guys. Can you hear me? Okay, thank you, thank you. So. Likewise, it's a real pleasure to meet you. I love the game of Go. I'm not very good, but I don't know if you know, but we actually have something in common. I actually also trained at a game at a young age. I used to be, when I was young, professional chess player. I used to play for the England team and then I stopped playing. When I was about 14, I was when I was 13. I was the second highest rated player in the world. That sounds very good. I would be very honored to to do that. It's okay to ask you this question, but I saw the games against fun three and and I didn't think it was quite a good lover to play with me. But I heard that it's getting really stronger. Can I ask how much? Yeah, IIIi can't say too much, of course, but it's definitely got significantly stronger with more time. I think a logical approach would be to follow up on it. That's just local. So generate holidays exactly and iterate more time. We realized that if we wanted to prepare for a mammoth task like taking on Lisa doll, there would be nothing better than talking to a professional, and we couldn't have picked a better person than fine way. We invite him as a visor because during the match we found he is a man of good spirit, he's very precious and that we have fun with us. He was crushed by a vago, but then he became very positive and a big help to us. What damage? Tell me, can you come back to help us make Africa more stronger? I feel this respect. Of course I accept about this.
I play with alphago to understand where it's a strong point about alphago and will is maybe the weakness. I plays morning afternoon all the hand and I found something I felt big weakness about alphago. The big one, the super, has always have a hidden vulnerability right, and the same is true of alphago. It's unbelievably super human in general, but it has some particular weaknesses. In some situations we can think of there being this space of all the things it knows about- and it knows about most of it extremely well- but then there'll be these tricky lumps of knowledge that it just understands very poorly and it's really hard for us to characterize when it's gonna enter into one of these lumps. But if it does, it can be completely delusional, thinking that it's alive on one part of the board when in fact it's dead, or vice versa. So there is a real risk that we can lose the match. Everybody, either team, try to walk more and more to fix the problem, but I think it's difficult to fix this very quickly. We've got version 18 in the pipeline anyway. Well, we'll only if it makes it significant, if it is nice which we're having to rerun all the tests because they they went bomb, unfortunately. So we sought to burn a severe day behind in our evacuation because of that. Well, maybe we just need to be realistic, that we've tried a bunch of things and we've come to the point where we said we would actually start freezing the code and I'm saying that, kiss, no, I'm actually not piling out. These delusions are still a realistic possibility for the match. We have some weaknesses that we I don't think we're going to fix fully before the match, so that's causing us a little bit of anxiety. Lee SEDOL is getting ready to rumble on Wednesday. Live across the Internet. This professional South Korean go player will take on artificial intelligence program. Alphago has. We've got all hit go Squealer tomorrow, Julian and George, they pack up version 18, they stick it on a laptop and they fly out to Seoul. And you always [Music]. Everything was a Bigfoot, everything is yes, I think. But I won't come on when I get to the hotel gonna catch all with the teeth. What we should do in the time remaining is list things that could go wrong in the solidity of the system.
How do you arrange the face for reason to stop in a difficult situation? He likes to smoke. Yes, there is a terrace. I'm gonna have security so he'll be able to go up there. Be by himself. What do you order? But I got here I didn't expect the attention on the match. It was literally front-page news. About 8 million Koreans play the game of go and even those who don't, you know, recognize lee sedol is. He's a national figure and so there's that right. There's some national and pride involved, but it's more than that. They're just the very thought of a machine playing as human, and something like this, I think, is inherently intriguing to people. [music]. Learn something now, Roxy. I see couldn't in Dynasty again. I don't conduct to do it. Come to England evening, eat organic agriculture. Neither Kingdom he saw take a coke. Inga Negron called sheikh ali a filter of children targets. All the war gave the pressure to listener. Before this he plays the dormant for country for himself, but this time he played was human. I just really hope we win this first game. If you lose the first game you literally have to win three out of four. Yeah, which is hard work. Yeah, where you gonna be, I'll start in the market and then I'm gonna come in here, make sure everything say yeah, yeah, if I can be fine. Hello and welcome to the deep mind challenge game. One round, one live from the four seasons here in Seoul, Korea. I am Chris garlic of the American goat a journal. I'm here with Michael Redmond, nine Don, professional welcome, Michael. Want to give a shout out to all the folks watching around the world. Well, the excitement is pretty pumpable here in the hotel. I've never seen a crush of interest: two reporters from around the world overwhelming to get one in there. Okay, so go and tell su chi o. All right, folks, you're here, you're gonna see history made. Stay with us by those guys. Bye, I just thought we should take a moment together and just think about what's about to happen, extremely excited to be there, extremely proud of every one of you and what we've done. And we're no loss. I think it's just amazing that we're here. [music], [Music]. He takes the universal form when he walks value - an encapsulation iron. You talk to me, [Music], [Music], guru hadisha Guevara Mina, you say that, oh, they move around. We had worked so hard to make sure that this would go technically smoothly. We tested it and tested it and tested it, and still there comes that moment when you're live, all the TV cameras are broadcasting everything and now it has to do the thing you built it to do. How can they? Okay, so I. So it doesn't come in how great, but in your published you got a Bushman y'all just some sheet on a wall. In their own they're just rolling over. [music]. I was a bit nervous. It's the first time that I sit in front of a world-class coal player and I actually can feel the spirit and courtesy of a gray coal player. At least I go, because I think it is the first time he faced a strange opponent.
I think it's not a human, has no emotion, it's cold, but he stay very calm and I can feel his mental strength. [music]: oh, oh, oh, oh, that was so. You're the Raymond, is the John? Worry about you guys? All right, pal, ah, sometimes, no, no, well, all-time. Got you to love your new Kimmie boubier. I'm Andrew Jackson. With me here is Maryland Kim, $9.00 from the Korean. But the Association? We are here live at the Four Seasons Hotel on the 21st floor. What are we looking at? How's the game going? Always fighting? No, from the beginning, from the very beginning. Yeah, yeah, I forgot, plays very well. Yeah, that's not just like a top professional. Yeah, it's very aggressive. Oh good, on you. There you go. Oh my, now the fight is getting really complicated. This is actually the first time I've seen alphago playing a game that has this difficult fight. We salute Anya. You go. This week is done. I don't need. It was honest and go ahead. Hoxie, don't move on, sir. I'm a co-captain on there. Chucky, go push me about three upstairs: hunt and espalier.
I just saw him looking at his opponent's face, and that's. That's just a kind of a habit, just an instinct as a player, to look at their personal quest. Yes, it's. It's sort of like something that Lisa, though, would do when he was wondering how his opponent was feeling. Right, it's just just a habit. So it's not as if Raja Huang is gonna do any giveaway, cuz I found isn't alphago, I lost all you guys.
Yeah, she drew a walk enjoying God. Come on, it's Erica. Are you gay? Ye go, she go in jacket down to do one one day with human. When you play, you can have exchange by feeling and look in you. I know, okay, maybe you won't talk with me, maybe your fear about me. I can feel many, many thing, but, alphago, you can feel nothing, so will you can feel nothing. When you play, you have a more than more question about yourself. Before beginning, you think: okay, my movie is good and really good, really good. Oh, maybe bad, Oh, terrible. Why we're more than more how to know where to be? All the different rooms are like, exciting the different ways, quite nice to be here at the heart of the operation. Yeah, why is thinking of doing this huge invasion here from it's thick wall? Yes, go forever. It's stunning. It's gone in. That is not confident face. He's pretty. Yeah, I'd buy that. I can't believe what I see right now. I thought you know she's only bit behind and made a face, or guess you move here. Okay, make it very complicated, okay. I think if he doesn't know this unpack today then it can collapse in a dishonest and of unthinkable as a human.
What they are? What if she knows everything about what's going to happen? And that's the maxima number of moves ahead that alphago is looking from the current game position. It's typically over 50, it's over 60 and the games we see often we're a hundred million or fifteen now. So we are all astonished and just in the middle of the game, because alphago is seems to be doing a much better job than we all thought they do. I thought they said all would be leading the game comfortably, but it turned out that he's struggling at the moment. But I think eventually he will prevail. I hope I was, you know more, 5 to 0, but now I'm not sure I like em. Well, I'll publish this isn't much assessment on your illusions with on it there might be the first mistake, kind of clear mistake. Then white made original. They can off. The didn't under my. You gotta talk to me, Otto. Come. I pop one on you give mom. Come on, do whatever was. Please dance. I should be bunching gear, Catherine, and a target for everyone there. Crotch our crotch, the kitchen jacket and then go look like Uganda man. Yeah, you Tigers on a couple ubon. You guys come sad. I got a balloon. When he finds it. Yeah, Lana, it looks like you've got a count. Yeah, right, what do you think God? Yeah, yep, yeah, what one is active if it's like this wise? There's one by Allah. Yeah, because he gonna choose shimmy. [music]. Why so shocking? I expected afterward to win only one game. [laughter]. I can feel his pain, like he was, he couldn't believe, he couldn't accept it. It takes time for him to accept. The outcome may be ethical, is very strong now, but he don't want believe. Have you lose it, just cope of the player we took. We can't believe this because film for us is something very, very far. It's not can be coming now as impossible, but in reality it's now. I think he resigned a very polite way. These are the priests- black, but he blue eyes down. I think you resigned. Oh, my gosh, the other kind of stuff. Yeah, Wow, I feel really good.
I feel like I I really believe in alphago. Of course it's natural that humans want humans to win. I mean, I think that's a natural response, but alphago is human created and I think that's the ultimate sign of human ingenuity and cleverness. Everything that alphago does, it does because the human has either created the data that it learns from, created the learning algorithm that learns from that data, creates the search algorithm. All of these things have come from from humans. So really this is human endeavor. [music]. In the battle between man versus machine, a computer just came out. The victor, deep mind, put its computer program to the test against one of the brightest minds in the world and one alphago beat a professional player who has 18 go world championships under his belt. The victors considered a breakthrough in artificial intelligence and their dominance Chobani 7's. Well, we launched about an application.
We'll assume that's real. Come on, Lou, let go, son go. Bonnie, tickety-boo thinking I'm doing cool dude, sweet, I'm calm that. Check out money till you get the money. Google, atomic cooking under you gonna even got some job. Johnny cutting hakuna matata. My dream easy, what do? Burning? Nothing. The ramekin Shannon tell me: okay, program, European abandon to Guantanamo. A program out of it, come where. Oh, keeping from Joey simmer about sonography de in research we normally work to produce an academic paper. It gets published and maybe we get to talk about it in a conference, if we're lucky. This is not normal research. In fact, I've never experienced any media attention remotely close to this. So it's a special moment for us all and we're just enjoying it while it lasts. In a matchup between man and machine, who wins? So far it's the machine.
In Seoul, South Korea, the artificially intelligent computer defeated the global champion in the ancient Chinese board game, go Lisi dole lost the first matchup, but he's got four more chances. It is strange, being the front cover and everything as a computer scientist, normally you see there in the corner your codes. Nobody really knows about it. Perhaps heard the joke. How can you tell that a computer scientist is an extrovert and not an introvert? If he's an extrovert, he looks at your shoes when he's talking to you instead about his own. Like if you look at that job, he avoids all the cameras like crazy. He's like the game is finished and he's like out the back and back in his room. And I think a lot of computer scientists would be like that. We were more about doing our work than standing in the spotlight. Hello and welcome to game 2, round 2 in the google deepmind challenge: Throwdown between man and machine.
Game 1: the machine takes down man. Huge shock headlines around the world. Reactions on the ground. Hear from the folks in Korea. We're just stunned. They estimate 60 million people watch the game in China alone. It's probably bringing up to me eighty million people watch this game worldwide. It was just incredible and, if anything, today is probably even more of a bad housing. So he said on those today he knows that this is just a really important game. Right, he's gotta win. [music] - Tom, we're gonna Orton god-kings animals.
If we now know I do. Kim Jong Kook will autism Chalmers such ogawa sumie da he said all white, I think probably looking for a little little payback. My impression is that maybe he underestimated top ago and he's gonna change his tactics program. One, Katy Matata, okay, going in the colostomy da, not on to salute aluminartful working. Didn't keep students where you don't wanna see my man there. Go on, Dale. Well, if I say anything about alpha, God is not normal is maybe the way it handles a game when it thinks it is ahead. Yes, we're actually gonna have a visit from for one of the team and we'll talk about exactly that point from the inside. Thanks so much for coming by, Thor, I really appreciated. Can you sort of share a bit of what is going on in alphago.
So alphago has these three main components. There's the policy network, which was trained on high level games to imitate those players. And then we have a second component- we call this the value net, and it can evaluate the board position and say what is the probability of winning in this particular position. And the third component is the tree search, where it would look through different variations of the game and tried to figure out what will happen in the future. So if we now take a position like this, first policy network would scan the position and come up with what would be the interesting spots to play and it builds up a tree of variations and it then employs this value net that tells it how promising is the outcome of this particular variation. So alphago tries to maximize its probability of winning, but it doesn't care at all about the margin by which it wins. Okay, so when you see a slow can move, that's maybe an indication that alphago thinks it has a good chance to win. Yeah, that is a little giveaway again. Buddy crunching on a ps4 zombie. My trip in there from Vancouver ago when you need to get sigismund. Okay, sir, looks like. Looks like Lee is taking a little bit of a break. Lisa doll go to smoke and I'll forego just to play it. Don't sing about. The opening will be zero, not so. I sees, I forgot. Plays the move 37 and IJ pulls the song in the board. That's a very, that's a very surprising move. I thought it was a mistake. What I see this move for me is just as a big shock. What normally human- we never play this one because this bad are just bad. We do know why it's bad. It's a little high. Yeah, it's bit like normally.
So coming on top of the fourth limestone is really unusual. Yeah, that's an exciting rules i I think we've seen in the original booth here. That's the kind of move that you play. Go for a interesting stuff. If flying shoulder head is that I wasn't expecting that. I don't really know if it's a good or bad move at this point. The professional commentators almost unanimously said that not a single human player would have chosen move 37. So I actually had to poke around in alphago to see what alphago thought, and alphago actually agreed with that assessment. Alphago said there was a one in 10,000 probability that moved 37 would have been played by a human player, so it knew that this was an extremely unlikely move. It went beyond his human guide and it came up with something new and and creative and different. I am very much watching the game through these commentators. That's the way it works. So when they're confused, I'm certainly confused. At the same time, I'm latching on to the fact that they are confused, right that is.
That is an interesting moment. When everyone else is confused, who's not confused, right? Besides the machine, I've also see Lisa doll. When they see this move, he's badly as bad. My opponent didn't wanna lose, okay, son Rocco. Yeah, you agree on current. Oh, she never got over sang cognizant and a cursory punah. Suniye and Ivana souvenir publish on yoga. Oh, tomorrow, doc, ooh, mmm ha, to gain our entire channel. Okay, normally have sing about 1/2 minute, no more, but this time he synched more than terminus. The more I see this move, I feel something changed. Maybe for human, we see, is bad, but for a Virgo, why not go? Is like geopolitics, like something small that happens here can have a ripple effect your hours down down the road in a different part of the board. The game kind of turned on its axis at that moment. This move is very special because with this move, all the stomp played before is walk together, it's connect, it look like a network link era where it's very special, very special. Time wasn't given to maintain: don't get Koko's printed on your nose and their two kisses changhie. Some don't achieve washing, you don't do, I think. And onion, green onion. This is a tough game for a resettle. Alphago is just not letting. Lisa will do what he wants. Right, almost 60 points or not. That's not a good sign, boss. He said. I'll just slapped herself on the side of the head. Oh, I think packs ahead at this point. It's looking good and it will not. Steady, young, steady path. Now I just seen Lisa del. He lose so much. Normally we resent before, long time ago. He won't try, they play, he play, he play it just don't want reason. [music]. [music] because then white, oh, he resigned. It looks like Lisa doll was just resigned. There was this heavy sadness over that whole floor and you could feel it during the game. I felt during the game- and I'm leaving the commentary room to go to the press conference- and I was stopped by someone at another technology reporter, and now at first all I would talk about was the technology and how great this was, but then even he kind of slipped into this moment of melancholy where he was upset as well.
I am quite speechless. I admit that it was a very clear loss on my part from the very beginning of the game. That was not a moment in time that I felt that I was leading the game. You feel elated and you feel a little bit scared. There is something I think frightening to people about a machine that learns on its own. For us, alphago is obviously just some computer program, but looking at the commentary on the Internet, I already saw the commentators call alphago- like he and she during the games- completely unconsciously- which. Alphago is really a very, very simple program. It's not anywhere close to full AI and we already see that happening. So I found that very interesting. The tendency to anthropomorphize AI systems is one of the big obstacles in the way of actually trying to understand how AI might impact the world in the future. For example, the conversation is about what could go wrong, like what the risks are. Then invariably you see this Terminator picture every single time. There are these red glowing eyes. Right, we're really closer to a smart wash machine than terminator. If you look at today's a I, we are really very nascent. I'm extremely excited and passionate about a eyes potential, but AI is still very limited in its power.
I think that people are right to think that there is a danger that, as we continue to improve these systems, that we might miss that, that threshold where where we do cross over into danger. But the good news is, if there are already people thinking about those dangers- you know there's a lot of talk now and we're leading the discussions on this- that maybe there should be a kind of cross industry best practices working group or something where the leaders or the research teams in those organizations that you know, the big ones that are working on a IBM Microsoft sword- come together and make sure that a I've used ethically and responsibly. I think what is important is that there is this community of people who are leading the cutting edge of AI, who are interacting and academics and already are thinking about the long term and how we can ensure that innovation is responsible as the power of these machines gets even greater. This is it, folks. Day 3, game 3: lease it all. Go master, back to the wall. He's down to 0. He's got to win today to keep hope alive. Nico, yeah, hard on the chickadees Sunday to know who bakes at the river already. Dr ponte de bak Chi, GI ha, young guru tattwa Hamid- ah, I heard that for pros. Yeah, when to visit him, mmm, to console him into a review, Africa consoled him. Do you think he's upset, or I mean mmm? Yeah, in the beginning there was a fearful fight and the ama go play very well. So he secured a very early lead from mu 50. The win rate was very high already and was climbing toward 100%. Ohh, what's your memories, commit? I didn't go to kill one really nice Marco Pantani with the gauge. Oh, gives me. They try to fight directly in the game, but it's not him.
Still, when we change our style to play with opener, normally it's very, very bad. So it's the game more easy, for alphago is huge and it's called Naruto and just going to be running around. I don't know how to describe the situation. If I were black, our resign. We should admit that we are facing the strongest existence ever, ever in the NGO history. There's no point playing at the end game and you know you never lose right. So even if black and live here, Oh, he'd resigned on. Ok, Wow, Wow, you saw history made here tonight.
Alphabets won again. Three straight wins, three straight wins. Has won the match. When Lisa is on the game he look like a happy. It's not just he loses the torment, it just especially about this game because he don't play his game and very heart about this, very. But I can do nothing. You know, certainly I'm feel a bit ambivalent about it, given I'm a games player and you know go is the pinnacle of board games.
But I really like the statement one of the top Chinese professional said of you know, if alphago wins, maybe we will really start to get to see what this games about. I couldn't celebrate. It was fantastic that we'd won, but there was such a big part of me that saw this man trying so hard and being so disappointed. I see internet. Many, many people talk about the digital. Maybe I don't play the best. You know we are copra here. Okay, sometimes change in current Japan. We see go or like are. We are artists. You know we play our best for Co. So Christian hallway solicitor, he's very, very good players, great players. I am in the room I sit is there. He won't win. They try everything. They just we can't just. Is it done on? The icinga starts almost up. They only not for months. There are some key their money. I just got a little kitchen - well, you don't catch on. Mm-hmm. Simon, you can do. Dahm, dahm, a 15-7 of tango opportunity, though she could already be on again.
And Jaden yogi kedaranatha. Cousin Peter stone Kron, how onion, and it doesn't a guy. That's on Sunday, I'm gonna do. Oh, what a legendary cousin. Tamale joins me talkin. Crazy women do harm to the children. Who knows who shot integrity? You know he said antigone and engaging. And Qatar, hakuna Qatar. Are you in there? A chromatic river PO. So mark cui Jian sits alone and Undertaker on again. Old man opposite Scirocco hinden, they are in G. So no, Tomasi, Dominic with Smita, it just Haku. Oh, cookie item demise meat. Are tamo? Who did I going then eat a tollbooth on town? Oh, who's in? Damn young again. You see, thousand Canada [Music]. You can see that he was more relaxed after he had lost three games in a row. That said, the stakes were still high. You know, in the end it isn't about pride. Hey, don't feel like confidence, but if you liked can lease it all. Find alphago's weakness. Is there in fact a weakness? I was thinking I just pulled a plug, they just pulled a plan out. Everyone's still cheering for Lisa do it and then, yeah, it's not going very well. Now consider me, I'm dumb dildo, as you can see. Then I hadn't forgotten you, Dan, John Doe, who sit there on each other with annually Antigua, the eudeco, gotta tell ya go back together. Oh, it feels pretty good for four black at this point. It feels different for black. Yeah, I won't Lisa play his game because for the moment, hey, try many, many things to play with Africa. To understand alphago that he never tried to play himself, I told men, meet an alphago, look like the real mirror. When you play with alphago, you feel very change. Look like you and all the time naked. The first time you see this you want to see because, oh, it's me, Rumi, and more the more you need accept: oh, it's real me, so how know how I can do? It's developing into a very, very dangerous fight. This is really lisanova, the type of game he likes, this kind of fight. White has to find something inside blacks turtle. I think he is already planning on trying something. So you believe in either those ability to live in the very small area, right, yes, yes, there's a little potential there and I think maybe he's gonna try to do something. He said all magic, what would be the magic move? Lee said, oh, he's running short on time, but he's gonna have to use that Paulist time. Is Jesus burned like seven or eight minutes just on this move already I don't see anything. We can't find anything for real. I was jumpin Nikolai, what is lease it all up to here? Yeah, he's really concentrating. It really is. Look at the pen. This is very patient. He wait, he wait away. This moment I feel something. Look like the wolf. Wait is a forest in the winter, a cold if you, very, very cold. But I need patience. But the moment coming, they go out to attack. This is the edge of the game. Oh, look at that move. That's an exciting whoa. It's gonna change the equation because now black cannot escape. That would be so cool if that works. Hmm, alphago has just played something maybe unusual. You know, I'm not actually sure what alphago is trying to do here. What's that about?
You don't really understand it. The shop is dropping. Wow, this could be that it actually can't find a way through. I think this is a little far enough ahead to see that it doesn't work. And now maybe it's on tilt, I don't know, does anything strange happen in there?
We can definitely say, well, there's weakness. We definitely need a mistake if I felt this mixture of a sinking feeling in my stomach where I was wondering if alphago was becoming delusional in this situation, where I could see that it was starting to play strangely, and at the same time, relief that lee sedol that he was actually in with the chance- now that is like fine, not to look horrified. I knew after move seven here, after like 10 or 20 moves, I saw a bubble, strange moves and I know I'll go over- somehow became crazy, but I didn't realize why. Yeah, I think it's like I searched so deeply aside. I do get them person that alphago is sort of gone off on a tangent. What are you doing? My family, no, it doesn't even think you. How does it? So? It knows it's made him just okhla starts its tots evaluating is the other way Lisa and Confused, like what is he doing? That's not. I'm scared, confused. That's a. What is it doing? Why is it going on? Hyou, know, you asked if it was a bug. I i've said before that if, if ya figured out how to write code that doesn't have bugs, that is a bigger news story than alphago. Are you kidding? Mm-hmm like this, literally, this makes me we're gonna play i think. I think they're gonna laugh, please gonna laugh. Oh, like that's the understatement of the year. Is it love? Okay, no, that's the move mahjong makes: no miss, clicks, use. It all is very confused. These are not human moves. This move also sort of inexplicable. I mean those you can. You can clearly call those mistakes. Yes, of course this is the first time in the in the four matches that we've seen moves like that. Right, hello, you talk to even more.
We're like 45% whites and white lightning. I was so confident that this black Moyer would just be consolidated by black that there's nothing there and somehow he's just erased it all like it's gone. So he's found his weakness that that wedge move probably surprised it. There it, yeah, yeah, alphago seemed to have such a good game and then all this whole sequence in the center sort of changed that he pulls off a miracle. He managed to make it so complicated that the artificial intelligence doesn't evaluate it. I think it looks like a. Jeff Wong may be sitting there- also knows that the game is over my head. Ii did this. My know, I haven't seen him smile yet. Yes, he's associated. He wants to be careful because a lot t really does his best. I think he something like you know he's possibility of order. The next applicant looks like alphago is resigned. The most amazing game- I'm almost gonna tear up was it was was Game four, where he comes back and wins. [applause]. Well, Pepe, finger around. Oh, hello, realtor and liquid running them. Hey, human, yuen-han, when you look in being an Indian cigar humidor, some, well, as you can see, counted in contango. Susi. Oh, Jenna, providing so much intricate smelling great. Oh, you are panicking before. Ah, son kanata, you go through some kanata. I heard from so many people saying: you know they were running out in the street. They were so happy, you know they were chanting. They're celebrating, especially after dearest reading. At the time it seems to be hopeless that the end of Aurora is coming, but we see the light. Usually I'm happy when I will not like my colleague wins, but this time it felt like my win because Chicago. [music], [Music] [Applause], [Applause]. Well, Charlie, he's doing this, but so much of this are you gonna need? Okay, cut it out along with the terminal. Okay, spin around it, but you donít want my car back through. Maybe some men currently singing Inga. My question is about number seven. Seventy eight move. Chinese taco layer.
Cooley said it was a cosplay. What were you thinking when you made that right, thank you. Well, go through to Noonan cuz of when your pasta mean octagon marathon, Terran human, i'm dok2 done, I'm so young and they're bitching turnabout. I don't know, you don't know. Moti gonna go down there does leave me a little bit in. Or of the human brains power and particular leaves, amazing ability to cause alphago problems and find something, seemingly out nothing. And so we really want to understand what happened. That means it wasn't magic, otherwise it would have had the right responses. Would we have played it? What does it give it his way? Om, 0, 7 percent of our is that in the position that he played. That's when he said the God meal was literally a God move. We believe that only 1 in 10,000- yeah, humans would have found that best friend doesn't come to mind- is the top 5 in the top 5 moves, unless at least they don't. He said it was being hard and he thought it was. Yeah, welcome back to the four seasons world champion Lisa Dahl went looking for alphago's weakness in Game four and he found it today, last round. He's looking to see if he can repeat that. We'll see what happens. The place is a madhouse downstairs. Maybe as many, if not more, journalists here today. Then there were for Game one.
We were really excited for the fifth match to see what would happen. Was this gonna be a 3-2 thing or is it gonna be a for one thing? And you know there's a different message with both of those for me. I don't sing. Arthur girl will make the mistake again. But who know, maybe will call me and the little have now have more confidence about this. Look like maybe listeners find the key to open the iPhone. Oh, good about, I'd probably check out at that. Oh sweet, a good you costing them. You weren't crazy about the timing on this move. Yeah, yeah. And now you don't approve of this? Yeah, I am. I'm sort of thinking that maybe alphago hasn't recovered from game. For hey, play some move is bettin. I feel something. Oh, maybe as victories come back again or something what's. I think it could be a kind of a Miss reading and where you're pretty comfortable saying that there's no reason for white to be playing that move. It's a bad move and in some cases that's going to lose a point to the whole game. We thought that alphago was wrong about the board position and we were super worried that I was gonna play. Garbage is going to be like lose in a very embarrassing way, and this continues for the whole game. Does it turn out? None of us know go well enough to accurately judge, for the alphago is doing the lies. We know this one looks like white is winning.
You all say some of our moves are so weird and strange and baby mistakes, but after a game is finished we have to doubt ourselves our judgment. Alphago making another kind of nonsensical throw-in. We're not really sure what that's about. This is what 10 or maybe 11 play looks like. It looks weird and we don't quite understand it. I think it is important too, study more about IPOs, mistake like moves, and maybe we can adjust our knowledge about go. To me, the most amazing thing to come out of my understanding of go as a result of watching alphago play are the, the infamous slack moves. Well, there's something strange about the way it's playing as it's playing some moves that are not really necessary.
Right, a slack move is a move that looks lazy. You can see these other, better moves and alphago is rejecting them, but what I think alphago is teaching us is that we've been using score as a proxy for chance of winning. So the bigger my margin of territory, the more confident I am that I'm gonna win, and alphago saying no, no, no, it shouldn't matter how much you win by, you only need to win by a single point. Why should I be seizing all this extra territory when I don't need it? The lessons that alphago is teaching us are going to influence how go is played for the next thousand years. I might contain this game. How, by how much are we talking? Two point, one and a half points. Of course go is just a game, but we could learn important lessons from our computer. He says excessive. Let's go. Machines will have the capability not only to crunch through huge amount of data, but also to analyze it intelligently. Just as in the case of the go games, the machine made moves that surprised even the experts, and eventually the machines will gain our confidence because we will see that very, very often they make a better guest and we could have made as humans.
[music] keyboard. You got it, so they contain your long German. You guys underwritten how to give us some time to tell Google only Chinese Janice, okay. - arya-aa- unfortunately for Lee- said: oh, I think white might have a slight advantage here- has called it for alphago. We'll just like to know, okay, no, they're not one thing. It's gonna resign. [laughter], [Music], [Music] [Applause]. Manling is just, really is once-in-a-lifetime thing I would say. Is, though it's the most amazing thing, yeah, I've experienced. You know, for us it's the combination of 20-year dream. It started as a pure research endeavor. We just wanted to understand: can your networks play the game of go? And from there it went on to a level that I never expected, and I'm unbelievably proud of the team. When I started doing artificial intelligence, it was four or five years ago, and I was really interested in that, but, like many people would discourage me when they would say, okay, there is no future. So actually seeing that within five years, we are at this stage right now, it's amazing by itself. There are so many possible application domains where creativity in a different dimension to what humans could do could be immensely valuable to us, and I just love to have more of those moments where we look back and say, yeah, that was just like me. 37: something beautiful occurred there, at least in a broad sense. Move 37 began. Move 78 began a new attitude, at least Sedo, a new way of seeing the game. He improved through this machine. His humaneness was expanded after playing this inanimate creation and the hope is that that machine, and in particular technologies behind it, could have the same effect with all of us. I remember hearing a talk by Kasparov who says that a good human plus a machine is the best combination. This is unique, its Prince. Nobody can have this occurrence. Play with alpha golf a game like this. So I help listener can find something in this 5 game. Maybe some change in his game I see today he fight, fight, fight. It's very good. Big master, real big mosque. Keep on. Joe Thomas, Jonathan, Scott, Alexander- a technical term needs high decibel. The proto Python and C true callostonight, the hepatic to noon, usually that taranaki pharyngeal. Okay, heosu, take her on the King to mentor now. But Yong Yong hak, determine, chanting, cruising Gandhi, symmetrical catenin. Tommy Kroenke, obviously is this able Stan. But for all the story, maybe it's just a begin with low [Music], it's just one I play with alphago. He showed me something I feel beautiful jazz it- I see the word different before Harrison began. What is real? Sing inside the cocaine with this thing. I will change something with my game. Maybe he just can show humans something we never discovered. Maybe is beautiful [Music]. [music]. [music] you [Music].