AlphaGo - The Movie | Full award-winning documentary

[heartbeat thumping] [stones rattling] [stones clacking] [tense music] [stones rattling] [Frank] It's intensely contemplative. It is almost hypnotic. [rattling] It's like putting your hand on the third rail of the universe. If you play Go seriously, there is a chance that you will get exposed to this experience that... is kind of like nothing else on the planet. Show more

Show less

00:55

[Frank] Go is putting you in a place where you're always at the very farthest reaches of your capacity. There's a reason that people have been playing Go for thousands and thousands of years, right? It's not just that they want to understand Go. They want to understand what understanding is. And maybe that is truly what it means to be human. [Demis] When I was a kid, I loved playing games. I started off with board games like chess. And then I bought my first computer when I was eight with winnings from a chess tournament. Show more

Show less

01:40

Ever since then, I felt that computers were this sort of magical device that could extend the power of your mind. Virtual environments and games, we think they're the perfect platform for developing and testing AI algorithms. Games are very convenient, in that a lot of them have scores, so it's very easy to measure incremental progress. So I'm going to show you a few videos of the agent system, the AI. So let's start off with Breakout. So here you control the bat and ball, and you're trying to break through this rainbow-colored wall. The agent system has to learn everything for itself, just from the raw pixels. It doesn't know what it's controlling. It doesn't even know what the object of the game is. Now, at the beginning, after 100 games, Show more

Show less

02:25

you can see the agent is not very good. It's missing the ball most of the time. But it's starting to get the hang of the idea that the bat should go towards the ball. [game beeping] Now, after 300 games, it's about as good as any human can play this, and pretty much gets the ball back every time. We thought, "Well, that's pretty cool." But we left the system playing for another 200 games, Show more

Show less

02:44

and it did this amazing thing. It found the optimal strategy was to dig a tunnel around the side, [audience laughing] and put the ball round the back of the wall. [beeping] The researchers working on this, the amazing AI developers, well, they're not so good at Breakout, and they didn't know about that strategy. So, they learned something from their own system, which is, uh, you know, pretty funny and quite instructive, I think, about the potential for general AI. Show more

Show less

03:05

So, for us, what's the next step now? Go is the most complex game, pretty much, ever devised by man. Beating a professional player at Go is a long-standing, grand challenge of AI research. [inspiring music] [church bells ringing] [man yelling in French] [church bells clanging] Show more

Show less

03:37

Wow. [in French] You really want to kill me, eh? No, I don't want to, but I'm trying to survive. Yes, that's it. That's it. [in English] [Fan] I am Go professional player. I am also European Champion. [in French] With that move, you're going to lose for sure. [chuckles] You were happy to defeat me but then you panicked. You're afraid that victory will escape you. In general, when you're afraid, victory always escapes you. [in English] [Fan] I'm born in China. When I was 18, I wanted to change my life. This is why I go to France. I want to try to forget Go. But it's impossible. Because all the things I learned in my life is with Go. It looks like a mirror. I see Go, I also see myself. For me, Go is real life. [bicycle bell ringing] [Demis] Dear Mr. Fan, My name is Demis Hassabis. I run an artificial intelligence company based in London called DeepMind. As the strongest Go player in Europe, we would like to invite you to our offices in London, both to meet you in person and to share with you an exciting Go project that we are working on. If you would be interested in coming to visit us, please let us know. Many thanks. Kind regards, Demis. [Fan] When I see this e-mail, I don't know if it's true or not. I will accept about this. Why not? For me, everything's an adventure. I want to go visit DeepMind to know Show more

Show less

05:25

what is this Go project. The first visit, I think maybe they want me sit in the special room, push many, many wires in my head and also my body, let me play to scan my brain. I don't know, [chuckles] to make some research. [Demis] We needed to get Fan Hui to DeepMind to see we were a serious operation, and we were serious people... doing proper research. [indistinct chatter] [David] And the search time is getting better and better as we go from, for example, one to eight, in any one of these, it always goes up. [Demis] We think of DeepMind as... kind of like an Apollo program effort for AI. Our mission is to fundamentally understand intelligence, Show more

Show less

06:14

and recreate it artificially. And then, once we've done that, we feel that we can use that technology to help society solve all sorts of other problems. [Julian] If you step through the actual game, we can see, kind of, how AlphaGo thinks, what's the most likely variation that it thinks will happen. [Demis] We've been working on AlphaGo, our program to play Go, for just under two years now. All the little patterns cascade together, layer after layer, after layer, after layer. [indistinct chatter] I started talking about the game of Go with Demis more than 20 years ago. [David] And so, this has been a really long journey. The game of Go is the holy grail of artificial intelligence. For many years, people have looked at this game and they have thought, "Wow, this is just too hard." Everything we have ever tried in AI, it just falls over when you try the game of Go. And so that's why it feels like a real litmus test of progress. If we can crack Go, we know we've done something special. [keyboard clacking] [Demis] So with Fan Hui, we started talking around what the real purpose of the visit was. It wasn't just a Go project we wanted him to help with, that actually, we wanted to play him, and we had a very strong program. Oh, it's okay, just a program. It's so easy. [laughs] So, it will be easy to play. [Shane] A lot of people have thought that it was decades away. Some people thought it would be never. Because they felt that to succeed at Go, you needed human intuition. Go is the world's oldest continuously played board game. And, in some sense, it is one of the simplest and also most abstract. Show more

Show less

07:47

[Frank] There's only one type of piece. There's only one type of move. You just place that piece on the board. And then, your goal is to create a linked group of your stones that surrounds some empty territory. And when you surround enemy stones, you capture them, and remove them from the board. You earn points by surrounding territory. And, at the end of the game, the person with the most territory wins. It seems really simple. [chuckles] But, then you sit down to play, and you realize right away, it's like, "Well, I technically know what I'm allowed to do, but I have no clue what I should do." [Demis] Go is incredibly challenging for computers to tackle because compared to, say, chess, the number of possible moves in a position is much larger. In chess, it's about 20. In Go, it's about 200. And the number of possible configurations of the board is more than the number of atoms in the universe. So even if you took all the computers in the world, and ran them for a million years, Show more

Show less

08:44

that wouldn't be enough compute power to calculate all the possible variations. [Demis] If you ask a great Go player why they played a particular move, sometimes, they will just tell you it felt right. So, we have to come up with some kind of clever algorithm to mimic what people do with their intuition. -[Maddy] Nice to meet you. -[Fan] Oh, hello. Nice to meet you, too. [Demis] So with Fan Hui, we agreed a best-of-five match. And we agreed it would be filmed. You know, we would treat it as a serious match. [tense music] [Fan] I play with AlphaGo. Aja Huang push the stones for AlphaGo. And, of course, I think I will win the game with AlphaGo because it's just a program. [Fan] Good game. [Aja] Have a nice game. [tranquil music] [Fan] The first game, I make some mistake, and I lose the game. Oh. Strange. Very strange game. [David] In that first match, I think something clicked for him that this wasn't an ordinary Go program. We weren't just doing the same as everyone else, that something new was happening. [Fan] The second game, I tried to change my style. But the problem is, also, I lose the second game. And also for a third game, the fourth game, even the last game. I lose five-zero. [whining] AlphaGo wins all the games. After losing, losing, losing, you can feel his pressure is getting heavier and heavier. [Aja] And several times after the game, he said he wanted to go out for fresh air. [chuckles] I said, "Oh, I can go with you and have a chat." He said, "No, I want to go by myself." [Fan] I feel something very... strange. I lose with a program. And I don't understand myself anymore. [somber music] [Maddy] I worried whether he would even come back. [chuckles] You know, he seemed very low, and he spent about an hour away from the office. He came back completely changed. [Fan] I told Maddy, "This is the first time in the history the human professional Go player loses with a program. She told me, "Yes, we know. [chuckles] But for you... [stuttering] Are you okay?" I told her... "Not, and yes." I am not happy to lose the game, but I will be happy for play in the history. Artificial intelligence researchers have solved the game of Go a decade earlier than expected. [Errol] The computer named AlphaGo, Show more

Show less

11:31

was able to beat the European human champion. [male reporter #1] Artificial intelligence researchers have made a significant breakthrough. [Martin] It really is a big leap forward. There's a big difference between the way the IBM computer beat Kasparov, which was programmed by expert chess players, and the way the Go-playing computer, more or less, learned itself. Show more

Show less

11:51

The way we start off training AlphaGo is by showing it 100,000 games that strong amateurs have played, that we have downloaded from the internet. And we first initially get AlphaGo to mimic the human player. And then, through self-playing, reinforcement learning, it plays against different versions of itself many millions of times, and learns from its errors. The specific ideas that are driving AlphaGo are going to drive our future. [Cade] The technologies at the heart of AlphaGo, they are what are called deep neural networks which essentially mimic the web of neurons in the human brain. It's a very old idea. But recently, due to increases in computing power, these neural networks have become extremely powerful, Show more

Show less

12:33

almost overnight. Big neural networks that operate on big data can achieve surprising things. [John] AlphaGo found a way to learn how to play Go. Learning is the key thing here. It is a machine learning. [Demis] The whole beauty of these types of algorithms is that because they are learning for themselves, they can go beyond what we, as the programmers, know how to do, and allow us to make new breakthroughs in areas of science and medicine. So, AlphaGo is one significant step towards that ultimate goal. [uplifting music] [bicycle rattles] [Fan] My wife called me. She told me, "Don't see internet. Show more

Show less

13:17

Don't connect internet, because people talk terrible things about your match with AlphaGo." "Fan Hui is living so long time in Europe, he is not real professional, he's just an amateur player." This is so hard for me, so hard. [Demis] The Go world was skeptical about how strong really was AlphaGo, and how much further did it need to get to beat the top professionals. So our program is improving over time, and we want to push the AI algorithm to the limit, and see how far this kind of self-improving process can go. So, we needed to look for an even greater challenge. [camera shutters clicking] [female reporter #1] A match like no other is about to get underway in South Korea. [male reporter #2] Lee Sedol, the long-reigning global champ... [male reporter #3] This guy is a genius... [male reporter #4] ...who will take on artificial intelligence program AlphaGo in the ultimate human versus machine smackdown. This is a huge moment for both the world of artificial intelligence and I think, the world of Go. So far, AlphaGo has beaten every challenge we have given it. [Demis] But we won't know its true strength until we play somebody who is at the top of the world, like Lee Sedol. We chose Lee Sedol because we wanted a legendary, historic player. Somebody who has been acknowledged as the greatest player of the last decade. [in Korean] I don't want to sound too arrogant, but, still, I think I have the advantage. [translator] "I will not be too arrogant, but I don't think that it will be a very close match. The level of the player that AlphaGo went against in October is not the same level as me. So, given that a couple of months has only passed, I don't think that it is enough for it to be able to catch up with me. My hope is that it will be either five-zero for me, or maybe four to one. So the critical point for me is to make sure I do not lose one." [in Korean] [female host] High five, please. [Demis] We don't know how well our system will play against someone as creative as Lee Sedol. Also, he's very famous -for very creative fighting play. -Yeah, yeah. Yeah. So, this could be difficult for us, but we'll see. Maybe, in some ways, he's the most difficult opponent we could pick. [man #1] Yeah. [Cade] There was still so much of a question about whether or not they could beat someone like Lee Sedol. Fan Hui is a good player, but he's nothing like the very top players. [Andrew] Lee Sedol is a 9-dan professional. Nine-dan professional is the highest rank that you can achieve in Go. The ranking system. Show more

Show less

15:51

Fan Hui, who is the European Champion, is just a 2-dan professional. On the other hand, at the very top, Lee Sedol is a 9-dan professional. Lee Sedol is to Go what Roger Federer is to tennis. He is playing in Wimbledon to win the Grand Slam. And it's not just this year. He'll be there next year, and the year after that, and the year after that. Of course, the internet and all the Go community, everyone, maybe not 100%, maybe 99.999% think Lee Sedol will win very easily. [in Korean] [student] Teacher, I got stuck. How do I go from here? [stones rattling] [Master Kwon] Good. Hold the stone properly. Place the stone nicely, not like that. And hold it nicely, like this. [Janice] Go is taken seriously in Korea. It's so much part of the culture, like breathing, or, you know, like taking swimming lessons, or something. [Yuan] On the surface, it's a game, but inside, it has a very deep philosophy. The Go board reflects the individual who's playing. The truth is gonna show itself on the board. You won't be able to hide it. [Chihyung] In ancient China, Japan, Korea, Show more

Show less

17:04

Go is one of the four noble things, like four accomplishments for literati, with music, poetry, and painting. So, people think the Go players are very smart and very noble. [in Korean] It's okay to lose, as long as you played your best. Bow to your opponent. [Joseph] Master Kwon started this school, so that he could produce great players in Korea. Lee Sedol, when he was age of eight, he came in here, attending class, 9:00 a.m. until 9:00 p.m. for seven days. And then, he stayed with Master Kwon. [in Korean] I remember his round face and dark brown eyes. [Master Kwon] Since he came from an island, he easily drew attention. But unlike the other children, his eyes shone brightly. 7TH WORLD GO CHAMPIONSHIP [Janice] Lee Sedol was a little boy that I remember when I was a student studying Go. Show more

Show less

18:09

He was very young and rural enough to think that pizza grew on trees. [in Korean] [Sedol] When I was young, I started playing Go because I thought it was fun to beat guys who were older than me. Since then, it has become a type of creation of mine. I want my style of Go to be something different, something new, my own thing. Something that no one has thought of before. [Janice] Lee Sedol plays things that are interesting, where you felt like he is beyond winning and losing. [Janice] He wants to do something that's innovative or takes things to the next level. So every Go player studies his game for sure. [Aja] Roughly ten years, he dominated the professional Go world. He won 18 World Championships. [in Korean] [Master Kwon] Lee Sedol is a genius of the century. Even when I look back now, I am proud of him. And I'm proud of myself, too. [Joseph] Definitely, Lee Sedol is going to win the game, five-all. Yeah, all games. He's going to win all games. [David] We had our evaluation match last week. We won a game, and we lost a game. Show more

Show less

19:24

And we lost a game in a way that would have made us look extremely foolish if that happened publicly. It means that we still have work to do, and we need to take this really seriously. There's just too much risk that, actually, we could lose, overall. Not only that, but we could lose in a way that makes us look rather silly. -Yeah. -So, I guess, um... Yeah, Aja, did you want to say anything about what you're trying? I'm working hard. [laughter] [Demis] So, we're working round the clock at the moment, training our algorithms further, trying to incrementally keep on improving right up to the moment where we have the match. We have collected together people with different skill sets onto the same team. [David] So we have researchers, engineers, valuation guys. But you mean what happens if it creates something new -which wasn't in heavy node? -[Aja] Yeah. Show more

Show less

20:12

Then we don't see it. [Aja] You'll see it. -Okay. -[David] The first thing to know... I was thinking we have the perfect solution, -but it's not perfect. -[David] Yeah. [David] Aja is the lead programmer, and built the original search engine. [Demis] So Aja's responsibility is quite a big one. He'll be the one sitting opposite Lee Sedol and actually playing the moves AlphaGo makes. -[Aja] I'm feeling excited. -[man #2] Yeah? [laughs] Lee Sedol is a great player, and I feel honored to play with him. [Aja] Many of my friends, they are very excited about the match. They keep telling me that the whole world is watching. "Just prepare AlphaGo." [chuckles] [Hajin] Hello. Hello, Demis. Can you hear us? [Demis] Yes, I can hear you, guys. Can you hear me okay? [Hajin] Yes. Perfect. "I was curious to meet you, such an amazing developer who made AlphaGo. [Demis chuckling] It's very nice to meet you." [Demis] Thank you, thank you. Likewise. It's a real pleasure to meet you. I love the game of Go. I'm not very good, but I don't know if you know, but we actually have something in common. I actually also trained at a game at a young age. I used to be, when I was young, a professional chess player. [in Korean] [Hajin] He said that he was once a professional chess player. I used to play for the England team, [Demis] and then I stopped playing when I was about 14. I was... When I was 13, I was the second highest-rated player in the world. [Hajin] "After the match, I would like to propose that I give you one teaching game of Go, and you give me one teaching game of chess." [laughs] [Hajin] "How does that sound?" That sounds very good. I would be very honored to do that. [Hajin] "I'm not sure if it's okay to ask you this question, but I saw the games against Fan Hui, and I didn't think it was quite at the level to play with me, but I heard that it is getting really stronger. Can I ask how much it got stronger since then?" [Demis chuckling] Yeah. I can't say too much, of course, but it's definitely got significantly stronger. [people chattering] [David] With more time, I think, a logical approach would be to follow up on Aja's local search, Show more

Show less

22:28

-run that in fast AlphaGo, -Right. -generate a whole new data set, -Exactly. -and iterate with more time. -Yeah. But we're just out of time for that, so we have to be realistic. [Demis] We realized that if we wanted to prepare for a mammoth task like taking on Lee Sedol, there would be nothing better than talking to a professional. And we couldn't have picked a better person than Fan Hui. Show more

Show less

22:49

[tranquil music] [Aja] We invited him as an advisor because during the match, we found he is a man of good spirit. -[Maddy] Welcome back. -[Fan] Thank you very much. [Aja] It's very precious that we have Fan Hui with us. [Maddy] Let's go down this way. He was crushed by AlphaGo, but then, he became very positive and a big help to us. [Fan] When Demis tell me, "Can you come back to help us make AlphaGo more stronger?" I feel this respect. Of course, I accept about this. Show more

Show less

23:24

I play with AlphaGo to understand where are the strong points about AlphaGo and where is maybe the weakness. I play in the morning, afternoon, all the time. And I find something. I find big weakness about AlphaGo. The big one. [Shane] The superheroes always have a hidden vulnerability, right? And the same is true for AlphaGo. It's unbelievably superhuman, in general, but it has some particular weaknesses in some situations. [David] We can think of there being this space of all the things it knows about, and it knows about most of it extremely well. Then there will be these tricky lumps of knowledge, that it just understands very poorly. [David] And it's really hard for us to characterize when it is going to enter into one of these lumps. But if it does, it can be completely delusional, thinking that it is alive on one part of the board when, in fact, it's dead or vice versa. So, there is a real risk that we could lose the match. [Fan] Everybody in the team tried to work more and more to fix the problem, but I think it's difficult to fix this very quickly. [Maddy] We've got version 18 in the pipeline, haven't we? Well, we will only go for version 18 if it makes -a significant improvement which... -[Maddy] If it... Yes. We're having to rerun all the tests because they went wrong, unfortunately. So we're basically a day behind in our evaluation because of that. [David] Well, maybe we just need to be realistic. That we've tried a bunch of things, and we've come to the point where we said we would actually start freezing the code, and saying, "Look, it's... not... actually, not panning out." These delusions are still a realistic possibility for the match. We have some weaknesses that we... I don't think we are going to fix fully before the match. So that's causing us a little bit of anxiety. [upbeat music] [male reporter #5] Lee Sedol is getting ready to rumble. On Wednesday, live across the internet, this professional South Korean Go player will take on artificial intelligence program AlphaGo. [in Korean] I am confident that I will win five to zero. [David] Tomorrow, Julian and George, they pack up version 18, they stick it on a laptop, and they fly out to Seoul. [exciting music] -[Julian] See you all in Korea. -Safe trip. -Have a safe trip. -See you, too. [upbeat music] [male reporter #6] Is everything all set for the victory against Lee Sedol? Everything is set, I think. But when I get to the hotel, I'm going to catch up with the team. [George] What we should do in the time remaining is list things that could go wrong in the solidity of the system. We need somewhere to put AlphaGo under here. Show more

Show less

26:25

[Maddy] All right, rehearsal. Let's go, please, folks! [Aja] Have you arranged the place for Lee Sedol to smoke? When he's in a difficult situation, he likes to smoke. Yes, there is a terrace, and we will have security, so he will be able to go up there and be by himself. [in Chinese] [journalist #1] Which one do you support, Lee Sedol or AlphaGo? I am in an awkward position. -As you can see, I am a referee. -I see. [Fan] I am a referee. [Cade] When I got here, I didn't expect the attention on the match. It was literally front-page news. About eight million Koreans play the game of Go, and, even those who don't, you know, recognize Lee Sedol. He is a national figure. And so, there's that. Right? [Cade] There's some national pride involved. But it's more than that. Just the very thought of a machine playing a human in something like this, I think, is inherently intriguing to people. -[woman #1] We can bring him in? -[woman #2] Yeah. [Demis] Let's go in? Yes. [camera shutters clicking] [in Korean] [Sedol] I am confident about the match. I believe that human intuition is still too advanced... for AI to have caught up. I'm going to do my best to protect human intelligence. [Fan] All the world gave the pressure to Lee Sedol. Before this, he played the tournament for country, for himself. But this time, he played for the human. [David] I just really hope we win this first game. If you lose the first game, Show more

Show less

28:11

you literally have to win three out of four. [Demis] Yeah, that's right. -[David] Which is hard work. -[Demis] Yeah. Where are you going to be? -I'll start in the match room. -Okay. Then, I'm gonna come in here, make sure everything's fine. -Yeah, you should probably be in here. -Or something like that. [chuckles] -I know you're nervous. -Yeah, I'm nervous. I'm nervous. How are you? You're not nervous? -[Aja] A bit. -[Demis] Little bit, yeah? It's good to have a little bit of nerves. It should be fine. [Aja sighs] Be fine. Be fine. [Chris] Hello, and welcome to the DeepMind Challenge, Game One, Round One, live from the Four Seasons here in Seoul, Korea. I'm Chris Garlock of The American Go E-Journal. I'm here with Michael Redmond, 9-dan professional. Welcome, Michael. Want to give a shout-out to all the folks watching around the world? [Michael] Well, the excitement is pretty palpable here in the hotel. I've never seen a crush of interest of reporters from around the world. -The cameras... -[Chris] The media is overwhelming. [in Korean] I am not sure how much AlphaGo has changed in the last five months. [Chris] All right, folks. You're here, you're gonna see history made. Stay with us. [Julian] Five minutes, guys. [chuckles] Five minutes. [camera shutters clicking] [indistinct chatter] [in Korean] [escort] Please don't push. [David] I just thought we should take a moment together and just think about what is about to happen. I'm extremely excited to be here. Extremely proud of every one of you and what we have done. And, win or loss, I think it is just amazing that we're here. [in Korean] [journalist #2] Isn't it strange your dad is fighting against a machine? I would like it if the machine did not beat a human in Go yet. [laughter] One minute left. [camera shutters clicking] [tense music] [tense music continues] [camera shutters clicking] Five, four, three, two, one. [grand music] [in Korean] [Cheolgyun] The match will be in Chinese rules, 7.5 points komi. The time limit is two hours, and 60 seconds times three. [exciting music] [exciting music continues] Please choose the stone. [in Korean] Lee Sedol, 9-dan, what have you chosen? Black. [in Korean] Please start the game. [stones rattling] [tense music] [George] We had worked so hard to make sure that this would go technically smoothly. We tested it, and tested it, and tested it. And still, there comes that moment when you're live, all the TV cameras are broadcasting everything, and now it has to do the thing you built it to do. [in Korean] AlphaGo is even considering what to do from the first step. If you look at the time closely, -it has been over 30 seconds. -Yes. [Seongryong] AlphaGo is thinking too long at the second move. [Soyong] Yes. [tensed silence] [somber music] [somber music continues] [Aja] I was a bit nervous. It's the first time that I sat in front of a world-class Go player. And I actually can feel the spirit and courtesy of a great Go player like Lee Sedol. Show more

Show less

33:23

Because I think it was the first time he faced a strange opponent, I think. [chuckles] It is non-human, has no emotion, it's cold. But he stayed very calm. And I can feel his mental strength. [stones rattling] [both gasp] Oh. [in Korean] AlphaGo peeped. [Seongryong sighs] It's unbelievable. [Seongryong] This is the first time I am seeing AlphaGo making a move like this. It feels like AlphaGo is playing like a human. I'm Andrew Jackson. With me here is Myungwan Kim, a 9-dan pro from the Korean Baduk Association. We are here live at the Four Seasons Hotel on the 21st floor. What are we looking at? How's the game going? Oh, it's fighting from the beginning. -From the very beginning? -Yeah, yeah. -AlphaGo plays very well. -Yeah? -Just like a top professional. -"Just like a top professional." [Myungwan] Yeah, it's very aggressive. -[in Korean] It blocked! -Did it block? [Soyong chuckles] [Seongryong gasps] [Soyong] How dare he disconnect it? [Seongryong] This can't be right. Now, the fight is getting really complicated. Um, this is actually the first time I have seen AlphaGo playing a game that has this difficult a fight. [heavy breathing] [in Korean] [Seongryong] This could make Lee Sedol nervous. Because AlphaGo uses one minute to 1.5 minutes in any situation. This action is not like a human at all. No matter how complex you make the game, Show more

Show less

35:06

AlphaGo plays as if it knows everything already. [Michael] I just saw him looking at his opponent's face. -And that's just kind of a habit. -[Chris] It's just an instinct, as a player, to look at the person across from you. [Michael] Yeah, it's sort of something that Lee Sedol would do when he was wondering how his opponent was feeling. -[Chris] Right. -[Michael] It's just a habit. So, it's not as if Aja Huang is going to do any giveaway -because Aja Huang isn't AlphaGo, right? -[Chris] Right. Right. Show more

Show less

35:39

[Soyong and Seongryong gasp] [in Korean] He almost made a move. Lee smiled for a second. -[Seongryong] No. That's... -[Soyong] I guess Lee is mistaken? [Seongryong] He was about to make a move that makes no sense. -Here is the... -What is he doing? If he had put his stone there, he would have lost the game today. -He was trying to place it here, -His hand... but he moved his hand there without thinking. -He has so many things to ponder. -Well, I think... He is exhausted now. -I think... -Well... He looks a little panicked. Show more

Show less

36:11

[Seongryong] This is the thing we were most afraid of. [Soyong] Yes. -Self-doubt. -[Seongryong] Self-doubt. [somber music] [Fan] With a human, when you play, you can have exchange by feeling. I look at you. I know, okay, maybe you want to talk with me. Maybe you fear about me. I can feel many, many things. But with AlphaGo, you can feel nothing. So, when you can feel nothing when you play, you have more then more questions about yourself. For beginning, you think, "Okay, my move is good. And really good, really good... Oh, maybe bad. Oh, terrible! Why do I play here?" More, then more. [David] It's hard to know where to be. All the different rooms are like exciting in different ways. [Demis] Mm-hm. Right. [chuckles] It's quite nice to be here at the heart of the operation. [Demis] Yeah, I feel safe here. [all laughing] [David] White's thinking of doing this huge invasion here from its thick wall. Yes, go for it. [Demis] Stone in. He's going in. -Look at his face. Look at his face. -Yeah. [Demis] That is not a confident face. He's pretty horrified by that. [Myungwan] I can't believe what I'm seeing right now. Really... -She thought she's a little bit behind. -Mm-hm. And she made a very aggressive move here. -Okay. -And made it very complicated. -[Andrew] Okay. -[Myungwan] I think Lee Sedol, -if he doesn't respond correctly, -[Andrew] Uh-huh. then he can collapse. I mean, this is kind of unthinkable as a human Go player. Show more

Show less

37:56

What if she knows everything about what's going to happen next? [George] Where are we? Here's our search depth. We're searching... 50 or 60 moves ahead. [David] That's the maximum number of moves ahead that AlphaGo is looking from the current game position. It's typically over 50. It's often over 60. In the games we have seen, often around move 150, AlphaGo goes for the kill. We are at move 115 now, so we are getting to that critical point. [tense music] [Seokhyun] We are all astonished, just in the middle of the game because AlphaGo is, uh... It seems to be doing a much better job than we all thought it would. I thought Lee Sedol would be leading the game comfortably, but it turned out that he's struggling at the moment. But, I think, eventually, he will prevail. I hope. I was, you know, more five to zero, but now, I'm not sure about that. [chuckles] [in Korean] [Seongryong] What is this? AlphaGo made a mistake. AlphaGo made a mistake here. Wow, what a mistake! It might be the first mistake, kind of a clear mistake that white made. [in Korean] AlphaGo is making mistakes at the endgame from time to time. If AlphaGo wins by a small difference in the end, it is possible that it played just enough to win. [Seongryong] The reason I stopped talking a minute ago was that according to my count, AlphaGo may have more points. [laughing] I didn't tell you because I couldn't believe it. [male reporter #7] It seems like a mistake, but because it's based on calculation, it's actually not a mistake. Yes, yes. So if it's actually based on calculation... it is so scary. [chuckles] It means it's just playing with its opponent. Myungwan, it looks like you have got a count. Yeah, right. -What do you think? Yeah. -It's done. Yes. White won a lot at this time. It looks like it. If it's like this, white has won by a lot. Yeah. [in Korean] Two, three. I can't believe it. Thirty-six, thirty-seven... Seventy-two. He lost. He lost. Whoa, it's so shocking. I... I expected AlphaGo to win only one game. [laughing] Oh, gosh. [sighs] [somber music] [Aja] I can feel his pain. Like he was... He couldn't believe, you know. He couldn't accept it. It takes time for him to accept the outcome. [Fan] Maybe AlphaGo is very strong now, but he don't want to believe he will lose. He's just a Go professional player. We can't believe this, because, for us, it's something very, very far. It's not can be coming now. It's impossible. But, in reality... it's now. [Aja] I think he resigned in a very polite way. Lee Sedol plays black, but he put a white stone. [clacks] [somber music] [Michael] I think he resigned. [Chris] Oh, my gosh. -Look at the time. It stopped. -Yeah. Show more

Show less

41:32

Wow. [exciting music] You got this. -Congratulations. -Thanks. What's up? [David] I feel really good. I feel like I really believe in AlphaGo. Of course, it's natural that humans want humans to win. I mean, I think that's a natural response. But AlphaGo is human-created, and I think that's the ultimate sign of human ingenuity and cleverness. Everything that AlphaGo does, it does, because a human has either created the data that it learns from, created the learning algorithm that learns from that data, created the search algorithm. All of these things have come from humans. So, really, this is a human endeavor. [laughs] [reporters clamoring] [camera shutters clicking] [male reporter #8] In the battle between man versus machine, a computer just came out the victor. [female reporter #2] DeepMind put its computer program to the test against one of the brightest minds in the world and won. [male reporter #9] AlphaGo beat a professional player who has 18 Go World Championships under his belt. The victory is considered a breakthrough in artificial intelligence. [in Korean] First of all, I would have to say that I was very surprised, because I didn't think that I would lose the game. I think the mistakes I made in the beginning lasted until the very end. Show more

Show less

43:08

That's why I lost this game. I wasn't able to foresee. [Sedol] I didn't think that AlphaGo would play the game in such a perfect manner. I have won world championship titles and have a lot of experience, so losing one game won't affect me in playing games in the future. I think now it's 50/50. I would like to express my respect to the team for developing such an amazing program like AlphaGo. [Demis] In research, we normally work to produce an academic paper. It gets published, and maybe we get to talk about it in a conference if we're lucky. This is not normal for a research. In fact, I've never experienced any media attention remotely close to this. So, it's a special moment for us all, and we're just enjoying it while it lasts. [male reporter #10] In a matchup between man and machine, who wins? So far, it's the machine. In Seoul, South Korea, the artificially intelligent computer defeated the global champion in the ancient Chinese board game Go. AlphaGo Shock AI Shocked the World Lee Sedol lost the first matchup, but he's got four more chances. [in Korean] This is the team that played Go with Lee Sedol. [David] We got our newspapers. [Veda] But we are not responsible. It's just the man in the beanie. [all laughing] Sorry. AI Defeats Human Brain It is a bit strange being on the front cover and everything as a computer scientist. Normally, you sit there in your corner and you code. Nobody really knows about it. Perhaps you've heard the joke, "How can you tell that a computer scientist is an extrovert and not an introvert?" If he's an extrovert, he looks at your shoes when he's talking to you, instead of at his own. [Julian] If you look at Aja, he avoids all the cameras like crazy. He's like, the game is finished, and he's, like, out the back, and back in his room. And I think a lot of computer scientists would be like that. We are more about doing our work than standing in the spotlight. [elevator dings] [Chris] Hello, and welcome to Game Two, Round Two, in the Google DeepMind Challenge throwdown between man and machine. Show more

Show less

45:36

Game One, the machine takes down man. Huge shock. Headlines around the world. [Andrew] The reactions on the ground here from the folks in Korea were just stunned. They estimate 60 million people watched the game in China alone. Probably bringing it up to maybe 80 million people who watched this game worldwide. It was just incredible. And if anything, today is probably even more of a madhouse. So, Lee Sedol knows today. He knows that this is just a really important game. Right? He has got to win. Show more

Show less

46:10

[in Korean] [man #3] Go, Lee Sedol! [woman #2] Fighting! [in Korean] [Yeowon] Can you tell what Lee is thinking by looking at his face? Does he seem nervous? [Changhyuk] Yes. Lee seems to be very tense. My guess is that he didn't sleep well last night. [Chris] Lee Sedol on white, I think probably looking for a little payback. [Michael] My impression is that maybe he underestimated AlphaGo, and he is going to change his tactics. [Demis] Lee Sedol's playing much, much slower today. Yeah. -Which is going to affect us. -[George] Yes. He's playing at half the speed, actually. [in Korean] It is hard to say who is ahead or better now. [Changhyuk] The last two moves make me doubt AlphaGo's ability. -[Yeowon] But we have to stay alert. -[Changhyuk] Yes. -Yes. This is difficult. -AlphaGo is hard to understand. [Michael] If I see anything about AlphaGo that is not normal, is maybe the way it handles a game -when it thinks it is ahead. -[Chris] Yes. We're actually going to have a visit from one of the team, and we will talk about exactly that point from the inside. Thanks so much for coming by, Thore. I really appreciate it. Can you sort of share a bit of what is going on in AlphaGo? Show more

Show less

47:19

So, AlphaGo has these three main components. [Thore] There's the policy network, which was trained on high-level games to imitate those players. And then, we have a second component. We call this the value net. And it can evaluate the board position and say what is the probability of winning in this particular position. And the third component is the tree search, where it would look through different variations of the game and try to figure out what will happen in the future. [stone clacks] [Thore] So if we now take a position like this, first, the policy network would scan the position and come up with what would be the interesting spots to play, and it builds up a tree of variations. And then employs this value net that tells it how promising is the outcome of this particular variation. [clacks] So, AlphaGo tries to maximize its probability of winning, but it doesn't care at all about the margin by which it wins. [Michael] Okay, so when you see a slow-looking move, that's maybe an indication that AlphaGo thinks it has a good chance to win. -Yeah, that is a little giveaway. -Yeah. -A little tell. We're looking for a tell. -Oh, yeah. [in Korean] Lee Sedol is playing in a completely different style from his usual style. This is a historic moment and Lee Sedol is the center of attention. He must be feeling immense pressure. [Master Kwon] I hope he gets over this pressure and enjoys the match. [retreating footsteps] [Chris] Ooh, it looks like Lee is taking a little bit of a break. [somber music] [Fan] Lee Sedol go to smoke, and AlphaGo just plays. It don't think about if the opponent will be there or not. So, Aja sees AlphaGo plays move 37, and Aja puts the stone on the board. -[Changhyuk] Oh. -[Yeowon] Oh, wow. -Oh, it's totally an unthinkable move. -Yes. The value... That's a very... That's a very surprising move. [Chris] I thought it was a mistake. [chuckling] [Fan] When I see this move, for me, it's just a big shock. What? Normally, humans, we never play this one because it's bad. It's just bad. We don't know why, it's bad. It is a little bit high. Yeah? It's the fifth line. Show more

Show less

50:18

Normally, you don't make a shoulder hit on the fifth line. So, coming on top of a fourth line stone is really unusual. [Chris] Yeah, that's an exciting move. I think we are seeing an original move here. That is the kind of move that you play Go for. [Thore] Hey. Interesting stuff. -This fifth line shoulder hit was good. -Yeah. [Michael] And I wasn't expecting that. I don't really know if it's a good or bad move at this point. [David] The professional commentators almost unanimously said that not a single human player would have chosen move 37. So, I actually had a poke around in AlphaGo to see what AlphaGo thought. And AlphaGo actually agreed with that assessment. AlphaGo said there was a 1-in-10,000 probability that move 37 would have been played by a human player. So it knew that this was an extremely unlikely move. It went beyond its human guide, and it came up with something new, and creative, and different. [Cade] I am very much watching the game through these commentators. That is the way it works. So when they are confused, I'm certainly confused. At the same time, I'm latching on to the fact Show more

Show less

51:31

that they are confused, right? That is an interesting moment. When everyone else is confused, who is not confused, right, besides the machine? [Fan] I want to see Lee Sedol when he see this move. [Chris] He is back. Lee is back. [tense music] [tense music continues] [in Korean] [Sedol] I thought AlphaGo was based on probability calculation and that it was merely a machine. But when I saw this move, I changed my mind. Surely, AlphaGo is creative. This move was really creative and beautiful. [Fan] Normally, he has to think about one or two minutes, no more. But this time, he thinks more than 12 minutes. [somber music] The more I see this move, I feel something changed. Maybe, for humans, we think it's bad, but for AlphaGo, why not? [Cade] Go is like geopolitics, like something small that happens here, it can have a ripple effect, you know, hours down the road in a different part of the board. The game kind of turned on its axis at that moment. [Fan] This move is very special, because with this move, all the stones played before is work together. It's connect. It look like network, link everywhere. It's very special. Very special. [in Korean] [Sedol] This move made me think about Go in a new light. What does creativity mean in Go? It was a really meaningful move. Show more

Show less

53:51

[Michael] This is a tough game for Lee Sedol. AlphaGo is just not letting Lee Sedol -do what he wants. -[Chris] Right. Black has almost 60 points. That's a lot. [Andrew] That's not a good sign. [Myungwan] Oh. Oh. [Andrew] Lee Sedol just slapped himself on the side of the head. [Myungwan] Oh, wow. I think black is ahead at this point. [Demis] It's looking good, isn't it? We're on that steady... steady path now. [Fan] I just see Lee Sedol. He lose so much. Normally, we resign before long time ago, but he wants to try. He play, he play, he play. He just don't want to resign. [tense music] [Michael] Because then white... Oh, he resigned. It looks like Lee Sedol has just resigned. [Demis] It doesn't make any sense. I didn't foresee that one. -Move 37, very beautiful. -Yes. Beautiful, yeah. [somber music] [Demis] Is he okay? I brought his friend, because yesterday I noticed that he really wanted to analyze the game. [in Korean] I didn't realize how bad it was. [somber music] [Cade] There was this heavy sadness over that whole floor, and you could feel it during the game. I felt it during the game. And I'm leaving the commentary room to go to the press conference, and I was stopped by someone, another technology reporter. At first, all he wanted to talk about was the technology and how great this was, but then, even he kind of slipped into this moment of melancholy Show more

Show less

55:43

where he was upset as well. [in Korean] Yesterday, I was surprised, but today, I am quite speechless. [translator] "I am quite speechless. I admit that it was a very clear loss on my part. From the very beginning of the game, there was not a moment in time that I felt that I was leading the game." [Cade] You feel elated, and you feel a little bit scared. There is something, I think, frightening to people about a machine that learns on its own. [Julian] For us, AlphaGo is obviously just some computer program. But looking at the commentary on the internet, I already saw the commentators call AlphaGo like "he" and "she" during the games. Completely unconsciously. Which... AlphaGo is really a very, very simple program. It's not anywhere close to full AI, and we already see that happening. So I find that very interesting. [zaps] [crackling] [Nick] The tendency to anthropomorphize AI systems is one of the big obstacles in the way of actually trying to understand how AI might impact the world in the future. For example, the conversation is about what could go wrong, what the risks are. And invariably, you see this Terminator picture. Every single time, there are these red glowing eyes, right? [Fei-Fei] We're really closer to a smart washing machine than Terminator. If you look at today's AI, we are really very nascent. I'm extremely excited and passionate about AI's potential. But AI is still very limited in its power. [Cade] I think that people are right to think that there is a danger that as we continue to improve these systems, that we might miss that threshold where we do cross over into danger. But the good news is that there are already people thinking about those dangers. You know, there's a lot of talk now, and we are leading the discussion on this, that maybe there should be a kind of, cross-industry best practices working group or something. Right. Where the leaders of the research teams in those organizations, you know, the big ones that are working on AI, IBM, Microsoft, so on, come together and make sure that AI is used ethically and responsibly. I think what is important is that there is this community of people who are leading the cutting edge of AI, who are interacting with academics, and already are thinking about the long term, and how we can ensure that innovation is responsible as the power of these machines gets even greater. Lee Sedol Lost by Resignation [Chris] This is it, folks. Day Three, Game Three. Lee Sedol, Go Master. Back to the wall. He's down two-zero. He's got to win today to keep hope alive. [in Korean] [Hyunwook] Lee Sedol had a day off after losing two games, and he gathered with Go professionals and analyzed the game all night. I heard that four pros, yeah, went to visit him. -Hm. -To console him and to review AlphaGo's... Console him? Do you think he's upset, or... [Hyeyeon] I mean, Lee Sedol is upset. Yeah. [Aja] In the beginning, there was a fierce fight, and AlphaGo played very well. So he secured a very early lead. From move 50, the win rate was very high already. It was climbing toward 100%. [Chris] Oh, that's a pretty move. What's your probability rating? -Like, 91? -[Julian] No. -[man #4] It seems 70, you think? -No. [in Korean] He must want to win desperately right now. [Master Kwon] But I think the pressure and the psychological burden is adding up. Today must be the worst. I personally believe, when you try too hard to win, you will lose. Show more

Show less

59:37

[Fan] He tried to fight directly in the game but it's not his style. When we change our style to play with opponent, normally, it's very, very bad. So it's a game more easy for AlphaGo. -It's looking good for us. -[Michael] Hopefully, I think... You know, that black group is huge, and it has got nowhere to go, and it is going to be running around. [somber music] [Hyeyeon] I don't know how to describe the situation. If I were black, I will resign. [chuckles] We should admit that we are facing the strongest existence ever, ever in the Go history. There's no point in playing out the endgame, and you're going to lose, right? So... [rattles] [Michael] Even if black can live there... -[Chris] It's done. It's done. -[Michael] Oh, he resigned. Okay. Wow. Wow. [sighs] Show more

Show less

1:00:39

[Chris] You saw history made here tonight. [Michael] AlphaGo has won again. Three straight wins. [Chris] Three straight wins. Has won the match. [Fan] When Lee Sedol resigned the game, he looked like unhappy. It's not just he lose the tournament, it's just especially about this game, because he don't play his game. I'm very hurt about this, very. But I can do nothing. [Demis] You know, suddenly, I feel a bit ambivalent about it, Show more

Show less

1:01:12

given I'm a games player, and, you know, Go is the pinnacle of board games. But I really liked the statement of one of the top Chinese professionals. He said, you know, "If AlphaGo wins, maybe we'll really start to get to see what this game is about." [Maddy] I couldn't celebrate. It was fantastic that we had won, but there was such a big part of me that saw this man trying so hard and being so disappointed. [clicks] [Fan] I see the internet, many, many people talk about Lee Sedol. Maybe he don't play the best. We are Go player. Okay, sometimes in China, in Korea, in Japan we see Go like art. We are artists, you know. -We play our best for Go. -Right. Right. -So, be gentle with Lee Sedol. -Right. He's a very, very good player. He's a great player. I am in the room. I see Lee Sedol. He wants win. He try everything. It's just we can't. Just it's so... [in Korean] I think I have to express my apologies first. If I had been able to play better or smarter, the results might have been different. I think I disappointed too many of you this time. I want to apologize for being so powerless. I've never felt... [chuckles] Show more

Show less

1:02:53

this much pressure, this much weight. I think I was too weak to overcome it. [Sedol] I can't believe this is happening. Regardless of your opponent's level, to be defeated not by three-zero, but five-zero? Losing to AlphaGo by five-zero would really hurt my pride. I also feel so bad for the people who have supported me. [in Korean] Lee Sedol, 9-dan, has the strongest heart of anyone I know. [Hyunwook] He is fighting a lonely fight. His opponent does not exist in physical form. I really feel for him. We still have Games Four and Five, and if Lee Sedol, 9-dan, plays like himself, I believe we can beat the machine. [uplifting music] [Cade] You could see that he was more relaxed after he had lost three games in a row. That said, the stakes were still high. You know, in the end, it isn't about pride. [Fan] He don't feel like confidence, but he feels light. [Chris] Can Lee Sedol find AlphaGo's weakness? Is there, in fact, a weakness? I was thinking I would just pull the plug. -You would just pull the plug? -Yeah. [Hajin] Everyone is still cheering for Lee Sedol. And... Yeah, it's not going very well. [in Korean] [Taegon] Lee Sedol has chosen to play conservatively. [Hojung] But I am not sure it will benefit him. I agree. Yes, it doesn't look like a very good strategy for him. It feels pretty good for black at this point. -It feels pretty good for black, yes. -Pretty good for black. Yeah. [Fan] I want Lee Sedol to play his game. Because for the moment, he try many, many things to play with AlphaGo, to understand AlphaGo, but he never tried to play himself. I talk many, many times, AlphaGo look like the real mirror. When you play with AlphaGo, you feel very strange. You look like you're all the time naked. The first time you see this, you don't want to see because... "Oh, this is me? Real me?" And more then more, you need accept. "Oh, this is the real me. So, how? Now, how I can do?" [stones rattling] [Michael] It's developing into a very, very dangerous fight. This is really Lee Sedol's type of game. He likes this kind of fight. White has to find something inside black's territory. [Hajin] I think that he is already planning on trying something. So you believe in Lee Sedol's ability to live in that very small area, right? Yes. Yes. There is a little potential there. And I think, maybe he is going to try to do something. -[Andrew] Lee Sedol magic! -[Myungwan] Nice. [Myungwan] Oh, what would be the magic move? Lee Sedol is running short on time, but he's going to have to use up all his time. [Chris] Yeah, he has just burned, like, seven or eight minutes, just on this move already. [Myungwan] I don't see anything. We can't find anything. [in Korean] Show us something. I don't see any possible move. [chuckles] [Chris] What is Lee Sedol up to here? [Michael] Yeah, he is really concentrating. [Chris] He really is. Look at that. [Fan] Lee Sedol is very patient. He wait, he wait, he wait his moment. I feel something, he looks like the wolf. Wait in the forest, in the winter. He cold, he feel very, very cold. But he need patience. But the moment is coming... he go out to attack. [Michael] This is the hinge of the game. Oh. Look at that move. That's an exciting move. -Basically, I believe that this time... -[Andrew] He found a wedge. [Chris] Whoa. [Michael] It's going to change the equation because now black cannot escape. That would be so cool if that works. [suspenseful music] Oh! [Andrew] AlphaGo has just played something maybe unusual. [Michael] You know, I'm not actually sure what AlphaGo is trying to do here. [Chris] What's that about? [Michael] I don't really understand it. Well, well. That was a sharp drop in win rate. That's the sharpest drop in win rate we've seen. Show more

Show less

1:07:32

[Julian] It dropped eight percent. [indistinct voice] -[George] Wow. -[Julian] Wow. [Andrew] This could be that it actually can't find a way through. -I think this is... -Uh-huh. It has looked far enough ahead to see that it doesn't work, and now maybe it's on tilt. I don't know. [Julian] Here it comes. [laughs] -[Michael] That was one time. -There it comes, though. It looks like it has fallen off the cliff. -Yeah, it has made a mistake. -[Michael] Yeah. Show more

Show less

1:07:55

Did anything strange happen in the... -[Julian] No, it all looked normal. -Yeah. Well, we can definitely say there is a weakness. Well, we definitely say there's a mistake. [David] I felt this mixture of this sinking feeling in my stomach, where I was wondering if AlphaGo was becoming delusional in this situation. Where I could see that it was starting to play strangely, and at the same time, relief, that Lee Sedol, that he was actually in with a chance now. Aja's trying not to look horrified. [Aja] I knew after move 78, after, like, 10 or 20 moves, I saw AlphaGo's strange moves. And I knew AlphaGo somehow became crazy, but I didn't realize why. What? We searched to 95 ahead at that point? At the part where it made the mistake? -[George] Yes. -I think that something went wrong. That's the longest it has searched the entire game, isn't it? Yeah. I think it's like it searched so deeply, -it has lost itself. -[George] It's tired. [Michael] I do get the impression that AlphaGo has sort of, gone off on a tangent. -What is it doing now? -Well, maybe it has a master plan. No, it doesn't even think it has, does it? So it knows it has made a mistake, and it starts evaluating it the other way. [Demis] Look, look, Lee is confused. He's like, "What is he doing?" That's not a "I'm scared" confused, that's a "What is it doing?" What's going on? You know, you asked if it was a bug. I've said before that if... -Yeah, right. That's what I thought. -If DeepMind has figured out how to write code that doesn't have bugs, that is a bigger news story than AlphaGo. -[David] Are you kidding me? -Hm? This... Literally, this next move we are going to play, I think they are going to laugh. I think Lee is going to laugh. [tense music] [Taegon] Oh! Oh! [in Korean] What is this? [audience laughing] -Oh, that's ridiculous! -What's going on? What is it thinking? [Michael] I don't really know what AlphaGo is trying to do here. That's the understatement of the year. [Myungwan] Is it a mouse misclick -from Aja Huang? -[Andrew] Nope, that's the move. Aja Huang makes no misclicks. Lee Sedol is very confused. These are not human moves. This move is also sort of inexplicable. [Chris] I mean, those, you can clearly call those mistakes. [Michael] Yes, of course. But it's the first time in the four matches -that we have seen moves like that. -[Chris] Right. Oh, the value dropped even more. That's weird. We're at 45%. [foreboding music] [Myungwan] White. -[Andrew] White. -[Myungwan] I think white is winning. [Andrew] Come on, Lee Sedol. -It's unbelievable. -Yeah, all right! I was so confident that this black area would just be consolidated by black, and there was nothing there. And somehow, he has just erased it all. Like, it's gone. [Andrew] So, he has found his weakness. That wedge move probably surprised it. -The wedge, yeah. -Yeah. AlphaGo seemed to have such a good game, and then... this whole sequence in the center sort of changed that. He pulls off a miracle. He managed to make it so complicated that the artificial intelligence doesn't evaluate it correctly. [Andrew] I think it looks like Aja Huang maybe, sitting there, also knows that the game is over. I can't... I can't stop smiling. [chuckles] [Myungwan] Did he smile? [Andrew] No, I haven't seen him smile yet. -I think he is still checking. -[Myungwan] He's so serious. [Andrew] He's so serious. -He wants to be careful. -[Myungwan] Yeah. He concerns a lot. He really does his best. I think he feel something like... responsibility, or burden. I think it's almost over. [David] So, what's the percentage? [Julian] It shows as 18.2%. [David] The next move should be resign. [tense music] There you go. AlphaGo resigned. Show more

Show less

1:11:52

-It looks like AlphaGo has resigned. -[Chris] Wow. [Cade] The most amazing game. I'm almost going to tear up, was, uh, Game Four... [clears throat] um, where he comes back and wins, right? [cheering] It resigned! [crowd cheering] I'm so happy! [cheering continues] [crowd applauding] [in Korean] [Sedol] I heard people shouting in joy when it was clear that AlphaGo had lost the game. I think it is clear why. People felt helplessness and fear. It seemed like we humans are so weak and fragile. And this victory meant... we could still hold our own. As time goes on, it will probably be very difficult to beat AI. But winning this one time, it felt like it was enough. One time was enough. I heard from so many people saying they were running out in the street. They were so happy. They were chanting, they were celebrating. Especially after zero-three down, at the time, it seemed to be hopeless, that the end of the world was coming, but we saw the light. Usually... I'm happy when I win, not when my colleague wins. But, this time, it felt like my win. [in Korean] I didn't want to make a move which AlphaGo could predict. This part... It didn't anticipate this wedge move. I won one game at least. Good job today. [stones rattling] [relieved sigh] [uplifting music] [crowd applauding] [crowd cheering] [loud applause] [in Korean] [Sedol] But I didn't expect it to be like this. I couldn't believe I won one game. It was unbelievable. [Sedol] Thank you very much. [laughter] I have never been congratulated so much for winning one game. After losing three games in a row, I couldn't be happier. [crowd cheering] This victory is so valuable that I wouldn't exchange it for anything in the world. My question is about move number 78. Show more

Show less

1:14:37

[journalist #3] Chinese top Go player Gu Li said that it was a god's play. What were you thinking when you made that play? Thank you. [in Korean] At that point in the game, move 78 was the only move I could see. There was no other placement. It was the only option for me, so I put it there. I am quite humbled by all the praise I am getting for it. [David] It does leave me a little bit in awe of the human brain's power, in particular, Lee's amazing ability to cause AlphaGo problems and find something seemingly out of nothing. And so, we really want to understand what had happened. [Chris] So, it really was Lee's move? [Aja] The key is the center. After center go out, there was no chance. [David] Come, come. We were winning before this. Show more

Show less

1:15:19

But if AlphaGo thought it was winning and it couldn't convert that win, that means it wasn't actually winning. Otherwise, it would have had the right responses. [Thore] Would we have played it? [Maddy] Nerves of steel in there. What probability does it give it as white? [indistinct chatter] 0.007%. Is that in the position that he played? -That's when he played it. -I see. -We thought this was a 1-in-10,000 move. -I know it was like... -Yeah. -The values we didn't know about. -So the God move was literally a God move, -Yeah. because we believe that only 1 in 10,000 humans -would have found that move. -That's right. It doesn't come to mind as one of the top five moves you would consider. Unless you're Lee Sedol, he said it was the only move. He thought it was the only move. Yeah, remarkable, isn't it? [exciting music] [Chris] Welcome back to the Four Seasons. World Champion Lee Sedol went looking for AlphaGo's weakness in Game Four, and he found it. Today, last round, he is looking to see if he can repeat that. We will see what happens. [Andrew] The place is a madhouse downstairs. Maybe as many, if not more, journalists here today than there were for Game One. [Maddy] We were really excited for the fifth match, to see what would happen. Was this going to be a three-two thing or was it going to be a four-one thing? And, you know, there's a different message with both of those. [Fan] For me, I don't think AlphaGo will make the mistake again. But who knows. Maybe it will be coming. And Lee Sedol have now more confidence about this. Look like maybe Lee Sedol find the key to open AlphaGo. [in Korean] Oh, this works! Is it fair to say that AlphaGo made a mistake? We might have another victory today. You weren't crazy about the timing on this move. -Yeah. -And now, you don't approve of this. Yeah, I'm sort of thinking that maybe AlphaGo hasn't recovered from Game Four yet. Yeah. [Chris chuckling] [Demis] Still deluded? [Julian] We don't know. Oh, no, I hope he doesn't... No, no, he needs to play the... [clicks tongue] [Demis sighs] [Fan] He play some moves. It's bad moves. I feel something. Oh, maybe his weakness come back again. [Chris] Are we seeing another short circuit? Or is there something, what's... [Michael] I think it could be a kind of a misreading. [Chris] And we are... You're pretty comfortable with saying that... [Michael] That it is looking good for Lee Sedol? [Chris] It's looking good for Lee Sedol. What is he playing in there for? There's no reason for white to be playing that move. [Michael] It's a bad move. And in some cases, it's going to lose a point, too. It is exactly the same thing. Ninety-one percent certain now. [Michael] Someone was telling me that maybe it had... Show more

Show less

1:18:09

Yeah, because it's incorrect again. [Julian] The whole game, we thought that AlphaGo was wrong about the board position. We were super worried that, "Oh, it's going to play garbage. It's going to be like lose in a very embarrassing way." And this continued for the whole game. This is a bit weird. -When did it play that? -Just now. -So I don't know. I mean, it doesn't... -Well, that we don't know. But we're not good enough Go players to know that, right? Yeah. [Julian] As it turns out, none of us know Go well enough to accurately judge what AlphaGo is doing. White is winning now. Show more

Show less

1:18:39

This one looks like white is winning. Ah! We all say some of AlphaGo's moves are so weird and strange, and may be mistakes. [Chihyung] But after a game is finished, we have to doubt ourselves, our judgment. AlphaGo making another kind of nonsensical throw-in. I'm not really sure what that's about. This is what 10 or maybe 11-dan play looks like. It looks weird, and we don't quite understand it. [Chihyung] I think it's important to study more about AlphaGo's mistake-like moves. [chuckles] Then maybe we can adjust our knowledge about Go. [Frank] To me, the most amazing thing to come out of my understanding of Go as a result of watching AlphaGo play Show more

Show less

1:19:24

are the infamous "slack moves." Well, there's something strange -about the way it is playing, -[Chris] Yeah. because it's playing some moves that are not really necessary. Right. [Frank] A "slack move" is a move that looks lazy. You can see these other better moves, and AlphaGo is rejecting them. But what I think AlphaGo is teaching us is that we have been using score as a proxy for chance of winning. So the bigger my margin of territory, the more confident I am that I'm going to win. And AlphaGo is saying, "No, no, no. It shouldn't matter how much you win by, you only need to win by a single point. Why should I be seizing all this extra territory when I don't need it?" The lessons that AlphaGo is teaching us are going to influence how Go is played for the next thousand years. By my counting, white won this game. How... By how much? Are we talking two points? -One-and-a-half. -One-and-a-half points. Yeah, maybe one-and-a-half. Of course, Go is just a game, but we can learn important lessons from a computer being so successful at Go. [Martin] Machines will have the capability not only to crunch through a huge amount of data, but also to analyze it intelligently. Show more

Show less

1:20:37

Just as in the case of the Go games, the machine-made moves that surprised even the experts. And, eventually, the machines will gain our confidence because we will see that very, very often they make a better guess than we could have made as humans. [sharp inhale] [sighs] [in Korean] [Jimyung] AlphaGo has strong foundation. Show more

Show less

1:20:56

[chuckling] [groans] [Sedol] What surprised me the most was... that AlphaGo showed us that moves humans may have thought are creative, were actually conventional. I think this will bring a new paradigm to Go. AlphaGo won this area as well? Oh, god. [laughs] -That makes me very uncomfortable. -Oh! Unfortunately, for Lee Sedol, I think white might have a slight advantage here. [Michael] White lights up in places, but if we count it like that, it's 1.5. [Demis] They keep saying one-and-a-half points. How do you know the Korean room has called it? Someone, um... -Who told us the Koreans called it? -[Chris] I don't know. [Demis] The Koreans told you? Koreans called it. Someone said the Korean room has called it for AlphaGo. We would just like to know if someone Korean in there can find out. [woman speaking indistinctly] [woman #3] The Korean room thinks AlphaGo is winning. "Winning," okay, not... then not won. -That's what she said. -"Winning." She said they called it right there. [clears throat] AlphaGo's saying it's going to resign. -[Chris M.] What? -No. I'm only joking. [all laughing] Jesus, I almost had a heart attack. Dave, don't do that. It's ridiculous. That was a very good one. [laughs] -[Veda] Well played. -Yeah. -[Veda] Well played. -No, not really. I couldn't do it for too long. I just couldn't think like that. [Chris M.] Dave, you've been waiting two years to do that. He needs to do that. [laughter] We don't know the score. We have no idea what's going on, right? [in Korean] Two-and-a-half points. Lee is two-and-a-half points behind, at least. [Michael] The parting in the center, it's very hard to... It's very hard to... [in Korean] Lee is touching the bowl. [Jimyung] Looks like he's considering resigning. [Seongryong] Yes. I think he is thinking of resigning. [indistinct chatter on TV monitor] [clacks] -Did he resign? -[George] He resigned. Hm? He has what? I think he resigned. [indistinct chatter] -[Julian] He resigned? -I think he resigned. [indistinct chatter] Aja's looking relaxed. -Yeah, he has resigned. -He has resigned. Show more

Show less

1:23:08

[in Korean] Yes, he is giving up. -Okay. That's it. He has given up. -Yeah. -Yeah! -Yes! [applause] [indistinct chattering] [Demis] I mean, I think it just really is a once-in-a-lifetime thing. I would say it is the most amazing thing, you know, I have experienced. You know, for us, it is the culmination of a 20-year dream. It started as a pure research endeavor. We just wanted to understand. Can neural networks play the game of Go? And from there, it went on to a level that I never expected. [David] And I'm unbelievably proud of the team. [Ioannis] When I started doing artificial intelligence, it was four or five years ago, and I was really interested in that, but, like, many people would discourage me, and they would say, okay, there is no future. So, actually seeing that within five years we are at this stage right now, it's amazing by itself. Everybody say, "Nine dan." -Nine dan! -Nine dan! [man #5] Kimchi! [David] There are so many possible application domains where creativity, in a different dimension to what humans could do, could be immensely valuable to us. And I just love to have more of those moments where we look back and say, "Yeah, that was just like move 37. Something beautiful occurred there." At least in a broad sense, move 37 begat move 78, begat a new attitude in Lee Sedol, a new way of seeing the game. [Cade] He improved through this machine. His humanness was expanded after playing this inanimate creation. And the hope is that, that machine, and in particular, the technology behind it, can have the same effect with all of us. [Martin] I remember hearing a talk by Kasparov, who says that, uh, a good human plus a machine is the best combination. [Fan] This is a unique experience. Nobody can have this experience playing with AlphaGo, five games like this. So, I hope Lee Sedol can find something in these five games. Maybe some change in his game. I see today he fight, fight, fight. He's very good. Big master, real big master. [in Korean] [Sedol] I have grown through this experience. I will make something out of it with the lessons I have learned. I feel thankful and feel like I have found the reason I play Go. I realize it was really a good choice, learning to play Go. [laughs] It has been an unforgettable experience. [calm music] [Fan] This event is done, but for all the story, maybe it's just the beginning. We don't know. [tranquil music] It's just when I play with AlphaGo, he shows me something. I feel beautiful, just it. I see the world different, before everything begin. What is real thing inside the Go game? With this thing, I will change something with my game. Maybe he just can show humans something we never discovered. Maybe it's beautiful. [inspiring music] Show more

Show less

1:30:40

Show less