Man Vs Machine In Chess - Who Is Winning? 534
FFriedel writes "In a few weeks, the world's strongest player Garry Kasparov will take
on X3D Fritz in a high-profile man-machine
chess match. Who is the statistical favourite? Since computers have been steadily
improving and are now holding their own against the very strongest human players,
one would think it may be Fritz. Not necessarily, says statistician Jeff Sonas,
who doesn't believe computers will inevitably surpass the top humans, and presents empirical evidence to support his claim as part of a series of articles for ChessBase."
required reading (Score:5, Interesting)
BTW, the Fritz people make a big deal about beating deep blue in 1995. That would have been a big deal, but the program they beat was Deep Thought II ("Deep Blue Prototype"), not deep blue, a weaker program running on weaker hardware. The match was in Hong Kong where DT2 had persistent problems with their data line to the USA where DT2 was physically located.
Re:required reading (Score:4, Interesting)
BTW, the Fritz people make a big deal about beating deep blue in 1995. That would have been a big deal, but the program they beat was Deep Thought II ("Deep Blue Prototype"), not deep blue, a weaker program running on weaker hardware. The match was in Hong Kong where DT2 had persistent problems with their data line to the USA where DT2 was physically located.
What's the big deal about the data line? Isn't the computer choosing the moves? If that's the case you can just have someone tell you the moves it chooses over the phone!
Anyway, I think this article is dumb. The guy raises the possibility that computers will never be better at chess than humans. That should set off immediate alarm bells that the author doesn't know what he's talking about.
Then he states that if it does happen, it won't happen in the near future. That, in itself, would be a defensible position (if the guy hadn't already proved that he doesn't know what he's talking about). But he doesn't back up this assertion with any compelling logic. If, as has often been speculated, chess is turning into a giant game of memorization, it stands to reason that computers are going to gain the upper hand.
-a
Re:required reading (Score:2, Interesting)
Why? Is it not conceivable that computers may perhaps be weaker in some THING than humans?
But he doesn't back up this assertion with any compelling logic.
I think you need to wait for part III lol no joke
What will they do when we're gone? (Score:4, Funny)
Re:What will they do when we're gone? (Score:2)
Re:What will they do when we're gone? (Score:4, Funny)
The computers will engineer humans to play chess with.
Re:What will they do when we're gone? (Score:2)
It would be rather ironic if they have already won and turned us into batteries, in which case we are just part of a computer simulation in which we think we are creating smart computers (yes I am impatiently waiting for the 3rd matrix movie dammit).
Moxy Fruvous on Chess Computers (Score:5, Interesting)
Re:Moxy Fruvous on Chess Computers (Score:2)
computer-aded chess? (Score:2)
Its not cheating; its computer *aided* chess.
Ahem.
still (Score:5, Insightful)
When a computer can learn to play chess by itself and then beat the top players, then we have something to look at.
Re:still (Score:3)
I don't think we're ever going to see that happen, but if you're just interested in computers automat
Re:still (Score:3)
Someone makes this argument every time slashdot posts an article about chess. That it's really a contest between a programmer and a chess player.
Quite frankly, this is bullshit. Or at least the programmer has a massive advantage. It's like saying that a race between an olympic runner and a car is really a test of skill between the runner and the driver. Well, it isn't. I doesn't take nearly as much skill and dedication to drive a car as it does to run a mile in four minutes. Writing a chess program isn't
poor humans! (Score:2, Interesting)
Re:poor humans! (Score:2)
Of course, he probably isn't.
Kasparov is a bad choice (Score:5, Interesting)
Part of the problem is that Kasparov is this generation's GM. Kasparov plays very emotional games. He's not just looking to beat you in his first match; he's looking to utterly destroy, smash and humiliate you with a dramatic and embarrassing win.
This is a great strategy against people, but it's not so effective against computers. Kasparov is probably the worst chess master to pit against a machine since Ruy Lopez (I think he's won with the Ruy Lopez opening a few times, case in point: it's a brutal and humiliating play for the losing opponent).
Kasparov knows that the computer can "think through" future moves better than he can. Computers, in fact, do the opposite of human chess players: we set goals and try to find ways to get there while computers search through various ways to find a satisfactory goal they can achieve. So, Kasparov plays it very conservative and keeps himself out of any situations that give the computer too much range of foresight, which is why the Kasparov/computer matches tend to look like Verdun (though he's been surprised a few times).
Personally I'd like to see some of the younger generation take on the big programs. They tend to play more technically and less passionately than Kasparov and his generation.
Re:Kasparov is a bad choice (Score:3, Funny)
Re:Kasparov is a bad choice (Score:2)
Oddly enough, I've had my ass kicked by a Hell's Angel in Oceanside, CA (I figured since I was a Marine the other Marines in the bar would leap to my aid... ah, to be young and naive again).
It was painful, but not terribly embarassing (though explaining to the MP's as I crawled back onto Camp Pendleton the next morning why I had 2 black eyes and shredded clothing was a little humiliating; I said I picked up a stripper and her pimp rolled me, it seemed less pathetic).
I personally am not humiliated when I g
Re:Kasparov is a bad choice (Score:3, Interesting)
Chess is boxing with the mind. Also, if you make no mistakes, it's a draw. As if that ever happens...
If you lose, you truly have no-one to blame but yourself. No excuses. There is no random factor, you have full information, the game is initially equal. Losing without a chance after a lifetime of study hurts.
Re:Kasparov is a bad choice (Score:3, Informative)
No, somebody gets the first move. I don't believe it has been proven whether this is necessarily an advantage, disadvantage, or absolutely not a factor.
Re:Kasparov is a bad choice (Score:3, Insightful)
Re:Kasparov is a bad choice (Score:3, Insightful)
I'm not sure what an 'emotional' chess move looks like. I can say this, kasparov's ELO has been over 2800 for quite some time (the highest rating in history). Younger players like rajdbov et all do not play more 'technically' than kasparov. He is the single greatest chess tactician ever, period (and an unmitigated jerk, meh) tactical brilliance. [demon.co.uk]
The really interesting thing is that a GM combined with a computer is MUCH stronger than a GM or computer by themselves. I
Re:Kasparov is a bad choice (Score:2)
You know, I was precisely thinking of Kramnik. Give Vlad a few years to build up some endurance (Christ, he's only 28) and I think he might do really well.
Mad props to your final sentence, though: computers can only beat good chess players after they get tired. I'm an extremely mediocre chess player who happens to enjoy studying the theory of the game. I can beat GNUChess readily in the first game, with difficulty in the second game, and almost never in the third and later games without a break of a few da
Re:Kasparov is a bad choice (Score:2)
does the computer do a dance? (Score:5, Funny)
Re:does the computer do a dance? (Score:2)
I honestly can't remember where I read this, and whether it was parody or real. But the thought is pretty funny.
Go (slightly OT) (Score:5, Interesting)
Not to get too off-topic, but there are also now several (increasing) prizes for beating top ranked players (well, rather, any professional player and occasionally there's a prize for beating a dan ranked amateur) in Go.
For those of you who are unfamiliar, there is an excellent, if somewhat dated, article [nyu.edu] that discusses some of the difficulties for getting a computer to play Go well. It also talks about Janice Kim, a 1 dan (professional) at the time (now a 3 dan), beating the then-best program when the computer had a 25 stone handicap. To give an idea, a 9 stone handicap in an experimental games between evenly matched professionals generates about 140 point advantage.
As I said, it is a bit dated (5 years old) and computers have improved, but we are still nowhere close to beating a professional.
Re:Go (slightly OT) (Score:2)
Not OT at all, IMO. Compare how easy it is to beat whatever version of Go comes with your Linux distro with how hard it is to beat a COTS chess program on "hard" setting.
Chess relies to a large extent on intuition and imagination, but Go relies almost solely on it. I think it might have something to do with the more strict rules of chess. Show a grandmaster a chess board that was achieved by legal moves and (s)he can usually memorize it; show him/her a "random" board and (s)he cannot. Go is not so simple;
Infinite Chess (Score:3, Interesting)
Re:Infinite Chess (Score:5, Informative)
Re:Infinite Chess (Score:2)
Re:Infinite Chess (Score:5, Interesting)
Humans will improve with machines for a while (Score:2)
What about Go? (Score:2, Interesting)
1) They can brute force the game. On the 8x8 board there is a very limited number of permissible moves at any given moment, and an even lower number of desirable ones.
2) They can easily tell if a move benefits them. Chess is a game where its very easy to look at the board and say who's winning. Board position, captured pieces, influence are all key points that anyone can spot at a glance.
In my eyes, this just isn't a challenge, but straightforward appli
naivity (Score:5, Insightful)
Re:naivity (Score:2)
Re:naivity (Score:2)
None of the modern computers even considers brute-forcing the move tree - it's impossible. The search space is far too big, and considering some moves/board configurations can loop back on themselves, it's nearly infinite. Brute-forcing the move tree is simply useless.
That being said, all the major chess programs nowadays are not limited by hardware, but by software. Throw better hardware at them, and they will not play better chess.
Re:naivity (Score:2)
Re:naivity (Score:2)
Re:naivity (Score:2)
Once a person has been introduced to the inevitability of the evolution of smarter-than-human intelligence [kurzweilai.net], they can no longer claim ignorance, and either accept it [singinst.org] or go into denial like most people because the future shock [everything2.com] is too much for old belief systems to handle, or too fantastic for bitter cynics who didn't get their promised
Human advantage (Score:2, Interesting)
Re:Human advantage (Score:2)
Re:Human advantage (Score:2)
Intimidation, and bluffing work against other humans, but it'd never work against a computer. That's like saying you'll trick an omnicient being by doing something they won't expect you to. If they are omnicient, they KNOW what you are doing. Co
Let's not let computers get too smart (Score:2)
a contradiction? (Score:5, Insightful)
"The red line is Garry Kasparov's rating over time, and the blue line is the rating of the top computers on the SSDF list. The blue line is creeping closer and closer to the red line. It seems just on the verge of crossing over. "
But then, further, down, he writes:
"Although computers obviously must be improving in recent years, the strongest humans seem to also be improving at about the same rate."
These two statements contradict each other, don't they? Either computers are improving faster than grand-masters, meaning the graph and its extraploations are true; or, computers and grand-masters are improving at the same rate, which would mean the percentage of human wins and draws would be generally the same as in previous years (something not indicated by the second graphic in the article)?
Re:a contradiction? (Score:3, Informative)
Re:a contradiction? (Score:2, Interesting)
Say the best computer in the set of computers always beats or draws the other computers. lets say it wins more than it draws. In that pool of players, it's rating will tend to creep up.
So the ratings aren't necessarily comparable. Take a 1700 player, throw him in a pool of only 1000 players - when his rating break
How complicated is Chess? (Score:4, Insightful)
Re:How complicated is Chess? (Score:2)
A naive calculation of the state space size has little to do with computational difficulty.
Re:How complicated is Chess? (Score:2)
Sorry, I thought you were arguing in favor of the author's unfounded claims that humans are unlikely to be beaten consistently by machines any time soon...
What about playing chess with God? (Score:3, Interesting)
Yawn. (Score:3, Informative)
Philosophers and other people have done arguments like that or better, far more efficiently and elegantly - e.g. "can God create a rock he cannot lift" and so on. Some h
computers have already surpassed humans in chess (Score:2)
if you ask me... (Score:2)
How about a nice game of gobal thermonuclear war?
Stop making me feel like an idiot already (Score:2)
Absolutely wrong (Score:2)
Look at the game TicTacToe. There are some finite amount of moves (something like 9!). Therefore it takes very little space to store the entire game tree, consisting of every possible move, in a computer. This means that a computer will always win a game, because it knows the best path at any given move. (TicTacToe might be wierd in the fact it seems that two good players can always tie)
Then look at Checkers. Sure, its much more complex then TTT. However,
You're absolutely wrong. (Score:5, Interesting)
How large is "amusingly large"? Around 10^150, if I remember my AI class correctly. Discarding entirely the problem of how you'd create a game tree of that size (given the cosmos has about 10^77 particles), let's just address the energy required to compute the table.
It requires an absolute minimum of kT*ln2, or about 3*10^-26 Joules, of energy to set a bit. Each cell on a chess board requires a minimum of four bits to store its state (it has to store a three-bit enum { PAWN, ROOK, KNIGHT, BISHOP, QUEEN, KING } and a one-bit enum { BLACK, WHITE }). So for a 64-block chess grid, you're looking at 256 bits just to store state.
256 * 3*10^-26 = 7.7*10^-24
7.7 * 10^-24 * 10^150 = 7.7 * 10^126
Do you have any freaking clue how much energy 10^126 Joules is? It's frickin' huge. Like enough to cause a symmetry-breaking event which would propagate through the universe at the speed of light and utterly annihilate everything in its path, including the computer churning out the complete decision tree for chess.
I can see it now. When Judgment Day comes, it's all going to be because of a Slashdotter who thinks he knows a lot more about what computers can and can't do than he really does, and goes off to solve unsolvable problems without considering the thermodynamic consequences of his actions.
Typical for Slashdot.
Re:You're absolutely wrong. (Score:2)
Not that it will make a great any difference to the outcome, although if someone did try they would be pleased to know that they had saved about 1x10^126 Joules, which should reduce their electricity bill somewhat.
Jolyon
Re:You're absolutely wrong. (Score:2)
I guess you'll have to calculate it the expensive way after all.
Jolyon
Re:You're absolutely wrong. (Score:2)
The first mistake is in assuming that you have to store board state in its entierty. We've invented this thing called 'compression.' It's really handy for taking situations whic
Neurodynamic programming: tree size not crucial (Score:5, Interesting)
However, noting that the state-space size is large isn't really a very useful observation, since chess programs these days don't try to map out the entire tree of possible outcomes. Instead, they operate on neurodynamic programming techniques, which basically try to extract which "features" of the game are important and weigh those features to decide which moves to make. This significantly reduces the complexity of the system, but requires that the person writing the program have some intuition about which "features" are important. In chess, for example, these include such things as material balance, piece mobility, king safety, and other positional factors. A period of training is usually required as well, where basically the computer goes over a lot of games that grandmasters have played and tries to "learn" how to weigh the different features in order to choose the optimal move.
For those who are interested in reading further about this (yeah, yeah, this is Slashdot, if people can't RTFA what are the odds they'll want to pick up a book? :) ) a good place to start would be Chapter 6 of Bertsekas' "Dynamic Programming and Optimal Control [athenasc.com]".
Re:You're absolutely wrong. (Score:2)
Not necessarily. I don't want to predict what the future will hold; it's possible we'll see reversible computers take hold, in which case we can compute with infinitesimal energy. A reversible computer could compute the entire decision tree using a nine-volt battery for a power supply, although you'd still have the problem of finding a hard drive larger than the universe
What is the standard ... (Score:2)
a) Top human vs Top computer: computers defending champs;
b) Elegance of tactics: humans (computers still brute force);
c) Efficiency (wins/joules): humans for forseeable future; and
d) Number of Wins: Average Human vs Average Computer: computers rule (sorry but people who beat computers of any level are seriously in the minority).
Pessimistically, humans take the occasional battle but the war has been lost.
Always have to bring it up (Score:2)
Basically, there's a million dollar prize out of someone can make a go playing computer program that can beat a weak professional. How are they doing? Well... if you've played Go for a couple months you can probably beat the strongest program to date. (And yes, I can)
What's go like? Try:
http://www.usgo.org (many links there)
http://www.kiseido.com
http://www.goprob
Sonas argument is silly (Score:5, Insightful)
Meanwhile, the fastest airplane ever built is still the SR-71A made in the 1960's. That doesn't mean aircraft technology has come to a standstill. It just means outrunning the SR-71A hasn't been a priority of aircraft builders since then. If they wanted to expend the resources to make a faster plane today, they could do it.
Deep Blue II was the SR-71A of chess computers. What's come afterwards has been a lot more economical and practical, but hasn't tried to match it in pure performance, and hasn't done so.
empirical THIS (Score:2)
simon
Re:empirical THIS (Score:2)
Any questions?
So it can beat a human at chess. Big F'ing deal. (Score:2)
Ill be impressed when they have a computer that can beat me at chess, write a sonnet, cook up lunch, play fetch with a dog, ponder a sunset, drive a car, change a diaper, laugh at groucho marx, and wonder if it has a soul. Anything less is nothing but an overgrown calculatior. A nifty godd
Re:So it can beat a human at chess. Big F'ing deal (Score:2)
Chess Players have their opinions... (Score:2)
Man wins. (Score:2)
The man who makes the tool that beats the guy without the tool wins.
Guy with gun beats guy with sword, guy with sword beats man with fist. Man with fist beats armless dude.
Simple enough for you?
This isn't a question of man vs. machine. This is man vs. man.
The "machines" are created by man as a collection of chess knowledge and principle. Essentially they're chess by committee, a very fast, giant, and efficient committee, but a committee nonetheless. Flaws in their understanding of the game wi
Real AI (Score:2)
Re:Real AI (Score:3, Funny)
X's and O's (Score:2)
I mean, it is possible to end in a stalemate after all. Is it at least concievable that the only way to assure not losing is to simply create a cats game?
would this explain the large amounts of draws we are seeing here? Is it an eventuality that someday computer vs computer and computer vs man games will all end in stalemates?
Comments from a Competitve Chess Player (Score:5, Interesting)
I imagine the new breed of young GM's like Ponmariov, Grischuk and Malakhov probably find the prospect of beating stock Fritz/Junior/Hiarcs rather boring. A few extra CPU's isn't going to make a big difference in terms of playing power. Much more effective is to spend time tuning the engine's opening book and that takes traditional GM's with novelties.
Kasparov should win this easily, though he did miss a trivial 2 move combination in a tournament recently so you never know...
Computer improvement (Score:2)
Begin with the end, the endgame. The end of the endgame rather. This (the end of the endgame) the computer does play perfectly. It's skill keeps improving as the tables come out - three pieces left on the board, four pieces left on the board, five pieces, six pieces...and I see this continuing. So the computer is increasingly perfect in this respect.
Opening - the computer can't innovate yet (although
"No true human world champions" (Score:5, Insightful)
Machines have been outpacing humans in various endeavours for years. Eventually computers will be powerful enough and well programmed enough that they'll never lose (although they certainly will still draw).
Big deal. Either show me the sprinter who can beat a formula 1 or show me the movement to claim there are no longer human champions in speed. I don't see either of those, so I don't see why it should matter for a mental game.
I see no reason why we should care if computers can someday see all possible positions 35 moves out. Chess isn't about that. Chess is a game of reason, of insight, of spacial perception, of memory, of stamina (you try concentrating on one thing for 6 hours), and of emotion. Seeing forcing variations a dozen moves out is rarely part of the game for humans, and plenty of players have risen to the top of the game almost never calculating beyond 2 or 3 moves out. Giving a machine an 800HP engine and wheels takes absolutely nothing away from the human accomplishment of mastering the game.
Re:"No true human world champions" (Score:3, Insightful)
Machines can fly, move faster, lift more, work faster, and are even quite good in the sack.
The only thing left in which we humans can claim superiority is "smarts". So naturally people are going to have a strong emotional reaction when challenged in this last domain. Hell it happens every time we're challenged by machines, but this last domain is going to be the worst.
P
Discussion board + Deep Blue vs today's micros (Score:5, Interesting)
There has been a chess message board discussion [chessninja.com] where the author of the article mooted his ideas last week. I write for ChessBase and worked on both of the last big man-machine matches (Kramnik-Fritz 2002 and Kasparov-Junior 2003).
For those here who claiming obvious Deep Blue superiority over current micros because of how many chips it had and how many positions per second it looked at, some chess knowledge would help. Deep Blue only played six games and all have been analyzed to death. We know two things. One is that Deep Blue beat Kasparov and that's the only thing most people care about, the result. The other is that Deep Blue's play was far from perfect.
Years of human and computer analysis can about as close as you can to the truth in chess. With that knowledge we can compare Deep Blue's moves to those of the current top programs such as Fritz and Junior. And we have, extensively. The bottom line is that they play better in many places, the same in others, and worse only in very few. The overall level of play by the micros in the same positions from the Deep Blue games is better. With Deep Blue in pieces that is the only way to compare the quality of their chess. Positions per second is interesting and not irrelevant, but time marches on and knowledge is important too.
While the humans in these matches obviously have some interest in saying that the program they are playing is the strongest, hundreds of other analysts don't. And Kasparov and Kramnik aren't going to make fools of themselves by recommending moves that could be easily shown to be inferior.
Kasparov played some of the most inconsistent and nervous chess of his life in the pressure-cooker match against Deep Blue in 1997. He resigned in a drawn position for the only time in his career and Deep Blue's other win, in the final game, came in a total mental collapse by Kasparov and was the shortest loss of his career in a serious game. All credit to the Deep Blue team, mission accomplished and all that, but it wasn't the greatest chess.
Meanwhile, humans studied and learned. Kasparov's attempts to baffle Deep Blue by playing intentionally inferior moves was ill-advised. That era was over, he just didn't know it. But computers still have their weaknesses, as Kramnik showed in the first half of the Bahrain match.
The top programs today running on the fastest micro hardware available play better chess than Deep Blue '97. But the top humans play better, and smarter, against them than Kasparov did in 97.
Man v. machine? MACHINE. (Score:2)
Re:Man v. machine? MACHINE. (Score:3, Informative)
World's Strongest player?!? (Score:3, Funny)
Jeez. And I thought only skinny nerds played chess... but this Kasparov dude is not only ace chess player, but very strong too? What's he doing with the 'puter then? Smashing it to pieces with a well-placed sucker punch? I'd like to see him duke it out with Arnold!
Humans are still on top (Score:3, Interesting)
A human player may, in the same amount of time, only actually evaluate a few dozen board possibilities before making a single move, The human player can somehow eliminate even *considering* 99.9% of the possibilities, and even then the human often doesn't fair too badly, especially considering the odds against him.
Until computers can pull off this sort of "magic"*, no computer can ever be considered a match for a human player. It's no more astounding that a computer can occasionally (or even usually) beat a human at chess by considering more moves than a human player does than it is astounding that a pocket calculate can show you the value of pi to 8 decimal places with a single keystroke. That's not intelligence, just raw computation. Put another way, it's no more suprising than the fact that a heavyweight wrestler of lesser skill would have a good chance at being able to take down a more skilled featherweight.
* Clarke's law says any sufficiently advanced technology is indistinguishable from magic (and the corallory which says that magic is always indistinguishable from some sufficiently advanced technology).
Re:Humans are still on top (Score:3, Interesting)
What's the difference? Why is the ability to store large amounts of state in mind and do various forms of complex pattern matching intelligence, whereas the ability to look at many positions and calculate their value not?
Computers won't surpass humans (Score:3, Insightful)
And neither will they ever need more than 640K of RAM.
The problem with using empirical evidence is that it's dealing with then. This is now. In the future we will have quantum computers with enough storage space to calculate (or just lookup) a winning path from any possible position.
Computers will inevitably surpass meat brains. The real question is: when, and what sort of computer?
Re:slashdot == sexist (Score:3, Insightful)
Hypocrite
Re:slashdot == sexist (Score:2)
Hello?? (Score:2, Funny)
Oh no you din't!
Re:That term is sexist, too (Score:2)
perSONkind? perSONity? What kind of a sentient being are you? Try perCHILDkind instead.
Hey! (Score:2)
Re:slashdot == sexist (Score:2)
slashdot != sexist (Score:4, Insightful)
Name a few.
Any in the top ten?
Didn't think so.
More importantly, the article mentions a match against Kasparov, most certainly a male. Thus, although we can philosophically ponder the bigger question of "human vs machine", the title has no sexism involved, without even resorting to a discussion on the use of the masculine neutral in English.
Re:slashdot == sexist (Score:2)
Re:slashdot == sexist (Score:2, Informative)
Re:slashdot == sexist (Score:2)
Re:Face reality (Score:2)
So if these inventive women hid behind the male pawns who released their inventions, how do you know that the women were the inventors??
I'm not saying women can't or don't invent; I believe they can and do.
But where's your evidence? Did you go back in time and see the women inventing these great things? Did
Re:interesting (Score:2, Insightful)
And it just seems to me that humans couldn't make motor vehicles that run faster than a human itself...
Re: interesting (Score:2)
All you need for a winning chess-playing program is a board-position evaluator that's "good enough" and a virtual player that can simulate game continuations "far enough" ahead of the current game state. Within reason, limits on one o
Re:Philosophical reason why.. (Score:4, Funny)
Re:subject (Score:2)
On the other hand it might be about as interesting as watching a video game play itself in the arcade.