Human Interference In Computer Chess Championship? 34
migstradamus writes "In a twist with interesting implications for the computer chess world, the intervention of a human programmer and a human arbiter have had a decisive impact on the World Computer Chess Championship that finished today in Graz, Austria. What happens when a programmer acts against his creation's best interest? ChessBase has an eye-witness report on the dilemma. This year's event was already controversial due to the disqualification of one of the programs midway through for being derivative of an open source program."
why the need for operators? (Score:5, Insightful)
much easier, faster, you could have online competitions as well with the same system.
Re:why the need for operators? (Score:5, Insightful)
Tradition is probably the biggest impediment. Having humans making the moves on a real board, pressing a clock, and writing the moves down allow them to use regular arbiters and the human rules for the most part. That's how we ended up with the mess this year.
The rule in question about claiming a repetition draw BEFORE you make your move is just to make sure you confirm it's a draw on your own clock time. This makes sense for humans, but since a computer can detect repetitions trivially, enforcing that rule in a comp-comp event is like having a rule about no talking or eating at the board for them.
The uber comp-chess guys are splitting hairs about whether it was the GUI or the program itself that claimed the draw, and whether or not it actually claimed anything or was just pointing out that the repetition had occurred. This is mostly foolish because of course if the computer had seen anything better to play it wouldn't have repeated the position three times whether it was aware of the implications of the repetition or not. So any such repetition should be taken as a draw.
If the programmers want to add threefold repetition awareness, and most have, in order to use it for contempt purposes, that's great. (That way they can tell it to avoid repetitions against weaker opponents or in must-win situations unless the alternative is fatal. This is what we call the contempt setting.)
At the end of the day, the letter of the law was followed correctly. Because the machine did not follow the obsolete FIDE rules and claim the draw before making the move, the claim would have been disallowed no matter what the programmer wanted to do. (One hopes.) But the event highlights several weaknesses of using human rules in machine events and in letting operators interfere with programs at all.
Re:why the need for operators? (Score:3, Informative)
Actually the computer playing the white pieces (Shredder) was in a position that it evaluated as overwhelmingly better. Because of a bug in its programming, it didn't factor 3-fold repitition when it had a forced win. It had engaged in the repition in order to fully calculate all the way to mate. When
Re:why the need for operators? (Score:2)
The ICGA: A board of old imposters (Score:5, Interesting)
Dann Corbit had seen the source of a former version and he judged all as completely different to CRAFTY. Ulli Tuerke (COMET) say that the two progs are
totally different in their behaviour.
These imposters should imediately retire after this tournament. People like Bruce Moreland and other younger characters should lead the union of computerchess. Fritz Reul has his examins in mathematics this week so it is a crime to disturb him at his home.
What I find interesting is the following quote:
"The program List is suspected to be a clone of the program Crafty. Autor Fritz Reul failed to prove otherwise and allowed a final deadline to pass."
So apparently an author's reputation and integrity can be maligned on "suspicion." What is truly tragic is the "assumed guilty" posture of the accused. LIST was suspected to be a clone, and was disqualified because the author failed to prove otherwise. How incredibly unjust.
Furthermore, it does not appear that the ICGA followed thier own rule:
"Each program must be the original work of the entering developers. Programming teams whose code is derived from or including game-playing code written by others must name all other authors, or the source of such code, in their application details. programs which are discovered to be close derivatives of others (e.g., by playing nearly all moves the same), may be declared invalid by the Tournament Director after seeking expert advice. For this purpose a listing of all game-related code running on the system must be available on demand to the Tournament Director." [emphasis added]
LIST was only suspected of being a clone; it was not discovered to be a clone. The rule, as written, places the burden on the ICGA to prove it is a close derivate of another before disqualification; it does not place the burden on the accused to prove that it is not a derivative. Thus, the rule is inapplicable to the present situation.
The ICGA needs a procedure to follow in resolving these disputes. Apparently it has none, so it made a procedure up at the expense of an author's reputation. Furthermore, the ICGA has now possibly damaged the author's reputation beyond repair. Allegations of copyright infringement are serious concerns in the software community. Finally, the ICGA should have accommodated the accused author's schedule - is it too much to ask to give a person a small reprieve while he tends to examinations rather than publicly call into question the author's integrity in a worldwide publication on the Internet.
A public retraction is in order, and an apology.
Re:The ICGA: A board of old imposters (Score:5, Insightful)
But it does have one - the inspection of the code.
Fritz refused to permit the inspection of his code.
ICGA run this show, if Fritz doesn't play by their rules, he's out on his ear.
I thought the flexibility offered by the ICGA was perfectly respectable. Remember - this is in the _middle_ of a tournament, decisions need to be made sooner rather than later.
However, I respect Dann Corbit, from my exchanges with him in other fields and believe him to be honest and entirely trustworthy and professional.
So quite probably Fritz is _innocent_ of plagiarism, but _guilty_ of stubornness.
It is their show. Like it or lump it.
I'd like to know what would happen if he were now were to submit his full program source. Would the ICGA lift or shorten the ban? (He is still guilty of not following the expected protocol, after all.)
YAW.
Re:The ICGA: A board of old imposters (Score:1)
"Face your accuser", and all that.
Something 6th-amendment-like, for the US readers.
YAW.
LIST was disqualified, not Fritz (Score:2)
The List program (and programmer) were disqualified for being suspected of being a derivative program and subsequently not responding to requests to inspect his code.
Re:LIST was disqualified, not Fritz (Score:2, Informative)
A computer program cannot "refuse to permit the inspection of his code".
Computer programs cannot be "_innocent_ of plagiarism, but _guilty_ of stubornness".
It was evidently a human that was being talked about. A human who is called Fritz by dint of his name being, of all things, Fritz.
YAW.
Treat it as a bug... (Score:5, Insightful)
In the future, this just needs to be a requirement - the message box needs to say "I claim a draw - three repetitions". In addition, the program needs to be smart enough not to mention anything if a draw claim is available in a favorable position.
Re:Treat it as a bug... (Score:5, Insightful)
However, as some ambiguity does remain it's a good safeguard for the ICGA to specify a list of acceptable phrases that are to be taken to mean "claim a draw" (and thus direct instructions the hyuman may not decline to follow).
Using principles of human linguistics (if that's what people say when they mean X,then it means X) and looking at things in time order:
1) the stronger program had a crap bug.
2) the weaker program did actually draw first it notified the outside world that that state had occured.
3) the human driving it followed the protocol for making the TD aware of this.
4) the TD failed to understand the situation.
5) the human driver broke both the rules by not following the computer's instructions and protocol by continuing to play.
So all three parties went awry here.
However, there's nothing against the rules in having bugs, so the first place where something went wrong was the _TD_ dismissing the information he was given as not requiring immediate resolution.
However, the TDs have a very difficult job, and it's an unfortunate situation that's occured.
If I were on a committee (I am for other games with strict protocols, and by heck, we've had a lot worse than this in our time), in review I'd:
- award the draw to the computer that claimed it.
- admonish the player for breach of protocol. (perhaps disqualification for one tournament).
- get lots of feedback from all competing authors, the ICGA exists _for_ them, and must serve their common interests. Yes, rules (protocol) meeetings can be excedingly boring, but it's only when you thrash things out that you can reach conclusions.
- issue an unambiguous directive regarding ambiguous statements.
YAW.
Hmmm (Score:5, Interesting)
I think that's the important thing here - make it clear that the computer is responsible for the decision and there's no more silliness here. It's an unfortunate situation - and it arose purely due to unclear rules. I don't think anyone needs admonishment, and I think the resolution reached is fair enough to all parties.
They may also need a rule in place in the odd case that neither computer claims a draw in a repeating situation.
Re:Treat it as a bug... (Score:2)
In addition, the program needs to be smart enough not to mention anything if a draw claim is available in a favorable position.
If a draw claim is available (to your opponent), then you are by definition not in a favorable position.
Meh? (Score:3, Interesting)
The option to draw is only available to the person who has the move. Thus, it's quite possible that a draw claim is available while you are in a favorable position (and thus choose not to take it). In this situation, you'd also want to make it unavailable to your opponent's next turn by breaking the repetition.
See the regular FIDE rules for how this works.
Re:Meh? (Score:1)
Re:Treat it as a bug... (Score:2)
Jonny did not want to be sporting, Jonny wanted to win. Jonny saw the other program screw up and wanted to capitalize upon it. If there is to be no human interaction, then that means no human interaction. Jonny's handler did not abide by the rules. Sure, it was
You misunderstand... (Score:3, Interesting)
The bug was in Jonny's program - it identified a possible draw condition without being clear that it wanted to take the draw. While it may have been clear in this situation that taking the draw was the right move, there are many other situations when taking the draw is the wrong play. In my last post, which I'm not sure you read,
Re:You misunderstand... (Score:2)
Apparently the Shredder interface contained a bug which allowed it to repeat postitions in a totally winning position.
I was commmenting on the article, and my article seemed most at home under this thread. I put this bug akin to someone melting down towards the end of a match, either from fatigue or stress, and not being able to close the deal. That is the bug to which I was refering.
Creatively laying blame at the
Meh (Score:2)
I guess it is. But I think it's also a solution that works, and lets everyone move on with the actual point of the competition.
Not an Open Source Issue (Score:4, Informative)
The author also has failed to reveal his code to the committee despite several opportunities.
Re:Not an Open Source Issue (Score:1)
If you develop a simple program with high economic value, it is in your best interest to keep the methodology largely unknown. You are getting paid because you develop a timely answer to a problem with economic value. If your solution is easily repeatable, then you don't want your source floating around for others to inspect and in turn kill your "innovative" program by giving it away for free. I say simple becaus
What a patzer (Score:2)
My first reaction is one of disbelief. You can claim a draw in a (formerly) lost position, but you don't out of "respect" for the opponent? Why not resign right away?
I can't believe that guy is a good chess player himself. Only weak players do things like this, allow someone to move another piece after they took one in their hands to move it, etc...
Re:What a patzer (Score:1)
I agree that the programmer should have claimed the draw, and that not claiming it is not very different that resigning the game. However, your claim that only a weak player would do something like this could not be further from the truth.
While I have a pretty weak rating (1843 3 years ago, I've nto played tournaments since), I've played casual chess with expert chess players, rated over 2000 ELO points. While those people would not allow such a thing in a proper tournament, they'd have no problems with no
Re:What a patzer (Score:1)
Re:What a patzer (Score:2)
You understand very little about chess. Remember that players, computers or otherwise, put in an enormous effort to play at such high levels. The players a
Why does this matter... (Score:1, Funny)