Believable Stupidity In Game AI 378
Gamasutra is running a feature written by Mick West, co-founder of Neversoft, about creating game AI that is dumb enough to defeat, yet intelligent enough that its "mistakes" are similar to those a real player would make, thus preserving the illusion that the AI is not just throwing the game.
"The simplest way to introduce stupidity into AI is to reduce the amount of computation that it's allowed to perform. Chess AI generally performs billions of calculations when deciding what move to make. ... The problem with this approach is that it decreases the realism of the AI player. When you reduce the amount of computation, the AI will begin to make incredibly stupid mistakes — mistakes that are so stupid, no human would ever make them. The artificial nature of the game will then become apparent, which destroys the illusion of playing against a real opponent. ... By reducing the amount of computation, we create an AI opponent that is trying to win, but has been crippled in a way that leads to unrealistic gameplay."
Cheating AI (Score:5, Interesting)
Artificial Stupidity? (Score:2, Interesting)
Interesting thought (Score:4, Interesting)
So, basically, we have to determine how many "calculations per second" equivalent an average human can manage. Then we have to allow a range on either side of that since not everyone has the same capacity. Once we manage that, game AI would start being more realistic, huh?
Somehow I doubt it's that simplistic but still sort of interesting.
depends on the stupidity (Score:4, Interesting)
What I've always wanted to see is more scripted realism in games. For example, the Medal of Honor games worked much in the same way as a Disney theme ride with certain prescripted actions occuring when you passed by. Run across the field to the house, then the soldiers there will go through a scripted sequence of planning the next move, then they do so. You walk past the far side, a German tank triggers and comes crashing through at you. These are all nice starts. The original Aliens V. Predator game would have the human opponents freak out at random. You tear the head off of someone beside the soldier, he might drop his weapon and run screaming or start spraying the walls at random. And the most unsettling of all were the civilians who would run, cower and cringe away from you, the alien monster.
All of the above are tricks, not real intelligence but things that provide the illusion of intelligent agents engaging in realistic behavior. Critics will say the heavy scripting ruins the replay value because there's not as much room for variation and surprise but I think that it makes the games more interesting. Unfortunately, not many people go to the effort here.
I for one would love to see a shooter where I burst in on the room of baddies playing cards and see them fumble for their weapons, someone drops his, etc. It would be very realistic to have an enemy get the drop on you but his gun jams and he's left trying to clear it when you engage. As mentioned before, AVP created a sense of realism when the humans freaked out and started firing randomly.
When we get right down to it, players aren't looking to get their asses mercilessly beaten every time they play. Neither do they want a pushover opponent. Gamers want to win but they want to feel like they had to earn it. It's rarer to find gamers who want to push the working for it to masochistic levels but they do exist. They would be typified by Rogue fans. For those who don't know, Rogue is a dungeon crawler where you really should save your game except you can't except as a bookmark -- you can save it to come back later but if you die the previous save point is deliberately deleted. You have to beat the game in one go through.
The only other game I've encountered that masochistic is Escape Velocity Nova, a space exploration and trading game with a realism mode. You die in the game, you die for keeps, you have to start over. To its credit, it does offer a vastly different play style. For example, you want to hit a big pirate ship for max profits, you pick a world near where they spawn and land. Each time you launch local space reloads and a pirate might respawn nearby. You have maybe a one in ten chance of taking him as a lowly player but it's fun. You keep reloading and rolling the dice until you win and you get a nice haul. If you play it in hardcore mode, you have a vastly different approach to this sort of thing. For starters, you lose your ship and it's gone, you have to buy a new one. If you lose your escape pod, you're dead. You will take a vastly different approach tackling a monster like that when you risk losing hours of progress. This seems too much like work to me but some people love it. I think they're the same ones drawn to high-risk PVP games like EVE Online. I think it's a form of gambling addiction, the risk of possibly losing a lot of stuff and the thrill of making it through.
AI leaps and bounds? (Score:5, Interesting)
Year after year, I read these kind of articles that report how game AI increases in leaps and bounds...and I still don't see it. Bad guys in GTA still seem to rush towards grenades, Halo/Gears of War enemies are either completely impulsive or avoidant. I'm not knocking the programmers...I think game AI must be very difficult to achieve, and even harder to detect for the layman (such as myself).
Does anyone have an example of really good AI in action games (or any non-RPG, non-RTS games)?
Re:Believable AI (Score:4, Interesting)
Fritz has a sparring mode which does a little better than that. It will find a route that sets up a position where the player can force a win of a piece or a pawn. Essentially it sets up a tactical middle game puzzle live in the middle of a game.
The player doesn't know when it will do this or even if it will happen at all. But it is most likely to happen when the player puts the computer under pressure. This is great because it teaches the player to press the computer and coordinate pieces while also constantly keeping an eye out for the wins.
The whole chessmaster series features near-perfect play alternating with just flat out dropping pieces.
Even with Fritz though, "easy" mode is still well above beginner.
Limited attention and experience (Score:5, Interesting)
My first rule of game AI is that the computer should have access to the same information and controls as a human player. I hate games where the computer knows about your units and buildings that it hasn't scouted.
The big advantage that computers have is that they can micromanage every unit with 100% efficiency. One way to reduce skill could be to limit the amount of attention the computer can spend, maybe in the form of "actions per minute". For a game like poker that could be a limit on how precisely the computer player calculates odds. A more experienced human player has a better feel for the game, so a more skillful computer player could dig deeper into the nooks and crannies of probability.
A way that computers often act too stupid is not accounting for how their interactions with one player will influence other players who aren't directly involved. For example, in a three-way game the computer player might throw everything against the strongest player, weakening them both and letting the third player win. Humans have millions of years of instincts for dealing with such situations. So the game AI might need to precompute some game theory and adapt to opponent reactions over a series of many games. Then it could be dumbed down by reducing its use of that experience and acting more like a newbie human player.
Competing goals (Score:5, Interesting)
If you want an AI to make human like mistakes, you have to have at least a roughly human cognitive model. The simplest way to do this, it seems to me, is to give the AI competing goals. Rather than just have the AI "try to win", and then cripple its ability to do that effectively, you could give it multiple goals to strive toward, and then give it some degree of randomness in which goal it chooses to pursue. Victory vs. pain-avoidance, attack vs. finding time to recover, etc.
Re:Cheating AI (Score:5, Interesting)
The programmers of Fritz [a chess program] hit upon a solution that involved the AI deliberately setting up situations that the human player could exploit (with some thought) that would allow the human to gain a positional or piece advantage. Once the human player gained the advantage, the AI would resume trying to win.
It's so humiliating, isn't it? We can only win if the machines let us. I for one welcome...
Re:Cheating AI (Score:5, Interesting)
I think that's largely because AI is generally controlled as a group entity, so there is one main master pool of data that they get information from.
When what should be done, is that each AI is IAI or something, individual artificial intelligence, which can be done with object masking, and an analysis of what the AI can see in it's perspective camera, or it's range to a sound, instead of all players and sounds being a dot on a grid, with no regard for obstructions and range.
Little more on topic, I don't really mind figuring out how the AI is working, what I dislike, is like hard-coded faults, usually with waypointed bots in FPS type games, where they will always get stuck at the same spot on that same path. Because then I abuse it, i'll lead them there, wait for them to get stuck, and kill them... lotsa fun for 15 minutes, but the game gets really boring quickly, however I actually like the superhuman AI as long as they still have to abide by the rules I do (not shooting through walls I can't, etc), makes for great practice.
I generally don't play games for realism, but rather for the lack of it, I can't go out collecting coins from trees, or shooting my neighbours "really"... excluding racing/flying simulators, but usually they don't have much problems with realistic AI because of how many variables there are to "fuck with", most, if not all of which can happen in reality, sudden gust of wind, punctured tire, blown engine, etc, perhaps thats what humanoid AI games need, is more variables to be more realistic. Different eyesights, hearing, reaction times, strength, etc, etc, then slightly randomized variations on them during the same match, so that even a hard-coded fault in the AI wouldn't come to the exact same result, humans don't play by constants, why should AI.
Now that i'm rambling, I'll end with the fact that most games are multi-player now, so they spend more time working on the human interaction with the game, and the AI is just tossed in afterwards, probably carried over from v1.0, just so they can say it has that option, expecting people to want to play people. As a side note, maybe thats the logic behind some of them, make shitty AI, to try and force more people to buy+play the game so the game is useful.
Re:Deep Blue (Score:5, Interesting)
If this were a karate match, this would be the equivalent of the master having to fight someone he's never met before, but that person has studied the master's every move. Then, after the master wins the fight, he has to fight someone else who has studied his every move and acts differently. Not a fair fight.
Re:Believable AI (Score:3, Interesting)
Not exactly, the GP seems to be discussing a probabilistic system weighted against success. You'd only get dramatically stupid moves on a regular basis if all possible moves were weighted equally, if you weight the best moves the most and the worst moves the least then you will not get "dramatically stupid" outcomes very often.
AIs Hardly Ever Think Like People (Score:2, Interesting)
Having played many fighting games, and hundreds upon hundreds of hours of the Guilty Gear series in particular, I can safely state that this guy has no idea how people are trying to think in high-level gaming. Let me explain.
In high-level gameplay of things such as Guilty Gear, there are theoretically a huge number of choices that one could make at any given time. However, several of them are stupid as hell. Of those which aren't stupid as hell, there's a sort of weighted rock-paper-scissors game where you weigh the advantages and disadvantages of each move, along with whether or not your opponent should expect each move, given your previous gameplay.
Computer AI almost always chooses the safest move. Either that, or it deliberately chooses a bad move. Sure, this emulates bad play at lower levels of play, but that's when you can't even do a hadouken with 99.9% accuracy. People like that are bad at the game, and as you rise higher in skill you will stop making those mistakes.
For more information and better explanations than I could ever come up with, check out David Sirlin's website [sirlin.net].
Fight or Flight Mode (Score:1, Interesting)
I think that to act more human, AI characters behavior needs to be multilayered. Include modes such as:
-Transitional deer-in-headlights mode
-Panicky fight-or-flight mode
-Tactical aggressive
-Strategic defensive
-Ambush/Camping behavior
-Random/unexplainable/opportunistic urges
Re:Deep Blue (Score:1, Interesting)
In the AI research community, Deep Blue isn't even seen as interesting. It was all about "beat Kasparov", and contributed little (if anything) to the field of AI.
It just showed that if you had deep enough pockets you could buy hardware to do enough conventional AI calculations to compete on a search problem.
Re:AI leaps and bounds? (Score:4, Interesting)
The Half-life series has always been acclaimed for the AI.
I found Left 4 dead had excellent AI. The zombies rarely did things that didn't make sense, the only thing I can think of is when they climbed up on objects they didn't need to climb over.
It's not enemy AI, but Alyx from HL2 was pretty impressive. The zombies rarely did something stupid, but Alyx never did anything stupid. I'm sure I'm not the only one who formed a weird bond with the character by the end of Ep. 2
Re:No human would ever make them... (Score:4, Interesting)
A fullback's running assignment is one of the most conceptually easy AIs to write. Run in front of the RB and knock as many people down as possible before they get to the RB (or until the RB passes you). If they can make a reasonably sane QB AI, they should have no problem with a decent FB.
As far as monopoly, the Madden fullback AI was a Rhodes Scholar compared to the fullback logic in the 2K games. At least the Madden FB doesn't go running off to the other side of the field based on how the D is stacked. And don't get me started on NCAA 2K2's misuse of the word "flex." Flex is not a damn blitz! Flex LBs are supposed to sit back and plug holes, not free-for-all the QB. And that's coming from someone who preferred the 2k series.
Impatience (Score:3, Interesting)
Isn't that sort of the same thing as limiting the number of calculations? In this case limiting the calculations would replicate the stupid moves that I (as a human/meat popsicle) would make, assuming that the order in which the computer evaluated possible moves was decided using more or less the same set or priorities that I would use (which are also probably stupid).
So the trick to coming up with a "realistic" AI opponent for chess might be more about figuring out how a human surveys the board and in what order they evaluate the moves. You can replicate the behaviour of dumb humans (like me) just by cutting off the evaluation at some very early point and scale up the difficulty by extending it.
Re:Cheating AI (Score:5, Interesting)
FC2 was notorious for the enemies ability to see you through anything, they clearly didn't even attempt to solve the perfect aim / x-ray vision problem.
The best shooter in this regard is Crysis. The enemy AI can only see you over long distances if they happen to look in your direction through either binoculars or a scope and if you can't see them they can't see you, even through bushes.
Gran Turismo 2 had this (Score:4, Interesting)
It used to have hilarious consequences as AI cars behind the spinning-out-of-control AI car would crash into it, deflecting and causing a complete pile up.
This gameplay felt realistic because this is what happens when cars are travelling at high speed in close formation.
Newer versions of Gran Turismo on the Playstation 3 - have way more computation cycles and so the AI cars now drive a whole lot better and never seem to crash. Sure they take different lines into corners and so on - but they don't completely bollox it up like the human drivers often do. It has made the game pretty infuriating because it has taken a randomness factor out of the game.
Re:Deep Blue (Score:4, Interesting)
i'm not involved into any of these activities, but i know Kasparov as a great mind and chess player because big blue won against him.
and thats probably what the history will remind us.
Eventually, a human would have been beaten anyway.
Or: measure a persons "gaming intelligence" (Score:3, Interesting)
Once you have that, you could start giving games meaningful measures of difficulty: such as "This game is suited to players with a GI greater than 80"
It would then be interesting, if not useful, to see how people's G.I. varied, and if their GIs correlated (or negatively correlated) to any other metric, such as SAT scores. Even better, you could determine people's personalities by how their GI changed with different types of game.
You never know, this might put the social "sciences" on the brink of coming up with objective, measurable and relevant data
Re:Believable AI (Score:2, Interesting)
There are many variables that determine how successful someone is in taking a shot. I could see a game having a simple database with records for each AI character. It could hold values ranging from the very basic and universal (avg # hours this character spends in target practice/week, how much sleep did they get last night, how long have they been awake, etc.) to more "fringe" variables (excessive coffee drinker, drug user, hangover from last night, laser-targeted sights in use, etc.). All of those could count toward their base accuracy/reaction time.
Add into that more variables based upon the current situation. There was a spy RPG many years ago (can't remember the name)that took into account how you were positioned when you took the shot. Your accuracy started at a base number and then dropped as you went from prone to kneeling to standing to running. +acc for steadying yourself against a structure was also a factor.
From there you could get use the db to get into the "personalities" of each AI opponent. A coffee drinker who didn't get his cup that morning might be in a nastier mood and walk over and shoot you in the face once your down. A timid variable might mean a bot who hides behind a wall waiting until you pass to put a bullet through your head than one who runs out of a darkened doorway, guns blazing. Ammo count and readily available supplies could also be taken into account.
Re:depends on the stupidity (Score:3, Interesting)
I think a set of possible scripts would actually make things more realistic. In reality a team goes according to script. They might have contingency plans. The more trained and prepared the more contingency plans and the more they will follow those plans. I would expect the SAS to be much more accurate when everything goes wrong than the common soldier. The less trained and prepared the less contingency plans and the more they will panic and deviate from the plan when things go wrong. I think a good selection of scripted reactions which can be limited to approximate lack of training, and higher "under pressure" accuracy could enhance realism.
Re:Deep Blue (Score:1, Interesting)
I guess so, maybe in a way, but it's not like people are saying, "Kasparov, what an idiot!" It only looked bad for the humans-will-always-be-better PoV, without really reflecting on Kasparov individually. The man didn't lose any esteem over this, or at least shouldn't have.
Oh, and perhaps a motivation in his favor would be curiosity. It's just plain interesting that a computer was eventually able to win.
Re:AI leaps and bounds? (Score:1, Interesting)
alyx is highly script-driven. also more-or-less invulnerable and has infinite ammo..
but she's hot, yeah :)
Re:Deep Blue (Score:5, Interesting)
Re:Easy solution (Score:5, Interesting)
Bah. It depresses me how bad the AI still is in FPS games after I made my own bots for CS years ago (when I didn't have a decent internet connection - when I got broadband I stopped making the bots). My bots had different personalities, can't remember if you specifically had to specify rusher/camper/whatever or if it was just a certain courage level, but you could specify obedience level (for responding to radio commands), weapon preferences, ability to use grenades, aiming skill (higher skill levels would use more controllerd fire and be more likely to HS you on the first shot, while lower ones would start at about chest level then just spray and pray), whether they were able to look sideways to check for enemies down side alleys as they were running along a path etc, all per bot so you could create awesome bots (modelled on myself and my friends :P), and noobs, etc. In the last incarnation they were starting to pick up knowledge of stuff like where they had killed enemies or died themselves which affected their 'courage' and how likely they were to start sneaking around or rushing (made a big difference because you can't hear walking enemies in CS and the bots respected that). Those were the days.. AI is fun, at least for games like Counter-Strike.. it's not quite so much fun for stuff like board games..
If anyone still has CS 1.5 and wants to try them out they're called TEAMbot and one of the last releases is still up at http://www.planethalflife.com/teambot [planethalflife.com] . I probably still have the latest version of the source on one of my old HDs..
Re:Believable AI (Score:3, Interesting)
he computer *always* knows exactly where you are and can make a perfect shot if it wants to
Not all games behave this way. It's certainly the easiest way to do it, but some games will look at each mob and try to determine what actions they will take based on realistically available conditions. This is tricky to do well because it's hard to code in the ability to act sensibly when searching for you, or to try to guess where you are based on previous information. (he ran around that corner. Maybe he's waiting just around the corner, or maybe he's flanking me, or maybe he's heading toward the objective while trying to stay out of my sight?
it's annoying to be playing a game and see on the radar all the mobs are taking the most direct route to your position. And then when something happens that blocks their route, (you hit a switch to close a door, or climb a ladder they can't climb, etc) they all as a group instantly head in a new direction, the new shortest possible path to get to you, without having any chance of seeing what happened to block their prior path.
Re:Interesting thought (Score:3, Interesting)
I think it may be more a case of where you KNOW what isn't a good idea even if you can't see far enough ahead to judge it for certain.
For example, in chess, you see very new (young in particular) players take out their queen soon and try to run around with it, expecting the most powerful piece to be a sure weapon to wreck havoc with. This quickly leads to a 'queen hunt' on behalf of the opponent, who while harassing the queen, develops a dozen pieces on the board before cornering or chasing away the queen, leaving the hunter in a tactically very superior position.
A computer can't see why this is a folly without looking many moves in advance. So they have "book openings" to pick from to start with a strong position, and have special exceptions coded in that protect them from attempting things like hauling out the queen early that are known to be a bad idea. But beyond that it's very hard for the computer to see "that's probably not a good idea" without researching it thoroughly. So if you cripple its lookahead, it has little foresight, and limited "common sense".
Chess is just an example here (tho an oft used one in this thread I see) but apples well to many other games.
Re:Cheating AI (Score:5, Interesting)
Really? I found that enemies tended to spray their fire more wildly when I disappeared into the bushes, then I would just turn on stealth and dash across open ground to alternative cover. From there it was generally a case of watching them circle in on empty ground and tossing in a grenade when they were all bunched up in my previous position! I rate it as the best AI I've seen in any FPS.
They had scarily accurate aim even across long distances but I didn't find that too unrealistic: the enemies were all trained soldiers. Except the aliens. Crysis would've been far better without aliens.
Re:AI leaps and bounds? (Score:4, Interesting)
Does anyone have an example of really good AI in action games (or any non-RPG, non-RTS games)?
The AI in the first Half-Life was pretty good, I thought. Especially for the era. There were AI creatures that, once they saw you, would run to the rest of their group so they could attack in greater numbers. IIRC, other AI would behave a certain way (i.e. aggressive) until their health dropped too low, then would act in another way (i.e. defensive, even retreating.) It was very believable with the non-human creatures (the sonic dog-things) and not too bad with the enemy soldiers. I think the soldiers had certain logic, where if they had a reasonably good shot at you, they took it - otherwise, they'd reposition to get a better angle. Net effect: in certain areas, you'd have two soldiers laying down "covering fire" while two others ran around the corner to flank you. I was surprised by that the first few times it happened; very decent AI.
I'm re-playing Killzone 2 right now. The first play-through, I thought the AI wasn't too bad. The second time through, I realized that the AI had a different behavior when you were more than a certain distance away vs. closer. So on my second time through the game, I ran up to a lot of Helghast and used the knife on them (there's a trophy for that, anyway.) If you can get close enough without taking too much damage, it's easy because the AI takes about half a second to switch to the other "mode", during which time it has stopped shooting. That's the opportunity to strike. (Yes, this kind of kills re-play value.)
Re:Cheating AI (Score:4, Interesting)
I would agree - to a degree. To me, an AI should be as smart as possible (even if superhumanly so - if I wanted a human opponent, I'd go to a gaming club), but should do so on no more information than a human player would have. Thus, you should not have one side play in a "fog of war" and the other be given a full-information scenario. That doesn't cut it.
But within the constraint of equally limited data, I have no objection to the computer throwing every clock-cycle it has into trying to beat me. I'd prefer it. Game AIs are frequently dumb to the point of being pointless.
One wargame I used to play was "Crusade in Europe". I found out that if you bombed the enemy supply depots and just sat on the beaches of Normandy, the AI's forces would all starve to death. I successfully won World War 2 from the D-Day landings onwards with under 500 casualties. I wish to argue that this should be impossible, no matter HOW good the human player is.
Sure, players want to win. That's natural. But they should win because they're good enough to win, not because the AI lets them, even if the AI is sneaky enough to not make it obvious that it's letting them win. Games should be hard. It took me almost a year to reach the top rank in BBC Elite. Had the AI been half-way competent, it should have taken me longer. Games that are completed and disposed of in a fortnight aren't worth the money to buy or the effort to write.
Re:Cheating AI (Score:4, Interesting)
Your mention of racing games makes me recall this racing game I was playing when I was a kid on an Atari ST called Hard Drivin' (IIRC) and I was almost beating the AI when we came up to the draw bridge jump. It was basically a ramp that automatically raised and lowered itself in a cycle, with a large tower in the middle. If you hit it when it was too low you smashed into the tower. If you hit it too high you'd overshoot the track, because right after the other side of the tower was a hard left turn. I could tell the AI was going to hit the jump at the wrong point and overshoot the whole thing, while I was going to hit it perfectly. So when I get to the other side I'm really ecstatic as I watch the shadow of the other car pass over me. I start to get less so when the shadow turns to the left and the AI car lands right in front of me, like nothing special had happened!
Re:Deep Blue (Score:1, Interesting)
Why did Kasparov agree to compete under those circumstances?
Money. $500,000 just for playing, with an additional $200,000 for loosing or $300,000 for winning.
Re:Here's what I'd like (Score:3, Interesting)
My suggestion: An AI should be coded as a bot, within the constraints given to the player. If the player can only see a part of the battlefield (like in Starcraft) then the AI should have the same limit and need adjust its own viewport to gain awareness of an area. It should also be limited by the fog of war, and lack the ability to see out of the back of its head. To put in another way, a fair Starcraft AI would be one implemented with a camera pointed at the screen, controlling only the keyboard and mouse inputs.
While this is a very good idea, it's very difficult to implement well, and it's been tried plenty of times. I've played games that attempted that, but as a result were very easy to beat. For example, you could start an attack on three fronts, and the AI would ignore all but the top two threats, and the third front would just walk all over them. Every single time.
The fog of war is usually done by a simple radius check. if you are running from something and you are faster, once you get more than 1.5 screens away, you can see on your radar they immediately break off the attack and go regroup. Or you know the exact limit of how far away you can build your forward base that they won't "see" it and come maul you while you're digging in.
Though I 100% agree that the computer's unlimited ability to micromanage is the one reason I can't stand playing RTS against computers. I can't micromanage anyway, so I still get tooled by real players, but against the computer it's totally futile. I think the computer should be limited in where it can make changes. As in, it can change its "focus" every 20 seconds, and during that time can only make changes within that screen-size area. That's how humans are restricted for the most part. If they want to know where other units are, they have two choices: rely on memory of thins they've seen or they need to invest one of their 20 second slots in "reviewing" things before they can pick a new area to focus on.
Re:AI leaps and bounds? (Score:4, Interesting)
Does anyone have an example of really good AI in action games (or any non-RPG, non-RTS games)?
I really liked the AI in the Thief 1 & 2 games (never played Thief 3.) Very believable, added a certain dimension to the game.
Guards would sort of tool around the place, doing their rounds. If you hadn't been discovered, they were not very attentive (you might believe they were just bored with the routine.) If they heard you make a noise, they entered a higher level of alertness, became more suspicious. Their posture would change as they snooped around, looking for what caused the noise. You had to be really well-hidden for them not to find you. If you made any more noise, they went towards that. Make a lot of noise, or show yourself, and they entered full-alert and came charging. You were pretty much screwed if you found yourself trapped in a semi-dark corner on marble tile when guards were around.
If a suspicious guard didn't find anything, then he would (after a long while) go back to the lower alert level, and just go about his day. But I don't remember that guards, once they actually saw you, ever went back to just doing a normal, unaware patrol.
(Did suspicious guards "infect" nearby guards, causing them to become suspicious for a certain time? Maybe someone here will remember.)
Guards alsowent into higher alert automatically if they came across an unconscious body. So you always had to be careful about stashing the body(ies) when you coshed someone.
It would have been much better if guards responded to torches going out, or moss suddenly appearing in a room, or an arrow sticking out of a post, or a door left open. Even a simple acknowledgment "hmm, I thought that torch was lit before... must have gone out" would have been more realistic.
But generally, I thought the AI in Thief was pretty well done.
Truly realistic (Score:4, Interesting)
Take poker for example. We have a standard bias of "unknown = 50%". This actually works pretty well for cases where information is not known. To make the winning software programs, they basically program in the rules that a human expert knows to be true. It is NOT that hard to instead program in a bunch of rules that a human FOOL 'knows' to be true. Just find some bad poker players and ask them what they do in certain circumstances.
-------------- Similarly, the pool game could be made more realistic. I noticed the first thing he did was have the computer select the highest possible point scorign shot, ignoring banking a shot unless it is set to super-expert. That is NOT what humans do. Bad pool players pick the EASIEST shot - i.e. the one that is most straight on and least distance. (I know, I am a bad pool player). As you get better, you raise your standards about what you think you can hit. So a moderate player looks among all the shots he thinks he can hit and takes the highest point one of that.
Re:Believable AI (Score:3, Interesting)
it's like once your cover is broken it's broken
I hate that. Some are better than others - the original Far Cry wasn't too bad, you could hide out for a while and watch the soldiers beat the bushes fruitlessly, but they were always jumpy after that, especially the sniper in a guard tower two miles away who could see you no matter where you were in the bushes.
I have also found STALKER: Shadows of Chernobyl with the Oblivion Lost mod running has pretty believable AI patterns, the enemies usually can't see you if you can't see them and you can evade them, sneak around them and set traps for them. Enemy factions fight each other, mutants fight soldiers and you can sit back and watch and loot corpses afterwards. But once again, every once in a while you get a supernatural sharpshooter who can hit you with that pistol from two blocks away. The mod also introduces some really strange spawning issues - getting killed by a horde of mutants the second you load a new area really sucks.
On the flip side, games programmed for stealth can result in a hilarious breakdown in NPC programming patterns when you don't sneak. I really enjoyed Thief: Deadly Shadows but the game is just awful if you're not playing as a hardcore thief. Once your cover is blown, it's blown. And if you defend yourself, God help you. They can see you in the dark, people freak out in the streets when they see any dead bodies and sometimes they start fighting each other or humping the wall. And sometimes the enemies had Daredevil hearing, other times you could jump on their heads and they wouldn't even notice you.
Re:Here's what I'd like (Score:3, Interesting)
That's just a bad implementation. There's no reason why an AI couldn't ocassionally spend a while to look at its territory. Also, the human player usually has a map, and notifications (like an unit popping up to report "We're under attack!"). It's fair to have the AI have access to that as well.
That's not fog of war, it's just a limit on how far they'll pursue you. And it makes perfect sense too. Otherwise it's trivial to exploit. Take a fast unit, drive it to the enemy base, get a tank or two to pursue you to your base, where they get pummeled by the base defense. Do that a few times, and the enemy is 10 tanks down.
The game that came closest to my ideal of what a RTS should be like is Total Annihilation (haven't tried Supreme Commander, so can't compare). The sheer amount of automation you have access to (waypoints, automated production, patrolling aircraft, automatic base repair) and long range defense means that achieving parity with the AI is perfectly possible.
The only problem is that the AI turns out to be too weak. Once you've got a good base going, finding ways to gain advantage is easy. But it seemed to be a step in the right direction.
Re:Cheating AI (Score:3, Interesting)
Crysis is definitely worth playing. It's just a glorified corridor shooter designed to sell the CryEngine but the corridors are wide bits of jungle that give you a reasonable degree of freedom. Except the alien bits, they suck. Try to pretend everything after meeting the aliens isn't really happening.
That the AI does a reasonable job of responding to how you're playing the game without the use of supernatural powers is what makes it fun. I originally pirated it after its release just to see if would run at acceptable settings on the gfx card I was using at the time (Hint to Crytek - I think most people who torrented and didn't buy were doing the same). I reached a certain point (the beach-head mission where you have to destroy the AA guns) and it slowed down to a crawl.
I bought both Crysis & Warhead on Steam shortly after upgrading my card and was surprised that enemies really did act differently on different playthroughs. In my first play I was trying to avoid combat (mainly due to frame-rate) but on my second I went in more gung-ho. This increased the number of enemy patrols I encountered further down the line; the KPA were clearly on a higher state of alert.
I pretty much agree with those criticism of FC2. I didn't think the checkpoints were quite that bad however - The most fun thing in FC2 is navigating across the map whilst avoiding checkpoints. The best way to do it is to use the rivers and just hurtle past the checkpoints. By the time they start shooting you're already well away!
Re:Competing goals (Score:3, Interesting)
"you could give it multiple goals to strive toward, and then give it some degree of randomness in which goal it chooses to pursue. Victory vs. pain-avoidance, attack vs. finding time to recover, etc."
That strategy would still create bot-like behavior; programmed correctly, a bot will find an "ideal" solution to a constrained problem. This isn't how humans work. Humans aren't just random number generators attached to optimizers. In fact, the score function of the typical game engine (like chess) works almost exactly as you describe and often creates very un-human like behavior. I believe many first-person shooter bots also use similar goals to poor results.
Re:Believable AI (Score:4, Interesting)
As far as Thief goes, you have to admit at least that it was very good for the time. Making it hard to win in a fair fight made sense for the game, especially since it was one of the first sneaker games, and they kind of had to smack you over the head to let you know that you weren't supposed to run-and-gun through the game. If you didn't want to sneak, then you simply picked the wrong game.
Also, I was remembering Thief as a game that rightly didn't follow the "once your cover is broken, it's broken" thing. It was more like, if they saw you, you couldn't simply run into the nearest shadow and be safe. You had to evade them first, sufficiently that they wouldn't particularly know where you were, and then hide in the shadow. The effect wasn't perfect, but certainly you could get back into hiding after being discovered without killing the person who saw you.
I don't know what I'd think of Thief if I played it now, but at the time, it did seem to be some of the most interesting AI in a FPS, if only for how limited the enemies' knowledge was.
Re:Cheating AI (Score:4, Interesting)
Customizing AI in the original Unreal Tournament was pretty amazing. You could specify different attributes like accuracy, and even specify favorite weapons. Using that, you could set up the bots so that you might be facing twelve "Brosephs" running around with rocket launchers, but you know true fear if you see "Will Hunting" coming at you.
Artificial Stupidity. (Score:3, Interesting)
It's interesting that in order to create better AI, we need to create Artificial Stupidity. Some would argue that is already all around us.
Re:Believable AI (Score:3, Interesting)
I totally agree with you, for the time the first Thief was great. I think the AI was actually better than the one I was referring to, Thief Deadly Shadows, third in the series (which used some form of the Unreal engine, probably a reason for some of its AI issues).
In fact, the first game is still good, even if the graphics are on the ugly side, the play quality makes up for it. It consistently follows its own rules, and like you say, it is possible to elude guards chasing you without killing them. In Thief 3 this is also possible, but there was far more glitchy behaviour than in the first two games.
Re:Believable AI (Score:3, Interesting)
I'll try to keep this on topic.
That would be great if the folks from Looking Glass Studios could get back together for another Thief game. The team was great at creating an atmosphere and NPCs and enemies that responded in believable ways, I'm sure if you looked closely at the programming and responses in Thief 1 they would be more primitive than, say, Far Cry, but they hold up even now because their responses were consistent and believable. Shoot out a candle you'd get "hmm, that's odd" but start doing too much at once and they would start getting suspicious. At least, that's the way it appeared while I was playing it, so they succeeded in making a believable "stupid" AI. The enemies in System Shock 2 (another Looking Glass game) were just as good, it freaked me out listening to the service droid blabbing away while it stalked me in the storage room, looking for an opening to run at me and explode. And who can forget the ninjabots. Scary, sneaky dudes.
I admit I liked Thief 3 (come on, shooting guys in the face with moss arrows was cool), it was great as long as you played it on the hardest setting (so the missions and sub-missions and crap you would find and NPC comments would actually make sense) and as long as you didn't start fights in the street. That's when the AI would break down.
Re:Easy solution (Score:3, Interesting)
One of the best AI examples I've played against was a quakeC bot written to learn just as a player would. The bots had no knowledge of the map nor any information beyond what a human player could garner, but they learned everything they were exposed to. So the first encounter was an easy kill. Later encounters became progressively more difficult as they learned to avoid your fire and learned to anticipate your dodges. In the end, they would memorize all ammo and health spawn points and times such that you could never defeat them as they would starve you out if you were good enough to go toe-to-toe in a firefight.
The same AI applied to the enemies in the regular quake game resulted in the best (and least fair) enemy ever. The first guy I failed to kill ran away and got help. I didn't see any enemies again until they had me surrounded by all of the enemies on the level. It was brilliant. And unfair, and undefeatable. Still, watching them learn how to defeat me was pretty interesting.
That also points out the problem with FPS AI. If they really had any degree of intelligence, they'd duck for cover and call in backup and you'd get pinned down pretty quick.
Re:Deep Blue (Score:3, Interesting)
He probably enjoys a real challenge? Also the reason why he went into politics and placed his life on the line against thugs?
Re:Believable AI (Score:3, Interesting)
What I didn't see discussed in the article is the alternative of not increasing the AI and exploring deeper paths in order to choose a weaker move, but to, you know, actually change the algorithm to match how a human would arrive at an action.
For example, in the case of a FPS, instead of having perfect accuracy and omniscient awareness of every opponent, the computer could use search algorithms to look in front, up to a reasonably human visual range, taking into consideration any obstacles in the way which will affect the computation. This way, the AI player is not artificially ignoring opponents behind walls and bushes (while tracking every single one of them), but is instead realistically not even aware of them--just like a human would not be aware of opponents hiding in the environment.
As for the accuracy, it could certainly be affected by random probabilities (like occurs in real life), but also by other environmental and stress factors. For instance, if the AI player is a sniper in hiding, and it seems apparent that the opponent hasn't become aware of them, then they have a natural advantage. But if they are in the open, and running, their accuracy should be affected negatively. Also, if the opponent happens to be farther away, or slightly masked by environmental obstacles, or moving fast, this should decrease the accuracy.
I know that I get very frustrated when I play games that give the appearance of perfect awareness of the environment, even when they don't really. As the article mentions, even when the computer opponent gains an advantage by pure chance, any previous appearance of omniscience adds up and distracts from the illusion of "humanity" or fallibility. It just does not seem like a fair challenge. It also feels rather stupid when the AI has been artificially crippled and then compensated by pure brute force; like when you get attacked by a few gazillion zombies at once, any one of which being insanely boneheaded in its individual moves, but all of them running towards you simultenously, giving you little chance to aim or escape.
-dZ.