Game Reviews Don't Matter, Study Finds 94
Next Generation has an article up looking at a report from SIG, on the correlation between game reviews and sales. Their findings indicate that, while reviews obviously do have some effect on games sold, there just isn't that much of a correlation. From the article: "He said he doubted that publishers and PRs would stop caring about review scores, especially as they matter a lot with consumers who compare games from the same sub-genre — say, basketball games. But he said that, as with last year's report, the report's findings are unlikely to be popular. 'We received a lot of attention but the stats do not lie,' he said."
I read reviews as an afterthought (Score:5, Interesting)
Re: (Score:2, Informative)
I usually read the reviews before buying, but it has very little impact on whether or not I'm going to get the game. The only exception I can think of would be for games I've never heard of. For example: I didn't follow the release of 'Shadow of the Colossus', I'd never heard of it before reading reviews, and the reviews made me want to go out and play it.
They can throw whatever horrible review they want at it, but the fact is I'm fairly certain I'm going to purchase 'Final Fantasy XII' anyway.
Re: (Score:2)
I used to make exceptions and buy certain games as soon as they came out... but they're not as important to me anymore, so I'm still holding off on
Re: (Score:2)
Re: (Score:2)
Fileplanet is the worst of this crew.
The worst part about this whole self-perpetuating scam is that in many publisher contracts, developer bonuses are specifically linked to their games recieving good reviews on gamerankings.c
Re: (Score:2)
FFXII has gotten some good reviews, too, especially in Japan. Famitsu gave it a perfect 40. Also, a good reviewer will give enough detail that you'll be able to figure out if you'd like the game even if the reviewer doesn't (or vice versa). I generally read a lot of reviews before buying a game to figure out if it's worth $50. I don't want to buy another X-2.
Studies don't matter, game review finds (Score:4, Funny)
Nowadays... (Score:2)
...I tend to identify quality with specific companies. For example, anything Nintendo cranks out is worth a look, especially in their long-running franchises. Anything Valve Software releases is in my Steam list purchased the day of release, if not preloaded before then.
Of course for those games that don't have this advantage, the best way is simply based on word-of-mouth and also watching the game being played.
Pre-release hype (Score:2, Insightful)
Seems like a "no shit" to me (Score:3, Insightful)
There's a hardcore segment out there that scrutinizes every scrap of information, for sure, but most games are still purchased by Grandma and Grandpa for little Joey because of the title, genre, or franchise, not because of an aggregate score somewhere in cyberspace.
Re: (Score:2, Interesting)
Re: (Score:1)
Re: (Score:2)
Re: (Score:1)
The reviewers were wrong about Enter the Matrix. At least the PC version. The game is a good game, the only thing wrong with it is that you can literally beat it in a 3 hour sitting. I still replayed it a couple times.
I just wanted to give my 2 cents. And, incidentally, I'm not a green gamer; I play all genres of games (MMOs, FPSs, RTSs, Puzzlers ... etc) on consoles and on the PC.
marketing (Score:5, Insightful)
sucky games (dirge of cerberus) do well with good marketing (commercials, ads, et. al.). good games with little/no marketing don't usually do nearly as well (not that they don't do well at all, just that they lose some of their potential).
a large enough portion of the market doesn't read reviews and bases their purchases off of the "coolness" factor of the game, instead of the quality. if a commercial or ad can make the game look cool, then they're all over it.
Re: (Score:1)
But this only works right at release. After that, word of mouth pretty much decides the fate of the product.
Look at movies for instance. Almost every movie ends up with a commercial that goes something like "#1 [genre] in the country!". This is because they hype the movie heavily before it comes out all with hopes of getting their big opening weekend. After that, word of mouth will either keep the
Re: (Score:2)
They do not lie (Score:4, Insightful)
What was that saying again? Something about lies, damn lies, and statistics?
Re: (Score:1)
Re: (Score:1)
KFG
Re: (Score:3, Funny)
(That is, "70% of murderers hate their mothers" is not useful unless you know the definition of "murderer", the definition of "hate", even the definition of "mother" (would a step-mother who raised the murderer since he was two be a "mother"?), and how they were sampled. Even in this simple example, you can see why statis
Judging from website comments, I have to disagree (Score:3, Insightful)
Sales != A good quality game (Score:5, Insightful)
It said nothing about reviews (written by magazines, etc) versus consumer opinions (or user reviews). It also said nothing about consumer opinions versus sales.
In my experience, reviews written by reviewers generally align pretty well with what consumers think of the game, while sales have little to do with either. In short, sales seem to have little to do with how good a game actually is. Sales seem to correlate more with things like movie and cartoon and brand tie-ins to a game, distribution methods, price point, and other such factors. All of this is really no big surprise, since the game industry has always successfully relied on churning out such drivel and it has obviously worked pretty well for them most of the time.
A more interesting thing to study would be what percentage of sales are purchases made by people who know nothing about games and won't be playing the games themselves... such as parents and grandparents choosing games as gifts for kids, etc. I bet they make up more than 50% of sales.
Remember when the Atari era went bust and the bottom of the video games market completely dropped out? My theory is that it was because the industry stopped creating any good-quality games, having realized from experience that they could just produce well-branded crap and rely on all those gullible non-gamer sales. I think the problem is that when the market floods with crap, the gamers (who ultimately receive those games from the purchasers) completely lose interest in games and stop asking their parents to buy them more. So then the purchasers stop buying completely.
In other words, a sufficient minority of titles must continue to be of good quality for the industry to sustain itself, but once that sufficient minority is met, the rest can be crap and the industry can thrive off the crap. The industry then foolishly thinks all it needs to produce is the crap, which kills demand completely, which kills the whole industry.
Re: (Score:2)
Re: (Score:1)
Incorrect (Score:5, Interesting)
If you want a list of things that a good review should look for, all you have to do is find lists of Cliches [project-apollo.net] and reviews that make note of them. There are similar lists for strategy and action games - but common components among all such lists involve being railroaded through events outside of the players control (e.g. is captured by 3 units after taking out 2000 soldiers), or events that are obvious enough to be traps but the player is forced to go through them to advance the plot.
Absolutely (Score:1)
some reviews I wish I had read (Score:1)
I think these days you have two groups of people
1) buy games the day they come out because they have for
Well duh. (Score:5, Insightful)
Hell, the article doesn't even say that there isn't a correlation between good reviews and good games, just that it's not a reliable predictor of sales. Well duh. Maybe things like number of consoles in the market for that game, or marketing, or whether its a sequal, or the price, or whether it's released in May or during the holiday season, might all play a role.
We expect that the same game with good reviews will perform better than that same game with poor reviews. The article confirms that expectation, while trying to sound like it's conclusion is surprising. It's not.
Some people will buy a Pokemon game no matter how bad the review is. This is obvious. Doing a study that confirms it doesn't change that it's obvious and your study is just an excuse to fill some pages under the guise of 'news'.
Re: (Score:2)
traumatic experience makes me read reviews always (Score:3, Interesting)
Re:traumatic experience makes me read reviews alwa (Score:1)
The first and last game I ever pre-ordered. Horribly scarred for life. And just for perspective, I'm 35 years old.
Re: (Score:2)
Re:traumatic experience makes me read reviews alwa (Score:2)
One gigantic red flag is if they ever say anything to the general effect that the new release will appeal to a "Wider Audience". That is the kiss-of-death for a sequal to beloved game. The more you love a game, the m
Reviews Prevent Me From Buying (Score:3, Interesting)
I don't buy many games (mostly I rent because most games are worth the $$$). If I REALLY want a game (New Mario, Guitar Hero) I'll just buy it ("Damn the torpedoes, full speed ahead!"). But if I want a game but I'm not that set, I'll wait for the reviews. If the review seems positive (no major flaws, still sounds fun) then I tend to buy the game. If not (bugs, doesn't sound fun, etc) then I don't.
I don't buy games just because of reviews though.
For the record, I get most of my reviews from X-Play (which I watch all new episodes of). I also check specific games on GameSpot and IGN.
A demo is FAR more likely to change my opinion of a game than a review, but I like having reviews around to see what is happening with games I don't tend to play (sports games) and to save me from buying a piece of junk that won't be that fun.
However, I can tell you that my little sister and her friends (all about 14) don't read reviews at all. They are just mindless consumers. "I liked spider man/the hulk, I'll get that game". "That football game looks like it might be fun". Mostly we rent (so many games are terrible) but they don't even consider reviews before renting (not their money, I guess).
Re: (Score:2, Funny)
Re: (Score:2)
Duh..since when have reviews mattered for anything (Score:2)
Re: (Score:2)
Ebert loved Star Wars. [suntimes.com]
Re: (Score:2)
If it's not NFL, it's probably soccer (Score:2)
Of course a football game not based on the Madden engine is going to play completely differently. If it's not Madden, then by EA's exclusive license, it's not NFL, and if it's not NFL, it's more likely association football than American football.
Re: (Score:2)
Re: (Score:1)
Re: (Score:1)
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
Game franchise fanboyism (Score:1)
These days i usually read reviews on IGN, GameSpy, Gamespot and a copuple more here and there, and specifically look for comments regarding length
Re: (Score:2, Informative)
I saw this report a couple monthes ago. It works (Score:2)
There's many more factors, the biggest being name brand recognition or movie tie in. Cars can be as bad as hell but people will buy it for their kids. The flip flop is the company name. I'll buy most anything from nintendo ov
Re:I saw this report a couple monthes ago. It work (Score:2)
Longer term (Score:2)
Game review RATINGS don't matter (Score:5, Insightful)
I can understand them using the game rating, as it's the only obvious number you can apply to a game review and do correlations with. However just having a number doesn't mean it actually represents something, and I'm not surprised that game sales don't correlate well with a number that is basically pulled from the reviewer's ass.
Re:Game review RATINGS don't matter (Score:4, Interesting)
This was why the OLD Computer Gaming World avoided giving numeric/star ratings for so long.
Some people consider different things when buying. Some look at a tie-in/license (parents, younger kids, non-"gamers"). Some look at genre/subject: WWII, evil-alien-shooter, cute ponies, horror. Some look at whether text of reviews (is it monotonous, etc). Some look for eye-candy or cool tech; game is secondary (anyone remember "Trespasser"?). And some look at the numeric rating closely - but not many, I'll bet.
My guess is that of those who even look at reviews at all, most use the numeric rating just to group it into 3 bins: Run like the plague, it's ok to look at other factors, and (occasionally) look at it even if you normally wouldn't. And for those who find a game first then check reviews, the 3rd case is out, so it's basically only a "look for warning flag before pulling trigger" check.
Who buys "Barbies playhouse" because it got a 8.8 instead of "Kill nasty aliens with cool guns" which got a 7.8? No one. Some may buy Barbies playhouse because that the sort of game they like. And others might NOT buy KNAWCG when they normally would because it got a 4.8, or because if KNAWCG got a 7.8 and "Kill nasty Nazis with cool guns" got a 9.5. But the point is that subtleties of score have almost no impact, and even gross differences of score have only moderate impact except at the very extremes.
Re: (Score:1)
Re: (Score:2)
Well that's my point -- the existence of a 1-10 rating scale, with decimal points, implies that one should be able to get better resolution than great, good, or crap. However it is the games in the "good" bracket whose scores seem to be random numbers betw
Try Before You Buy (Score:1)
Yup, that's what I do before I "buy" any of my games. Yarrr!
They matter to me (Score:4, Interesting)
Here's an embarassing thing to admit: if I've been looking forward to a game and it gets an 8.9, I actually feel disappointed and I might take a few weeks to make a decision. But if that game gets a 9.0, I'm much more inclined to run out and grab it. Yeah, it's dumb. It's just like I know that $49.99 is only a penny away from $50, but it feels a lot more like $40.
One thing I realized as I was typing this is that while I'll look at the points the reviewer gives a game, I rarely ever read a professional review. They're simply too wordy and glossy. I'd rather just read some player comments about how "it sucks ass that you can't ride the donkey in multiplayer mode" than to try to discern these tidbits from the professional review.
Re: (Score:2, Interesting)
I'd use online and magazine reviews and comments if I could but they're so badly polluted by fraud and astroturfers that it's pointless.
That's why reviews have very little effect on sales; such a large percentage have no correlation with the actual quality of the game that people rightly ignore them.
Word of mouth from people I trust is it. I do not trust the vast majority of marketing parasites.
---
The majority of modern marketing is nothing more than an arms race to get mind share. Everybody loses
Re: (Score:2)
World Of Warcraft got a huge score and I was tempted, also by what other people were telling me, the reviewer did outline that the game was abo
Re: (Score:1)
In World of Warcraft, the grind from 1 - 60 isn't really that bad IMO. I've seen worse in other titles such as FFXI. What's really a bad grind in WoW is the 60 - Uber 60. And there is a huge difference between a 60 with greens and a 60 with purples.
After leveing 2 characters to 60 and a few others past 40, I started doing the MC grind on one of my 60's and for a while it was fun. Then for a while it was sorta fun and sorta getting repetitive. Then it got difficult to always get a spot in the raid, yet
Re: (Score:1)
It's all in the hype (Score:4, Interesting)
Name of Game/Company
Hype
Popularity of genre
In that order.
There's quite a lot of really awesome games out there that didn't get any attention. Why? They lack at least 2 of the three factors.
Imagine something is labeled "Command & Conquer Final Chapter". Will it sell? You bet it will! It could be the last crappy ripoff, a repackaged C&C1 with new graphics for example (no, you don't need to tell me "it's already been done", I know, thank you very much). It will sell. It has the name. Imagine Halo 3. Quake 5. NHL 2006. Diablo 3. Does/would/will it sell? Yes. Why? Name.
Same with "games to movies". Fortunately, at least some movie studios do care these days who buys the license for the name to slap on a game. It used to be a surefire way to say a game sucks donkey bits if it had the name of a current movie. But they always were bestsellers. Even the crappiest of the lot.
Then there is hype. DNF will sell. No matter when it comes out and no matter if it is up to par. You could offer an empty box and it would sell. Other games have the "new feature" hype, whether that feature actually matters or not. Max Payne was hyped as "revolutionary" in the genre of shooters for its bullet time and the actually rendered bullets. Whether it really was, I leave to the reader.
Astounding... (Score:1)
However, game reviews review the enjoyment and playability of the game. Further, they are often framed, for example: "I give enchant arms a 10/10 if you like these types of RPG's, otherwise, avoid.".
This "study" sucks.
50 Cent: Bulletproof (Score:1)
Re: (Score:1)
Re: (Score:2)
Why would it scare you? What a 'critic' looks for in a given thing, and what the average joe looks for in a given thing are generally two completely separate and distinct sets of criteria.
Reviewers are just like you and me (Score:3, Interesting)
Re: (Score:2)
Reviews can be influenced (Score:3, Interesting)
Completists (Score:3, Interesting)
One of the posts here said DNF will sell pretty well because of coverage. Heck, given its extreme coverage, if it actually comes out, I predict it will be one of the best-selling games of all time. (Many will play it, and those who don't, will still buy it for their collection.)
OT:A more interesting statistic to find out is... (Score:2, Insightful)
My buying habits are erratic, sometime I go by reviews, or word of mouth, or a continuing franchise that I've bought previous versions of. But wether I keep hold of a game or trade it in is based on wether I enjoyed p
Shelf space (Score:1)
Ranking (Score:1)
I'm always suspicious on game review-sites that they enhance the rating of games from money-spending advertisers.
Huh? (Score:2)
Game reviews don't affect sales, so there's really no point in writing them.
Sincerely,
Sucky Game Producers, Inc.
They mattered to me.... (Score:1)