Slashdot is powered by your submissions, so send in your scoop

 



Forgot your password?
typodupeerror
×
Games Entertainment

Lawyer Opines On 'Flaws' in ESRB Rating Methodology 61

Gamepolitics has a post up looking at blog entry by attorney Mark Methenitis, who is not only a practitioner of the legal arts but also a gamer. At his site, he runs down some of the major pros and cons of the ESRB's ratings process, and on the whole he thinks they're doing a good job. Their major oversight, in his mind, is that at no point are the videogames ever actually played: "Game publishers send in a DVD of selected scenes and a lot of paperwork to get the game rated... The point being that the ratings board never plays the games. Yes, you read that right. The people who rate video games do not play the game they are rating. It would be the equivalent of basing movie ratings on a form and a trailer. Context would be wholly absent." The ESRB argues that if the publishers create their 'ratings package' within the organization's guidelines, they don't need to play the game. And indeed, with a title like Oblivion you can't expect the organization to play through the whole game. But ... c'mon ... maybe just the tutorial? How long would that take?
This discussion has been archived. No new comments can be posted.

Lawyer Opines On 'Flaws' in ESRB Rating Methodology

Comments Filter:
  • by llevity ( 776014 ) on Wednesday September 12, 2007 @10:56AM (#20572829)
    The idea is to rate the game based on its content. So they create a DVD with a range of the various types of content.

    You can't expect them to play through the whole game. And what good would they get out of playing the tutorial? They're not rating how good the game is, how the controls work out, how well the gameplay works. They're rating its content. They don't need to play it to do that.

    The only flaw is when the developer does not include a true spectrum of the game's content on the DVD, but they have policies in place to cover that, I'm sure, as we saw with the whole Hot Coffee crap.

    I'm really not sure how else you could go about doing it. Perhaps a DVD that contained the entire game played through, but for some of the longer games, you couldn't expect them to watch it all. And how do you handle more open ended games, with multiple branching storylines? (do those even exist anymore?)

    I think the system probably works reasonably well as is, as long as everyone is honest. And its usually in their interests to be honest, so it works out.
    • The whole 'Hot Coffee' thing was massively overblown; the content was not accessible to normal users, you had to go and download a mod to get it working. Complaining about content that requires a user-generated mod to run is like complaining that you can stick a mod on a game to play a porno every time the game starts (which, actually, probably takes less effort to write than it took to find the 'hot coffee' settings in the first place).
      • by tlhIngan ( 30335 )

        The whole 'Hot Coffee' thing was massively overblown; the content was not accessible to normal users, you had to go and download a mod to get it working. Complaining about content that requires a user-generated mod to run is like complaining that you can stick a mod on a game to play a porno every time the game starts (which, actually, probably takes less effort to write than it took to find the 'hot coffee' settings in the first place).

        Perhaps, but the entire point of the Hot Coffee was that the *developer

    • Playing the game would allow a ratings board to get a sense of context, as the article states. It would also give someone an idea of the kinds of choices the player has. In God of War you can can choose to kill a medusa by stabbing it repeatedly or by twisting its head off. All choices made by the player are bloody violent. In BioShock you can choose to rescue the Little Sisters or exploit them - a choice with positive and negative moral significance. A person may rate the violence and mature content i

      • Re: (Score:3, Interesting)

        by badasscat ( 563442 )
        Playing the game would allow a ratings board to get a sense of context, as the article states.

        Context is provided in various ways. The ratings board is not just presented a series of money shots. They're given a DVD that is "representative" of the game but also includes its most salacious content. Both of those are requirements.

        If the ratings board were forced to play the games, I guarantee two things would happen:

        a) It would take forever to get games rated, resulting in huge delays and potentially fewe
        • Re: (Score:3, Insightful)

          by ElleyKitten ( 715519 )

          I think gamers have to understand first and foremost that ESRB ratings are by nature not for them. They are for the people who have legal guardianship over them.

          Most gamers are adults, and many of us are even parents, so no, the ESRB isn't for the people who have legal guardianship over us.

          Despite your insistence on treating us like children, I do agree with your main point, the ESRB is not for us. I, and many gamers, have no problem with playing a game before deciding it's ok to give to a child (mostl

    • We had one of the project leads from the video game Prey come to a user group meeting last year. He talked about how they put all of the worst content onto that DVD knowing that if they didn't put the worst on that CD, that the penalties and lawsuits after going gold would crush them. He even talked about specific parts that they were worried different ratings boards would object to and had mods ready to change blood color on some environmental objects and even to remove the sphincter things. And Yes, those
  • The Major Flaw (Score:1, Interesting)

    by imstanny ( 722685 )
    The major flaw is not how it's rated, but the fact that it is rated. I have no problem with independent reviewers rating games and/or movies, but I do have a problem with an arbitrary organization making ratings; it becomes legalized censorship.
    • The ESRB is not an arbitrary organization, it is the video game industry's self regulation system. Going beyond that simple fact... "The rating system is voluntary, so companies do not have to submit a game for rating before selling it." http://en.wikipedia.org/wiki/ESRB [wikipedia.org]
      • "The rating system is voluntary, so companies do not have to submit a game for rating before selling it."

        Except the console manufacturers won't allow unrated or AO games on their systems, and the retailers will refuse to sell an AO or unrated game. So it is pretty effective censorship.

        Yet they'll sell unrated versions of the newest torture porn DVD to kids, without a damn problem.

      • by jandrese ( 485 )
        This is another case, like the Comics Code Authority before it, where what is technically voluntary self censorship becomes effectively mandatory self censorship because as soon as you create a ratings authority like this, stores and municipalities all over the country rush to enact policies/laws that prohibit any unrated (or even rated but above a certain threshold) material from being sold.

        Although I don't have a reference for it, I'd be willing to bet quite a lot that you simply cannot get a license to
    • Re: (Score:3, Insightful)

      by Mr_Silver ( 213637 )

      The major flaw is not how it's rated, but the fact that it is rated. I have no problem with independent reviewers rating games and/or movies, but I do have a problem with an arbitrary organization making ratings; it becomes legalized censorship.

      This is no different than the rating on films, yet no-one seems to complain about them.

      I have to admit, I don't understand why people on Slashdot are so upset that games are rated. We are no longer in the 8 bit age of pixelated graphics and some of these games ar

      • I have to admit, I don't understand why people on Slashdot are so upset that games are rated.

        That's probably because you don't live in the U.S. like many of us do; I'm making that assumption since you're counting things as "rated 18" which is not how things are rated here. In the U.S., we don't have laws that enforce ratings. Movie ratings are voluntary and theaters set their own policy instead of having laws enforced. In retail, most stores are pretty lax about enforcing ratings. For example, a kid can
      • by Kymri ( 1093149 )

        The major flaw is not how it's rated, but the fact that it is rated. I have no problem with independent reviewers rating games and/or movies, but I do have a problem with an arbitrary organization making ratings; it becomes legalized censorship.

        This is no different than the rating on films, yet no-one seems to complain about them.

        This is vastly different than the rating on films, for two very important reasons.

        The first: The ratings are not entirely consistent. A film with brief, non-titillating nudity can still sometimes get a PG-13 rating, while Janet Jackson's infamous 'wardrobe malfunction' (or it's digital equivalent) would instantly garner an 'M' rating from the ESRB.

        The second: As some have said before in other posts, it is much more challenging to get any sort of audience at all for a video game that receives the dreaded

    • It's not 'legalized censorship' unless it's illegal to purchase a game with a certain rating. As far as I know, anyone over 18 can purchase an AO game with no legal repercussions. Actually, I'm not sure if a law even exists about who you can sell AO games to -- if anyone has info on this, I'd be interested.

      If a private entity doesn't want to publish games with a certain rating, that has nothing to do with the rating's or the game's legality. All it means is that if you want to produce a AO game, your

    • Back in the late 80s (or 90s), the US government basically told the game industry: "You have to rate your games or we'll do it for you." A couple of organizations were created, and the ESRB became the standard.

      So, in short, the ESRB is the only thing that stops people like Hilary or Arnold from tell you what you can play.

      (And, yes, it still sucks)

    • I have Flamebait raitings? Wow!

      From Wiki: "To obtain a rating for a game, a publisher sends the ESRB videotaped footage of the game's most graphic and extreme content. The publisher also fills out a questionnaire describing the game's content and encloses a check for between $2,000 and $3,000.

      The ESRB states on its website that three trained raters, working independently, then watch the footage and recommend a rating. If all raters agree on the rating, content descriptors are added and the ESRB notifie

  • by revlayle ( 964221 ) on Wednesday September 12, 2007 @10:59AM (#20572901)
    It is a matter of resource availablity
    Do you want to pay the costs of adding extra staff, time, & money at the ESRB to do:
    - game installation
    - software/hardware support (just in case games have trouble running underneath the ESRB's setup)
    - and then the time to PROPERLY play through what needs to be played through to get the rating
    also, the staff would have to be decent enough game players at some of these games to get through the appropriate parts to rate
    plus, some of the critical content to rate is not later int he game, do not want to force developer to further pigenhole the degien to cater to the ESRB players or force the dev team to make a special demo just for the ESRB to play.

    i mean, yeah, it is doable... but the extra cost would be handed down to the consumers, and games are expensive enough already. Not "hard" at all, if you want to pay for it, sheesh.... :)
    • by Sciros ( 986030 )
      Considering it takes something like $1000 to get a game rated, that's basically what the ESRB charges to read some paper and watch a DVD of sample content. Yes, $1000 to watch a DVD. They can play the game a bit while they're at it.

      As for the cost of an extra $1000 or whatever the ESRB would grossly overcharge for the "playing" service, that should amount to like $.01 being added to the game prices (for a nice round $60 rather than $59.99 woohoo) considering game budgets nowadays.
  • Now, the problem with requiring the ESRB to play the game is that, either they have to play the whole thing (something which isn't time constrained, and won't even necessarily give you everything you need to know (read: things like mods can't be tested, and things like the infamous hot coffee won't necessarily be found), or you force them to play a demo, which is practially the same as screen shots (the developer still defines what you see in a demo). Dammed if you do dammed if you don't. The problem is p
    • A good game demo or the opening tutorial section of a game can give you a good idea of what's in the game and how it feels to play. An RPG where your character is shooting a gun and an FPS may look the same as screenshots or a demo trailer. But, the two kinds of games play and feel very different.
  • They would only play a small subset of the game. Most likely the same small subset they would have normally watched.
  • hmmm (Score:3, Funny)

    by nomadic ( 141991 ) <`nomadicworld' `at' `gmail.com'> on Wednesday September 12, 2007 @11:05AM (#20573027) Homepage
    You know, if they actually DID play the games before rating them...

    That would be a sweet job. I'd take it.
    • by faloi ( 738831 )
      I wouldn't. Unless they could come up with some system to allow me to either choose the games I rate, or be willing to have some "N/R" (not rated designation) designation. I could put a check in the tedious, poorly designed, and too many cut scenes categories and put it out the door.
      • by nomadic ( 141991 )
        I wouldn't. Unless they could come up with some system to allow me to either choose the games I rate, or be willing to have some "N/R" (not rated designation) designation. I could put a check in the tedious, poorly designed, and too many cut scenes categories and put it out the door.

        Well maybe you like your current job more than I like mine.
    • The job position got slashdotted about a year ago. They're in midtown Manhattan and as far as I know they're still hiring. :-P
      • by nomadic ( 141991 )
        The job position got slashdotted about a year ago. They're in midtown Manhattan and as far as I know they're still hiring. :-P

        Sweet! I'll have to take a look.
    • Yeah, except when your job is to rate this [gamespot.com] game.
  • To me, this is like rating a novel by listening to an audio book rather than having to read and turn the pages. Yes, you read that right -- some organizations rate a novel without even turning one single page!

    But seriously, as long as the content they review is what someone would experience were they to play, what does it matter that the marginal amount of additional context you get from playing is absent? Unless there's a game that shows a mother nursing her newborn child and the ESRB has a form with a c
  • The thing is, that's not how things are done. The ESRB ratings are mainly self certification from companies that really don't have any desire to mislead anyone.

    The impression people seem to have is that developers write a game, and then the ESRB decides what rating to give it. A developer knows full well what rating they want right at the start of the design. The game is targetted at the rating. They'll remove anything that will give it a higher rating long before anyone at the ESRB gets to see it. T
    • What about eggs, left over stuff, things that need a cheat code to get (Duke 3d had jokes that needed a code to get to) and other cut stuff that still ends in games.
  • If the ESRB had to play through each and every game on the market to judge their content and make a rating, some games would have to be delayed for months just so judges could mull over all the easter eggs, missions, and other miscellany. For movies its a hell of a lot easier: spend two hours on it, done. If you really wanted that much from the ESRB, have it run by the people who review games for a living. They've got to do it anyway, so might as well make it beneficial.
  • Couldn't hey be given savegames to try out the game at many different stages?
    or perhaps a god-mode?
    • by gknoy ( 899301 )
      Agreed. While it would be a scheduling hassle, it would be more effective to send over a competent player of the game (presumably from the developer house or the beta team), with a selection of savegames at various points. (e.g., here's some of the more violent stuff ... here's the nudity which you can see in context is nonsexual, here's the cathedral with contrast of the selflessness of the church with the inhumanity of nonhuman forces.) (Sorry, I know that's not related to ratings.)

      This would ensure bot
  • by darkmayo ( 251580 ) on Wednesday September 12, 2007 @12:04PM (#20574083)
    I would rather the industry was self regulated, instead of having big government come in, who has no effin clue about games and tell us what we can and cannot have.

    The ESRB isn't holding back the AO games, its society, its the general consensus that video games are still just for kids and therefore we have to protect the children from bad content. This idea is changing, though slower than we might like. The boundaries are being pushed slowly allowing for more and more "adult/graphic" content. This isn't just meaning titties and extreme violence but, mature story lines and content that we identify with better instead of the usually spiky haired hero saves the day. Content that makes you think, challenges your ideals and makes the game more than just press button to shoot gun.

    As we all have noticed our games and gaming habits are in the media spotlight, legislators and politicians as well as ambulance chasers and attention whores all have there two bits to say about how games are bad and this and that. Like Rock and Roll and Dungeons and Dragons, Video games are the scapegoat of the year and its up to us gamers to work with our system and to make people see that there fears and concerns are unfounded and a bunch of FUD.

    We are parents, grandparents, business owners, teachers and responsible individuals, we play games, we love our games because we grew up with them. Its still a new medium and its slowly getting to be accepted and seen as more than just for kids.

    For me, I'm for the ESRB
    • I would rather the industry was self regulated, instead of having big government come in, who has no effin clue about games and tell us what we can and cannot have.

      The only reason the industry is self-regulated is because the government threatened to involve themselves. "Self-regulation" is a sham. I would rather have no ESRB, and a government that minded its own business--and the business of government is not to regulate videogames.

      • So what's your problem with the ESRB then? Do you not see a value in their service? Do you think that because it's self-regulation at an industry level that it's certainly too biased to be of any value?

        While a major goal of the ESRB is most certainly to avoid government regulation of the industry, I happen to think that even without that governmental threat, a rating system along those lines is still a good idea.

        • Before ESRB and since ESRB there have been better ways for parents to get a decent clue about the content of a game and its suitability to their children. I do not think putting mandatory letter-grades on game boxes is the best solution.
    • by rtechie ( 244489 )

      I would rather the industry was self regulated, instead of having big government come in, who has no effin clue about games and tell us what we can and cannot have.

      Yup, that's the fear that's being played on. But IT'S NOT GOING TO HAPPEN. The Supreme Court, even the current conservative court, has been very firm on protecting freedom of expression unless government money is involved. Numerous state laws banning or limiting the sale of "violent" or "sexual" video games have been overturned. Even "virtual child porn" is 100% protected because the logic behind banning child porn is based on the children being harmed during production (it's pretty tortured logic). The sa

  • but they never give you the solution. I'm sorry, if every movie was 100 hours long and had hidden content revealed based on some obscure action you do, they would be doing the same thing. Oblivion is the perfect example. If some dumb lawyer said this to me I would drop a copy of Oblivion on his desk and tell him to give me a complete review of all the content in the game. I imagine he would come back to me some time in 2008. Then I would tell him to get all the online mods and expansion packs.
    • The expansion would have to be rated because it is released by the company who created the game, any mods that were created by the company would likely also have to be rated.

      Player made mods and such would not be applicable as they are not created by the company. If this was the case pretty much every PC game that is mod able would be considered AO.

      Of course if this is what you meant then its all good.
  • by sesshomaru ( 173381 ) on Wednesday September 12, 2007 @01:54PM (#20576163) Journal
    The ESRB does not exist to regulate games. The ESRB exists in order to protect video game companies from legislation sponsored by their critics. In theory it is therefore in the best interests of all game companies to cooperate with the ESRB. They are supposed to be on the same side.

    The method used to rate games is perfect in this regard, because when video game critics attack games, they use video game footage of "objectionable" scenes taken out of context to do so.

    Of course, this is why the "Hot Cofee" scandal was such a public relations nightmare, and I blame the ESRB for mishandling it. This is perhaps because the ESRB thinks that it really does exist to pass judgments on games. The goal should have been damage control, to the ESRB and to the game industry in general. Instead they caved into their worst critics and gave them new ammunition, based on some incomplete code that couldn't be reached through normal gameplay.

  • I used to make those tapes that were sent to the ESRB by a certain publisher. We would play the game over and over countless times, restarting every time something happened that management didn't want the ESRB to see. We would continue until the right random encounters occurred in a row, so that we had something that had actually happened, but wasn't really representative of the violence normally encountered during play.

    So, while it isn't practical for the ESRB to play through an entire game, I think th
  • I'm sorry, why can't we expect them to actually do what they claim to do? They aren't rating the game - they are rating the PR package created by the game company, a package specifically designed to garner a particular rating. Would it be equally credible if Consumer Reports never used and tested the products they rated nor examined actual quality statistics from the field, and instead just went over the MTBF and features lists the manufacturers provided?

    It's BS and we all know it.
  • it would be a lot of time and money to play through whole games, but there needs to be a way that the MSRB can see the context of the scenes in the game, not just the scenes themselves.

"Protozoa are small, and bacteria are small, but viruses are smaller than the both put together."

Working...