Want to read Slashdot from your mobile device? Point it at m.slashdot.org and keep reading!

 


Forgot your password?
Close
typodupeerror
×
Toys Entertainment Games

Tracking Gaming Stats With Video Capture Devices 96

Posted by simoniker from the ingenious dept.
galtish writes "M. Schrag has put together an amazing PC stat tracking system called 'Soul Calimeter' for use with the GameCube version of fighting game Soul Calibur II. The software is as yet unreleased, but uses a cheap video capture card to analyze the video feed from the console and create a stat database. It's not just stats, there's also a web browser-based front-end for analyzing the stats and starting circuit matches, and voice synthesis using AT&T Natural Voices for in-game commentaries on the action. His website includes pics of the stats screens, and samples of the synthesized audio commentary. Pretty sweet - I'd love something like this for the weekly Halo LAN matches..."
This discussion has been archived. No new comments can be posted.

Tracking Gaming Stats With Video Capture Devices More

Tracking Gaming Stats With Video Capture Devices

Comments Filter:

    • Re:Mirror (Score:2, Funny)

      by Anonymous Coward
      Dude, mac.com has more bandwidth than Jesus. Your mirror is pointless.
  • It's really too bad they had to jump through so many hoops to get this to work.

    Nothing like making a developer's life hell by making them interface it like this.

    • Re:Lot of work (Score:5, Interesting)

      by randyest ( 589159 ) on Wednesday April 07, 2004 @09:44PM (#8799463) Homepage
      In the (sadly few) posts in this story I see an amazingly underwelming response to this achievement which, personally, I find rather amazing. Maybe it's because I've worked with image processing (CISP at Lockheed Martin during college) and appreciate how damn difficult reliable image recognition is, even when recognizing sub-images from a fixed (but still decently large) selection of image inputs.

      IMHO this is one of the most clever and thorough hackings I've read about on /. in months. This is excellent work to solve a technically difficult problem in an unorthodox (and risky, in terms of complexity) way, and they do it with style (the commentary stuff is mint) and extensibility (the API is very open FWICT.) The only thing I lament is a lack of more detail (maybe that's the problem?), but I think the site has switched to simple static pages to minimize the slashdot effect (though probably not needed in this case) and I expect to be able to find more details on a later visit.

      And I'm afraid I must disagree with your notion that somehow it is a shame that it was so difficult to do. Necessity is the mother of invention, and here it shows (and pays off) in spades. What, are we supposed to rally against Nintendo (and all console makers, for that matter) for failing to provide a port with some open API to scan internal game variables? Frankly, I'd be way less impressed were they to in fact do that by either hacking onto the motherboard electrically, or worse running the game on an emulator (MAME or such) and peeking at RAM.

      Nothing like making a developer's life hell by making them interface it like this.

      Eh? These are not "developers" and no console maker expects antyone to want (much less implement) anything like this! They are hackers!

      Again, I just want to say that I think this is one of the most underrated and under-commented yet excellent stories I've read here in a long time, and I plan to revisit the site later to learn more. This may be applicable to many other things from security cameras and home automation to MythTV-type device commercial skipping.

      Then again, maybe I just don't realize how easy it is to do real-time image processing with object recognition in a reliable way using cheap under $50 capture cards on a 1GHz Athlon these days. Were that the case, though, I'd expect to read more about such efforts. This is a first for me.

      Thanks for reading. And no, I do not know the authors(s) and I've never heard of this until now.
      • I think I speak for most people when I say that the reason I failed to get at all excited was:

        I just could not understand what the hell they were talking about in the article text. I mean,
        "analyze the video feed from the console and create a stat database"
        huh? I don't know what sort of stats you're talking about, and what do you mean by analysing the video feed? Huh?

        But now, after admitedly RTFA and your post, I have a greater understanding of what this is all about after reading your post than I do fr

      • When I first saw this earlier today I was completely amazed and excited. I happen to have a GameCube, and I love Soul Calibur II. I noticed that you couldn't download this thing, but didn't make much of it. I had contemplated emailing them to see if I could get a copy, or whatever, but then decided against it.

        But the more I've been thinking about this, I'm really starting to think this is a hoax. Think about it: how many times have you seen something home-grown like this and not been able to download

        • re: I'm starting to think this is a hoax (Score:1, Informative)

          by Anonymous Coward
          its not a hoax. this guy is a very credible programmer for java rio apps who has reliably put out new releases of his software. there's no reason he'd fake something like this, he's a grown adult with better things to do than make a bunch of nerd believe he's doing something he's not.

          • Then two questions:

            1. Why did you post anonymously?
            2. Why didn't he release the software?

            I don't believe he has some obligation to release the software, I just seems curious that he hasn't. I could have made those screenshots and voice samples (you can do so at AT&T's Natural Voice website for free). I, for one, would love to see this software because it would be quite cool. I definately applaud the authors of it if they have, in deed, really developed this software. I don't want to take away from t

            • If you've ever released an open source app, you know you can't just toss it out there. You have to package it, document it (at least enough to get people going), and support it. None of these are particularly enjoyable. Especially for an app like this -- video analysis is really finicky (at least mine is :) ). In fact, when I brought it to work after working on it at home, it just didn't work. It took me a good 45 minutes of screwing around to realize that somehow the color calibration got messed up on

              • Wow, I really appreciate the response. You are absolutely correct that I have never released an open source application. Your explanation helps me to understand your situation. Would you consider just releasing the executable software so other GameCube/SCII freaks like myself could enjoy your system? Should I perhaps instead send an email to the address listed to let you guys know that there is some interest out there?

      • The reason why there are so few comments posted is that everyone is still busy installing Linux on a dead badger.
    • What would you expect, Nintendo to provide a port on the GameCube to which you attach a device which receives relevant events from the game?

  • Yay! A /. story that's interesting (Score:5, Interesting)

    by ObviousGuy ( 578567 ) <ObviousGuy@hotmail.com> on Wednesday April 07, 2004 @07:39PM (#8798620) Homepage Journal
    While his project is altogether useless and probably a complete waste of time, the site is well-documented, well written, and the project is very high in hack-value. More stories like this, please!

    Obviously this is just the first step of this project. It looks like they can identify characters and health meters, as well as winners and losers, however the next obvious step is to identify moves on-the-fly so that a running commentary can be played. Also, since they are running video capture HW/SW, they could even have their epic fights saved and played back with computer commentary. Now that would be geeky!
    • the project is very high in hack-value

      Wouldn't it be higher in hack-value if their method was to track the game's internal variables directly rather than trying to digitize the video feed and backward-engineer the variables?

    • Or, creative people can turn this into "game-nanny" kind of stuff. This could be good or bad, as what net-nanny kind of software did... Having "game-nanny" may encourage adult-content games (and probably the game producer also cooperate). Hmm... lots of possibilities....

      Just my 2c

  • Running commentary on everything that happens in the office? Priceless!

    "Hey, man, another coffee?"

    "Hey, Aztec, you scored good in that meeting. Give ya a kickdrop and a sideswing. Need more stamina though..."

    "Hey, Sandy, nice skirt you're wearing there! You already got ten eyeballs."

    "Hey... WTF!? You can't unplug m-/$!

  • Camera (Score:1, Troll)

    by Greenisus ( 262784 )
    Don't point the camera at games.slashdot.org . . . it might blow the PC up!
  • I've never imagined that a 1ghz computer could capture in real time stats from a video feed. This is amazing.

  • Pretty cool (Score:4, Informative)

    by stratjakt ( 596332 ) on Wednesday April 07, 2004 @07:49PM (#8798697) Journal
    Reading the descriptions, it watches the health bars and the squares at the character select screen. Which would be simple enough image detection, since they're always in the same x,y coordinates.

    It would be really cool if it could grok the movements of the fighters and say things like "Kilik delivers a fierce scissor-kick to an uppercut combo!".. But you cant have everything.
    • It would be really cool if it could grok the movements of the fighters and say things like "Kilik delivers a fierce scissor-kick to an uppercut combo!".. But you cant have everything.

      Actually, you can have everything. But it won't arrive until approximately the heat death of the universe.

      -kgj

  • Shoot! (Score:2, Funny)

    by Anonymous Coward
    I must turn off my PS2 for playing Strip Poker!

  • Time? (Score:1, Offtopic)

    by cmburns69 ( 169686 )
    I know some people who have WAY too much time on their hands..
  • What would be convenient would be something like this, but for playing poker for $$$ online. So the computer can advise (or even play for you).

    "I advise you fold this marginal hand."
    "There is a 45% chance that this opponent is bluffing."
    etc.

  • Halo (Score:4, Interesting)

    by Spy Hunter ( 317220 ) on Wednesday April 07, 2004 @08:02PM (#8798791) Journal
    This is a great idea. We were just thinking the other day about a video capture based stat tracking system for our Halo LAN matches. Sometimes large portions of our potential Halo-playing time are taken up by arguments about team balancing (AKA "team wanking"), but if a computer could analyze the stats and make balanced teams for us we wouldn't have to worry about that anymore. Stats on who's best/worst at killing who, and with what weapons, would be really interesting. Plus the automated trash talking would be great fun! Having a robotic voice affirm your greatness after you get a triple killtacular would just be that much more awesome :-)
    • I'm a big fan of Halo on XBox. Try the new Unreal demo on PC if you haven't already. It's got all that kinda commentary and stats (your successes and failures with certain weapons).

      I really didn't like the early Unreal games at all (preferred the Quake series), but UT2004 (even the demo alone!) is pretty good.
    • The OpenHeX [sourceforge.net] project aimed to do things like that and more (bots , tournaments, etc) with XBox Halo. Unfortunately, my XBox is in need of a mod so I can get it back to a working state, so that I can get back to development on it :P
    • Plus the automated trash talking would be great fun!

      So you're the guy who thought that was a good idea in Unreal Tournament.

    • Trash Talk (Score:2, Interesting)

      by cluke ( 30394 )
      Jeez, if there is one thing I hate about American society it's Trash Talk. Mindless (and usually entirely unjustifiable) braggadocio about imagined violent acts, usually done by pasty-faced milquetoasts as an accompaniment to something as far away from actual physical exertion as possible, like video games or pool, or attached to something like wrestling where it is even more ludicrous as the results are predetermined.

      Mind you, I think I have just been traumatised by my last visit to America where I went t
  • This is a truely breathtaking impressive hack. By people who've been playing Soul Calibur for more than 3 years every day. The last part would actually ask for some stupid jokes, but as somebody who writes software for a living I must say I'm really impressed by this cool piece of work.
    And I really don't wanna compete with those guys in Soul Calibur. :-)

  • Coooool. (Score:3, Funny)

    by Moonshadow ( 84117 ) on Wednesday April 07, 2004 @08:16PM (#8798896)
    Wow. As an avid Soul Calibur fan whose roommate is always talking trash, it'd be nice to have some hard stats to back up the asskickings.

    If these guys don't make any movements towards sharing this with the general public, I very well may have to work on hacking up something like this myself.

  • Geez . . . (Score:2, Funny)

    by 0bjectiv3 ( 216391 )
    If only they had bigger breasts. I'd buy it then.
  • His website includes pics of ...

    I'm giving it 5 minutes.

  • try the natural voices (Score:3, Interesting)

    by Anonymous Coward on Wednesday April 07, 2004 @08:57PM (#8799180)
    If you have never heard what AT&T Natural Voices sound like you should listen to the demos [att.com]. I first discovered these over two years ago and although they haven't changed that much quality wise, they are the best synthesized voices I have ever heard.

    -- paper
  • A quality capture card that doesn't suck is the Winfast TV which runs about $60. It has no problem capturing 640x480 30fps DVD or higher compression video on a decent system.

    No point "saving" $35 to buy a piece of junk that has virtually no uses except for one application.

    Ben
  • I first read the title of this as "Tracking Gaming Sluts with Video Capture Devices"

    But then again, I guess that title works too, huh?

    • "I first read the title of this as "Tracking Gaming Sluts with Video Capture Devices"
      But then again, I guess that title works too, huh?"

      You're thinking of the version for Dead or Alive: Extreme Beach Volleyball

  • Just What I Needed (Score:4, Funny)

    by DeadBugs ( 546475 ) on Wednesday April 07, 2004 @10:04PM (#8799627) Homepage
    Documented proof of my ass getting kicked.

  • I'm sorely disappointed (Score:4, Funny)

    by Cuthalion ( 65550 ) on Wednesday April 07, 2004 @11:56PM (#8800313) Homepage
    You're writing software to measure Soul Caliber. WHY isn't it called Soul Caliper?
  • It's really, really cool. We need something like this for our games!

    It's too bad it doesn't look like it can detect Guard Impacts, which can turn a fight around. (A Guard Impact is when you press toward or away from the opponent and press the block button the instant a hit would strike, causing you to parry or sidestep the attack and basically giving you a free hit on your opponent -- unless *he* Guard Impacts, that is.)
    • We've actually talked about adding in audio detection also because some events (GI's in particular) have really distinct sounds though don't necessarily have a very distinct video event (though I think GI's do actually flash for a few frames, which might be detectable). But audio detection seems like it would be a lot harder to do, so I just haven't done anything with it yet.
      • I was thinking about that myself, but the hardest part would be figuring out which player performed the Guard Impact. There could probably be special commentary lines for them (it'd be cool if they could interrupt whatever was being said at the moment, shouting and yelling like a wrestling announcer), but you wouldn't be able to refer to the player who performed it.
        • One way would be to read the controllers as well. That would require some more hardware for analysing though.
          • That wouldn't work, because control inputs are too vague without being able to tell what's happening on the screen. Also, since Guard Impacts happen in response to attacks, both players would have buttons pressed and control directions going at the same time.

            If you could find any non-vague visual element, something that's part of the basic interface and not the 3D engine, that corresponds to performing a GI, then it could be attributed to the performing player. Otherwise, it gets much harder to do anythi
            • That's a pretty good idea with the looking-for-a-hit -after-the-GI approach. You probably have to toss in there that if another GI happens first within the window of time (before a hit), then you switch around and expect a hit from the other side. Assuming it's possible to detect the GI sound, I bet that would be pretty successful.
              • Since the program has no idea who accomplished the GI until damage is scored, you actually wouldn't have to worry about consecutive GIs, since only the last one really matters. You could have a special commentary for GI-fests, but it wouldn't be able to know who initiated it until damage is scored -- *if* it's scored.

                The thing about the GI sound is that it's distinctive -- nothing else in the game sounds remotely like it -- and its really loud. Since all the sounds are mixed with the music and other soun
            • Well, I wasn't suggesting that you should only use the controllers. It seems like only one player should be pressing the GI combo when the GI sound is played though. Naturally this would assume that you know which controller is hooked to which life-bar.

              That may still not be quite sufficient. I haven't played SC2 quite that much... Yet.
              • Generally, but not essentially. If you perform the move for a Guard Impact, but aren't getting hit, nothing happens. But since buttons are probably being pressed by both sides at that moment, it wouldn't be obvious which side performed the GI just from looking at the controller data stream.

                Also... the hack doesn't seem as cool if you need to jury-rig special hardware to do it. One of the great things about this is that you *only* need a capture card to do it. That's swell.
  • GOD I WILL KEEP THIS ONE IN MY BOOKMARKS FOR A LONG TIME!!! The link to ATT'S site for the voice synth mentioned, its great to make it say funny things like "smoke crack mate, crack is good!" in uk english. The address for that page is http://www.naturalvoices.att.com/demos/ HAVE FUN!!!!!
  • Soul Calimeter? That's awful.

    Soul [b]Caliper[/b] would have been a much better name.

Slashdot Top Deals

One man's constant is another man's variable. -- A.J. Perlis

Close