Follow Slashdot blog updates by subscribing to our blog RSS feed

 



Forgot your password?
typodupeerror
AI Quake Microsoft Games

Microsoft's New AI-Generated Version of 'Quake 2' Now Playable Online (microsoft.com) 27

Microsoft has created a real-time AI-generated rendition of Quake II gameplay (playable on the web).

Friday Xbox's general manager of gaming AI posted the startling link to "an AI-generated gaming experience" at Copilot.Microsoft.com "Move, shoot, explore — and every frame is created on the fly by an AI world model, responding to player inputs in real-time. Try it here."

They started with their "Muse" videogame world models, adding "a real-time playable extension" that players can interact with through keyboard/controller actions, "essentially allowing you to play inside the model," according to a Microsoft blog post. A concerted effort by the team resulted in both planning out what data to collect (what game, how should the testers play said game, what kind of behaviours might we need to train a world model, etc), and the actual collection, preparation, and cleaning of the data required for model training. Much to our initial delight we were able to play inside the world that the model was simulating. We could wander around, move the camera, jump, crouch, shoot, and even blow-up barrels similar to the original game. Additionally, since it features in our data, we can also discover some of the secrets hidden in this level of Quake II. We can also insert images into the models' context and have those modifications persist in the scene...

We do not intend for this to fully replicate the actual experience of playing the original Quake II game. This is intended to be a research exploration of what we are able to build using current ML approaches. Think of this as playing the model as opposed to playing the game... The interactions with enemy characters is a big area for improvement in our current WHAMM model. Often, they will appear fuzzy in the images and combat with them (damage being dealt to both the enemy/player) can be incorrect.

They warn that the model "can and will forget about objects that go out of view" for longer than 0.9 seconds. "This can also be a source of fun, whereby you can defeat or spawn enemies by looking at the floor for a second and then looking back up. Or it can let you teleport around the map by looking up at the sky and then back down. These are some examples of playing the model."

This generative AI model was trained on Quake II "with just over a week of data," reports Tom's Hardware — a dramatic reduction from the seven years required for the original model launched in February.

Some context from The Verge: "You could imagine a world where from gameplay data and video that a model could learn old games and really make them portable to any platform where these models could run," said Microsoft Gaming CEO Phil Spencer in February. "We've talked about game preservation as an activity for us, and these models and their ability to learn completely how a game plays without the necessity of the original engine running on the original hardware opens up a ton of opportunity."
"Is porting a game like Gameday 98 more feasible through AI or a small team?" asks the blog Windows Central. "What costs less or even takes less time? These are questions we'll be asking and answering over the coming decade as AI continues to grow. We're in year two of the AI boom; I'm terrified of what we'll see in year 10."

"It's clear that Microsoft is now training Muse on more games than just Bleeding Edge," notes The Verge, "and it's likely we'll see more short interactive AI game experiences in Copilot Labs soon." Microsoft is also working on turning Copilot into a coach for games, allowing the AI assistant to see what you're playing and help with tips and guides. Part of that experience will be available to Windows Insiders through Copilot Vision soon.

Microsoft's New AI-Generated Version of 'Quake 2' Now Playable Online

Comments Filter:
  • by Tough Love ( 215404 ) on Saturday April 05, 2025 @09:40PM (#65284197)

    Who TF came up with the brilliant idea of F to attack? Did they ever actually try this thing?

    • Re:F to attack (Score:5, Interesting)

      by Jeremi ( 14640 ) on Saturday April 05, 2025 @11:45PM (#65284269) Homepage

      Who TF came up with the brilliant idea of F to attack? Did they ever actually try this thing?

      My guess is that it was easier to detect F being pressed within a web brower, than the Ctrl key or the mouse button or whatever, and since I think this is more of an AI proof-of-concept demo than an actual play-it-for-fun game, they just went with what was easier to implement.

      • I've done a lot of web dev work, you can detect CTRL fine, the problem is the hotkeys. CTRL+D adds a bookmark, CTRL+A selects all text on the page, highlighting it, CTRL+S saves a page to disk, opening a dialog to ask you where. And finally CTRL+W closes the browser tab. You can block CTRL+A but I am not sure if you could block any of the others, definitely not CTRL+W (not without an intrusive "are you sure you want to close" dialog)..
  • by packrat0x ( 798359 ) on Saturday April 05, 2025 @10:09PM (#65284215)

    TFS: They warn that the model "can and will forget about objects that go out of view" for longer than 0.9 seconds.

    • Yeah, I found that statement very Microsoft-ish. "We can't figure out how to fix this, so we're gonna pretend it's a fun thing for you!"

      They warn that the model "can and will forget about objects that go out of view" for longer than 0.9 seconds. "This can also be a source of fun, whereby you can defeat or spawn enemies by looking at the floor for a second and then looking back up. Or it can let you teleport around the map by looking up at the sky and then back down. These are some examples of playing the mo

      • And I find you comment very 93 Escort Wagonish. Forget the point they were making in releasing it you have your own rant that needs fired off because microsoft dammit
      • There's a map hole that they couldn't figure out how to fix before they went to launch so they just put a sign in front of it that says map hole.

        It's near the beginning of the game and it's a real map hole. If you walk over it you'll fall out of the map and you'll have to restart the game. And is a big dumb cartoon sign warning you not to step over it.
  • Experience (Score:4, Informative)

    by markdavis ( 642305 ) on Saturday April 05, 2025 @10:41PM (#65284231)

    >"We do not intend for this to fully replicate the actual experience of playing the original Quake II game. "

    That's for sure :) It is a tiny window with whacked controls that is very, very, very slow, with rough movement and physics all over.

    Now this is Quake 2: https://qwasm2.m-h.org.uk/ [m-h.org.uk]

    • Now this is Quake 2: https://qwasm2.m-h.org.uk/ [m-h.org.uk]

      Yep, that's more like it. What Microsoft actually seems to have created here is some sort of anachronistic throwback to my youth, when I'd attempt to play NES games and the cartridge wasn't making a good connection, so everything was a bit glitchy.

      Of course, back in those days we'd blow in the cartridge as an attempted fix. The only really good use of AI in this case was to make a song about it. [youtube.com]

      • Yep, it seems we're headed towards a world where we'll have to use prompt injection to blow on our cartridges.

  • I'm working on a zork-like adventure game that calls an LLM for moves, saves game state and re-prompts with some of the game state each turn to avoid forgetting. I'm sure the same thing could have been done for this. But even that's not enough. The real problem is an LLM seems to only have enough attention to remember the details of a paragraph or two of prompt. Go beyond that and it starts to forget regardless of the token limit.

    If I could re-upload the important bits of the entire game each turn and had
    • I can feed it two character descriptions with other stuff and by the time it runs the turn it will have one of those descriptions wrong.

      It sounds like you need to be training as you go so that the game can effectively incorporate the information back into the model. Now you can have a text adventure with the system requirements of a bullet dodger! Computer vendors love this one weird trick!

  • Breathe a sigh of relief soon after and 0.9 seconds later forget about it.

  • Can't even use the mouse to drive, a fundamental of FPS games.

    Large chunk of functionality missing? On brand for microshafts I guess.

    • by Luckyo ( 1726890 )

      You couldn't in early FPS games. Mouse was instead used for movement in original configurations if used, more typically you had the combination of move on one set of directional keys and shoot on the other.

      • When we're talking about Wolf3D, Hexen, Duke Nukem or Rise of the Triad, you go ahead, take a sip of water, clear your throat and prepare to chime in. Quake 2 was always point and shoot, and this sloppy AI fart doesn't even get that basic mechanic right.. Or get it at all.

        • Omg... Rise of the triad was a fucked up game. Agents bouncing all over the place.
        • by Luckyo ( 1726890 )

          This doesn't really have mechanics. Or more accurately it has them outside context. I.e. if you look at armor and health bars, they have no relationship with what's happening in game.

          It's what happens when you train without context. What interacts with what? Who knows. Why does this set of pixels change? Who knows. All you know is that it looks a bit like this, and a bit like that.

          It's the cargo cult version of understanding reality when you don't have the context. What they're demonstrating is not really t

  • by sTERNKERN ( 1290626 ) on Sunday April 06, 2025 @05:58AM (#65284479)
    It is terrible even for a tech demo.. But hey, lets put AI into everything and try to hype it up.
    • If you know how AI works... it's basically a computer recreating gameplay based on only videos fed into it of people playing... it's pretty impressive. I walked myself to the beginning of the level, hurt myself with an exploding barrel, and then to the end of the section (where it got stuck on a loading screen; I presume maybe that's the end of this tech demo) and only noticed the AI make one mistake (it fired a shot when I did not press F near the start). It's interesting, and clearly this is not an end re
      • Does it say anywhere how the LLM did it? I'm guessing for training it went up to each texture and 'saved' it, then built a 3d engine using code that's floating around. There's quite a few 3d first person shooter games with its source code published on the internet. It looks like magic but guessing if we could learn exactly what its doing, it wouldn't be as impressive. Like when its learned how a magic trick is done it loses its mystique.
        • by SirSlud ( 67381 )

          It's not a 3D engine. It's predicitvely drawing out each frame individually (that's why certain aspects of the frame that are harder to predict are more janky). There's no engine under the hood with vertices, texture buffers or rasterization. There are lot of projects like this floating around if you follow the academia in AI. I've seen demos of AI engines that can generate expanses of geography to drive around in a car. It's just rendering a single picture for each frame. The contents of the last X frames

  • Classic AI hype: "it doesn't really work, but we spent billions of dollars on it so we're going to do it anyway."

Beware of bugs in the above code; I have only proved it correct, not tried it. -- Donald Knuth

Working...