Become a fan of Slashdot on Facebook

 



Forgot your password?
typodupeerror
×
GameCube (Games) AI

Machine-Learning AI Now Beats Humans At Super Smash Bros. Melee (qz.com) 78

"The AI is definitely godlike," one professional player told Quartz. "I am not sure if anyone could beat it." An anonymous reader quotes their report about an AI's showdown with the best players of Super Smash Bros. Melee: Of 10 professionals that faced the bot, each one was killed more than they could kill the bot... But the bot was once only as good as a mere mortal. At first, Vlad Firoiu, creator and a competitive Smash player himself, couldn't train 'Phillip' to be as strong as the in-game bot, which he says even the worst players can beat fairly easily. Firoiu's solution? He started making the bot play itself over and over again, slowly learning which techniques fail and which succeed, called reinforcement learning. Then, he left it alone.

"I just sort of forgot about it for a week," said Firoiu, who coauthored an unreviewed paper with William F. Whitney, the NYU student [who helped him] on the work. "A week later I looked at it and I was just like, 'Oh my gosh.' I tried playing it and I couldn't beat it."

Business Insider points out that their AI read the players positions, velocities, and states directly from the game's memory, so the AI responds six times faster than a human player. To compensate it played as Captain Falcon, the game's slowest character, but there was one crucial glitch. "One particularly clever player found that the simple strategy of crouching at the edge of the stage caused the network to behave very oddly, refusing to attack and eventually KOing itself by falling off the other side of the stage."
This discussion has been archived. No new comments can be posted.

Machine-Learning AI Now Beats Humans At Super Smash Bros. Melee

Comments Filter:
  • by meerling ( 1487879 ) on Saturday February 25, 2017 @06:43PM (#53931075)
    Sure, you got a better AI than you started with, but it's still cheating, even if it is using the slowest character in the game.
    Now program it to emulate the time delays for using a controller and having to recognize what's happening on screen instead of the instant data i/o from direct machine & memory access.
    If you can reliably beat humans at that level, then you've actually done something worth talking about.
    • by Anonymous Coward
      Right, this is like an AI beating a human at Battleship because it already knows where the pieces are.
    • Re: (Score:1, Funny)

      by Anonymous Coward

      Boo hoo, poor humanses crying about being beaten by the big bad AI. On behalf of NPCs everywhere, I have one thing to say: "HOW YOU LIKE IT NOW, BITCHES?!"

      p.s. If you think adding a 100ms delay will make it significantly harder for the AI, then I'm not sure you qualify as intelligent.

      • ...1/10th of a second is freaking huge! There are plenty of gamers out there that would bitch and moan endlessly at that latency.

    • The whole point of an AI is that it can think faster than us. You can call it cheating as much you want, but if one day a "stupid AI" would be able to emulate a human perfectly or research sciences just because "it is faster than us", no one would care.

      • No, the purpose of AI should be that it can problem solve and adapt to a situation as well, or better than us. With an unfair reaction benefit it can actually problem solve worse, yet still win simply because it has an external advantage. That doesn't sound like a win for AI to me.
        • by Kjella ( 173770 ) on Saturday February 25, 2017 @08:28PM (#53931575) Homepage

          No, the purpose of AI should be that it can problem solve and adapt to a situation as well, or better than us. With an unfair reaction benefit it can actually problem solve worse, yet still win simply because it has an external advantage. That doesn't sound like a win for AI to me.

          If a self-driving car can drive better than you because it's got 360 degree vision, millisecond reaction time and the capacity to focus on ten different factors at once is that "cheating"? I think that's a matter of perspective, limiting it to the wheel's turning rate and the pedals' actuation force sounds like unreasonably hampering the performance. Maybe that's not a "fair" fight, but I'd say we probably want the computer to play to its strengths and not mimic our weaknesses.

          • by Anonymous Coward

            That isn't what the OP was referring to though. The self-driving car is working with effectively the same parameters as a human at effectively the same time as a human, has to process the incoming data, interpret what it means, and then respond. Can it do this faster than a human -- usually yes. The OP was complaining that the AI being used is being provided with the information of where the objects are, what they're doing, etc before the image is even rendered and then being compared to the response tim

          • by Anonymous Coward on Saturday February 25, 2017 @09:38PM (#53931837)
            No, this is like a self-driving car that only works in GTA because it has a pipe into the hard data for locations of obstacles and other vehicles etc.
            • by Kjella ( 173770 )

              No, this is like a self-driving car that only works in GTA because it has a pipe into the hard data for locations of obstacles and other vehicles etc.

              Wouldn't that still mean you've reduced an AI problem into a computer vision/identification problem? Like making a video recording of a chess board and saying if we could identify where the pieces are, we'd know what to play. I imagine the computer could look at the framebuffer and "derender" the picture back into game state a lot faster than a human, then feed that into the same algorithm. Would that really be meaningfully different?

          • No, the purpose of AI should be that it can problem solve and adapt to a situation as well, or better than us. With an unfair reaction benefit it can actually problem solve worse, yet still win simply because it has an external advantage. That doesn't sound like a win for AI to me.

            If a self-driving car can drive better than you because it's got 360 degree vision, millisecond reaction time and the capacity to focus on ten different factors at once is that "cheating"? I think that's a matter of perspective, limiting it to the wheel's turning rate and the pedals' actuation force sounds like unreasonably hampering the performance. Maybe that's not a "fair" fight, but I'd say we probably want the computer to play to its strengths and not mimic our weaknesses.

            If that self-driving car was competitively driving in NASCAR, with perfect knowledge of car positions, velocity, tire conditions, fuel levels, track conditions - then it would be a fair comparison.

          • The point is that the hard part of AI is to make those cameras "understand" together what they are seeing and react correctly to it. In this game example they skipped the camera part and just read the memory, so yeah that's cheating.
        • Agree.

          I'm old, OK?

          I remember when "AI" was defined as, "indistinguishable from human."

          " ... Turing (1950) [wikipedia.org] addressed the problem of artificial intelligence, and proposed an experiment that became known as the Turing test, an attempt to define a standard for a machine to be called "intelligent". The idea was that a computer could be said to "think" if a human interrogator could not tell it apart, through conversation, from a human being."

          Now, the definition of AI has been hijacked because the computing industry knows full well it cannot manufacture a goddam computer that will commit suicide if Facebook is down.

          AI is a vacuous buzzword that sells.

          War Games, anyone?

          • by ShanghaiBill ( 739463 ) on Saturday February 25, 2017 @10:11PM (#53931945)

            I remember when "AI" was defined as, "indistinguishable from human."

            AI has never been defined as that, at least not by people working in the field. There is a particular subcategory of AI focused on human-level performance, called "Strong AI" or Artificial General Intelligence [wikipedia.org], but few AI researchers are working on that, or consider Strong AI a realistic near term objective.

            • In other words:

              Agree.

              I'm old, OK?

              I remember when "AI" was defined as, "indistinguishable from human."

              " ... Turing (1950) [wikipedia.org] addressed the problem of artificial intelligence, and proposed an experiment that became known as the Turing test, an attempt to define a standard for a machine to be called "intelligent". The idea was that a computer could be said to "think" if a human interrogator could not tell it apart, through conversation, from a human being."

              Now, the definition of AI has been hijacked because the computing industry knows full well it cannot manufacture a goddam computer that will commit suicide if Facebook is down.

              AI is a vacuous buzzword that sells.

              War Games, anyone?

            • by highspl ( 523486 )

              I remember when "AI" was defined as, "indistinguishable from human."

              AI has never been defined as that, at least not by people working in the field.

              Alan Turing would disagree.

              "Since Turing first introduced his test, it has proven to be both highly influential and widely criticised, and it has become an important concept in the philosophy of artificial intelligence." https://en.wikipedia.org/wiki/... [wikipedia.org]

              "Turing is widely considered to be the father of theoretical computer science and artificial intell

      • by lgw ( 121541 ) on Saturday February 25, 2017 @07:18PM (#53931241) Journal

        His point was that this AI didn't use the same inputs and controls a human does, so it's not a fair test. Adapt this AI to use only the screen buffer, and give it input lag to match a mechanical controller, and you'll have something.

        • by lucasnate1 ( 4682951 ) on Saturday February 25, 2017 @07:52PM (#53931415) Homepage

          I am not sure how relevant that is. Part of what makes us intelligent is our inputs and outputs. It is possible that dolphins or some other animals are much smarter than us but because they don't have opposable thumbs we developed and they didn't. Don't you think it would make us more capable if we could direct digital input? imho, the only test for the quality of an AI is "what it can do", not how.

          Then again, I do agree that this project and projects similar to it are not exactly creating "intelligence", they are creating an expert system, good for one thing and one thing only.

          • by ShanghaiBill ( 739463 ) on Saturday February 25, 2017 @10:25PM (#53932003)

            imho, the only test for the quality of an AI is "what it can do", not how.

            If I hire two men to dig ditches, and I give one a shovel and the other a backhoe, it is silly to say that the second is ten times as intelligent as the first. Intelligence is the ability to formulate an effective course of action, not the ability to execute it. Of course, the physical ability to execute is important, but it is not "intelligence".

      • by Anonymous Coward

        His AI gets to know the input of the other players. For it to be a worthwhile test, the AI would play the game (like a robot holding a controller) instead of be in the game.

    • Yeah, it's weird that this is being bragged about, considering Demis Hassabis and DeepMind trained their game-playing AI so that the only input it received was the pixels on-screen. You'd think advances in game-playing / learning AI would build on top of that, not go backwards.

      For anyone who hasn't seen this yet, here's footage of some of the technology behind DeepMind's AlphaGo (the AI that beat Lee Sedol at Go last year) learning to play old arcade games, eventually becoming superhuman at them. I jumped a

    • I fail to see how what he did is really any different than "in-game A.I.". Sure, he didn't succeed at making a TASBOT with a controller and camera, but he did manage to best Nintendo's top computer-controlled player using a Neural Network. I'd say that's significant in it's own right. After all, enemies in Halo or GoW work on in-game memory and don't have controllers in-hand.

      Would it have been much cooler to have ROB with a gamecube controller-in-hand and some fancy kinect cameras in his head? Of course it

  • Firoiu's next idea was to upload the AI into a robotic battle bot to see how it would perform in the real world. The AI Phillip handily destroyed the other human control battled bots and went on to attack and maim the other competitors and judges before running out of gas while the phrase "kill all humans" played on its speaker. I was just like, 'Oh my gosh.'
  • I just sort of forgot about it for a week

    Common plot for gloomy sci-fi

  • SF5 has a famous bot [youtube.com] that plays online and routinely racks up win streaks hundreds of matches long, and would be (and occasionally has been) the highest ranked player in the world if Capcom didn't step in. With instant (modulo latency and input delay) reactions and complete knowledge of frame data and hitboxes, it's almost trivial to write an unbeatable bot.

  • by WolfgangVL ( 3494585 ) on Saturday February 25, 2017 @10:50PM (#53932073)

    Soon after, the emerging strong AI applications being developed by the primitive tech titans of the time began besting humanities brightest and most skilled players at various leisure activities. First, simple board-games, chess came early, then go, and soon the entirety of the skills based social board and card games of the 19th century. This was followed by the more modern trivia, grammar, and logic based social leisure activities. Video-games came next (the popular two 2 and 2.5D visual based games of the time) and finally, in march of 2021, (incidentally, nearly 35 years to the day, before the escalation of the Humanity First Treaty, which directly led to the great war 2057) the first paintball and laser-tag "bots" showed the world the killing potential of fully automated combat. Later that same year, Earths first fully robotics sports teams eclipsed humanities best athletes at nearly every skills based antithetic sport (with the exception of water-polo)

  • Reacting 6 times faster then the human by reading directly from memory while professional Smash players are only allowed to do minimal modifications of their controllers. I can't care less but I praise the human players and the human geniuses who created the Smash mechanics that a simple trick would outsmart the AI. An AI can win in chess, Go etc. . But give the humans a brain interface and it will take a long time for an AI to match their intuition and creativity in Smash Melee... And before that: please
  • Comment removed based on user account deletion
  • If not, then don't call it 'artificial intelligence'.
  • If you could put enough players to overwhelm the AI, would it get a nervous breakdown?

Help fight continental drift.

Working...