Video The Leap Motion Controller is Sort of Like a Super Kinect (Video) 108
Tim: Let’s talk about Leap Motion for a little bit. Leap Motion is a company that came out of what sort of background?
Michael: So the company is based around technology developed by my cofounder and our CTO, David Holz, over four or five years while he was getting his math PhD. It is essentially born out of a deep frustration with the fact that even though computers today are radically different in every way from computers of 30 years ago, the ways that we interact with them haven’t really changed.
Tim: Now on that front there has been a lot of motion control at the consumer level, just in the last decade. What distinguishes what Leap Motion is introducing from things that already exist like the V and the Connect Controller?
Michael: Yeah. So we are different on two levels. One is the philosophical level. So basically most other players in the space in which people tend to think about gestures when they hear about this sort of technology and what they mean by gestures are these sort of binary sign language-esque inputs where a system looks for x and then y happens. And that doesn’t actually solve the problem. It doesn’t actually give the user more bandwidth; it is no different than pushing a key on the keyboard. What we are trying to do is bring the same sort of complexity and intuitiveness that people have when they interact with the real world by reaching out and grabbing things, pushing - making it as direct and interactive and dynamic as possible.
So basically we are trying to take advantage of this intuition that people have developed over thousands of years that lets us perform this incredibly complex action that is reaching out and grabbing something in a totally thoughtless way, and the way that we do that using much more accuracy and much lower latency than other devices. So we are one of the only devices that contract multiple fingers, we contract up to ten fingers and we do that at a sub-millimeter level. So hundreds of times accuracy of something like a Connect; and more importantly, our latency is extremely low. So we want it to be virtually undetectable to the user; we want them to feel like their hand is physically inside the device. And that is as important for us as the accuracy.
Tim: Now compared to some of the other motion controllers out there, it seems like the tradeoff that you’ve chosen is high accuracy versus large area.
Michael: So it is less the core innovation and the core algorithms can’t work over a large area, and more that we think that the types of applications where people most need this sort of accuracy and this sort of multi-finger tracking happen on computers right now. So we don’t think that people want to control their desktop from six feet away but we do think that when they are sitting in front of their desktop they would like to be able to mold a piece of clay, grab an object and move it, interact with it in a certain natural way; so the device we built today is intended to be the smallest, most accessible, most powerful that can sit on someone’s desk and perform that function. But if in the future, we wanted to build a different device and we didn’t have to worry about USB power it could cover a much larger area.
Tim: You know the other thing is that when you look at things like the Kinect Controller, it is obviously just the name and what it is tied to, it is really part of Microsoft’s gaming lineup. What kind of connections do you have? It seems like it is a much more open possibility for connecting your device to various types of computers and systems.
Michael: Yeah. So one of the most important things about Leap is our developer ecosystem. So there are over 50,000 developers from 150 countries that have applied to be part of the Leap Developer ecosystem. And today we’ve sent units to 12,000 of them, and they are working on applications as diverse as Zeptolabs with Cut the Rope, and Autodesk with Maya and then in between there is an incredible diversity of applications, everything from really intuitive ways for people to create audio, create video, virtual pottery wheels, ways for people to scroll up and down, and more mundane things like ways for people to move through presentations.
So we want this to be a platform. And we also announced Airspace, which is our apps store. And basically the goal is that the user should be able, within 30 seconds of connecting their Leap, to have a place to go and know that everything there works great with Leap. So we are not requiring developers to use Airspace but to make discovery for the end user as easy as possible, it is going to serve as a curated, centralized place for great Leap apps.
Tim: The bigger names, the ones that already have so many users in the world, they obviously have a lot of connections to gaming studios; can you talk about what sort of games are actually going to be available for the Leap Motion?
Michael: There will be a pretty diverse range. So there will be lots of casual games and a lot of the mobile gaming studios are very excited about Leap because obviously mobile gaming isn’t that compelling or fun as an experience with a mouse or keyboard. But it can be a very fun experience with Leap. But also more hardcore games. So both through mods and original games.
So we have developers working on mods or plugins for virtually every popular game that you could imagine. And in Airspace there might be hundreds of mods or plugins for a particular game, and the market or user preference will decide which are the best control schemes. But then we also have developers working on things like original first person shooters where each hand controls a gun that is fully independent, and then when you get close to something, maybe it switches to melee mode where you are actually punching and fighting basically we want to make sure that everything that developers build and everything that users use is a fundamentally better way of doing that thing. So we are very cautious about doing things that seem cool but aren’t fundamentally better.
Tim: It seems like that one thing the Leap Motion controller has quite different from the others is that nongaming uses - they are not an afterthought, they are actually it seems like what you talk about in a lot of your material, as opposed to just shooting up your enemy.
Michael: I think nongaming uses will be the majority. So right now it is about 50:50. Obviously it takes a lot less time for a developer to build especially for the mobile games, then something like a CAD program, so I expect that it will probably be at least 70 percent nongaming at launch.
Tim: For the idea of mobile games being used this way, does that mean there will be a smaller controller in the future, or can it use software or integrated embedded say from Leap that is using your phone’s hardware.
Michael: For May, when we ship the Leap peripheral what it means is basically just that many of the top mobile studios are taking our content for iOS or Android porting it to Windows or OS 10, because they realize that Leap can turn it from something that doesn’t make sense on those platforms to experience that it is better than it is on a tablet or phone. So the Leap peripheral in May won’t work with mobile devices, it is very focused on PCs; but we definitely want to embed this technology anywhere there is a computer. So in the near future, we would like to embed this not just in laptops, and desktops but also in everything from tablets, smart phones, cars, surgical robots, fighter jets the sky’s really the limit, I think.
Tim: Now those 12,000 developers to whom you’ve actually sent hardware and all the others who have access now and are working on things, what sort of access do they have? Is that STK, and is that going to be available to a wider pool at some point?
Michael: Yeah. In May, once anyone can get their hands on a Leap device, we will totally open the developer program, and anyone will be able to go to the developer portal and also anyone will be able to download the STK. So right now, the reason that we have selected those 12,000 is because this is both a beta test as well an opportunity for them to develop early things; then we have sent them physical units, but we want this platform to be as open as possible.
Tim: How many applicants did you have that you had to select from?
Michael: Just over 50,000.
Tim: That’s quite a winnowing process.
Michael: Yeah, it is a testament to people, particularly developers’ passion for what we are trying to do. I think we are very committed to using this technology to make the world a better place. We really believe that this is holding back computing in a fundamental way, and as accessible as possible, and I think that is one of the reasons we’ve gotten such a great response from developers, developers at their core, they became developers because they like creating things, they like building things, and I think they are as passionate as we are about making it easier for other people to create things.
Tim: Finally, it is just a few weeks or I guess a month and change before you start sending units. So where are they now? What is the process? Are things in boxes on ships?
Michael: Yes, we’ve received hundreds of thousands of preorders and we are building units to satisfy that demand as well as to get units to our retail partners like BestBuy and our bundling partners like ASUS; and we have units being mass produced; something that is in the US already being put in boxes; we are taking preorders globally so we have three global distribution centers that are currently preparing the devices. Our goal is to simultaneously ship to all many hundreds of thousands of preorder customers on the same day; it is a big logistical undertaking but it will be worth it.
Tim: Any last words that people should know about?
Michael: Well, South By Southwest has been a great show for us. It has been really great to see people that have preordered the device come for the first time, and get to use it , and see them to be happy and meet their expectations which is great. It has also been great to talk to people who have no idea who we are and what the device does, and get them to give us their feedback and thoughts as well.
Looks promising. (Score:5, Insightful)
Re:Looks promising. (Score:5, Funny)
Re: (Score:2)
Also, am I the only one that thought this was from the kids' toy mfg Leapfrog?
Re:Looks promising. (Score:5, Informative)
"How do you have something like the Kinect and not have patents all over something related that basically would prevent this, or at least cause it to have to license numerous patents? Missed opportunity indeed."
I am in the Leap developer program and I have one. But I am not an expert on the Kinect. From what I understand, the Kinect uses cameras and visible light to do passive motion detection. The Leap works very differently. It uses active infrared signals and a pair of infrared detectors to do its magic. Unlike the Kinect, its active area is limited to just above the desktop. But also unlike Kinect, they claim precision down to a few microns. I haven't tried to measure the accuracy of mine, but it's pretty darned accurate.
Also, using the SDK, you can (A) detect all 10 fingers, (B) the position of each finger, (C) the direction each finger is pointing, (D) the position and orientation of the palm, and (E) the relative curvature of the palm (e.g., the diameter of an imaginary ball in your hand).
It's pretty impressive. The question is how well it will be integrated into software. Like any "alternative" controller, implementation in an individual application might be sad or might be great. There is no way to tell in advance, and I am sure we will see some of each.
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
Wait they did? Seriously?
Because the first thing - the very first thing I try to do with the kinect everytime is use a closed fist or rotating hand action to try and control something, and then get frustrated when I can't.
Re: (Score:2)
Wait they did? Seriously?
Because the first thing - the very first thing I try to do with the kinect everytime is use a closed fist or rotating hand action to try and control something, and then get frustrated when I can't.
We've all been there dude. =D
Re: (Score:2)
I did realize I was walking right into that one :)
Re: (Score:2)
Re: (Score:2)
Re: (Score:1)
Re: (Score:2)
"I'm going with the DUO for a couple of reasons. LEAP has been at this for how long now, and they still don't really have a product widely available; the DUO guys seem to be ready to go *today*. And while LEAK doesn't have any plans to produce an open source driver so that I can use this device and do my own processing of the data, the DUO guys say their driver will be open source. Indeed, their hardware will be licensed under Creative Commons."
The LEAP and the DUO are two completely different kinds of devices. You are comparing apples and oranges.
Re:Looks promising. (Score:4, Informative)
The DUO guys aren't "ready to go *today*" at all! They're still in early development! They are WAY behind the LEAP.
This is what I learned from their website:
(A) They haven't decided (or announced) the degree to which it will be open source. They said so in a forum on their own website. So that part is still very much up in the air.
(B) DUO just finished building their development prototype. LEAP has had actual development units out for months. They have gone through 4 physical revisions, and many firmware revisions. Many developers have been actively developing for the LEAP for that same period. I happen to know because (disclaimer) I happen to be one of them. Nevertheless, I am not terribly biased toward the LEAP. I am simply reporting the facts as I see them.
(C) The LEAP looks pretty nice and it is small. The DUO looks about 3 or 4 times as big, has cameras awkwardly sticking out of it, and looks cheap. Yet for some reason getting on the bandwagon even during the development stage costs almost 2 times the retail price of a LEAP? Say what?
(D) While they make claims of high accuracy and low latency, I don't see any numbers anywhere. I'll believe that when I see it.
All in all, at this stage of the game, the LEAP has a hell of a lot going for it that the DUO lacks. Maybe it will be better in the long run. Maybe it will be open source. But neither of those things is anywhere near certain yet.
Re: (Score:2)
All they need is the funding to get the first of devices built - devices they plan on shipping as soon as they can assemble them. Look at the Kickstarter. Something tells me that the DUO will be more widely available before the LEAP, despite the "headstart" that LEAP has - they've been at this for how long now and all they have to show is a pretty webpage and a press onslaught in response to a Kickstarter project.
You can argue that the price of the DUO is high, but the DUO guys aren't funded by venture capi
Re: (Score:2)
"Something tells me that the DUO will be more widely available before the LEAP, despite the "headstart" that LEAP has - they've been at this for how long now and all they have to show is a pretty webpage and a press onslaught in response to a Kickstarter project."
But this was my point. The DUO does not even have devices in developer hands yet. LEAP has had them out for I think close to a year now. And they are not just "prototypes". They are beta versions of the commercial product.
Sorry, but it's just wrong. LEAP is WAY ahead of the DUO. The DUO folks still have to go through all the things that LEAP has already done, before the DUO will be a production product. I see absolutely nothing indicating otherwise.
240 frames per second is not "ridiculously low" laten
Re: (Score:2)
Re: (Score:2)
I hadn't heard about the DUO before. I'm checking it out.
Not if MSFT/Windows supports it (Score:2)
If OEMs start incorporating it into their PCs and MSFT/Windows supports it...I'm sure Windows will be fine.
Re: (Score:2)
I like that keyboards require deliberate action. (Score:4, Interesting)
While I'm all for new and exciting technology, I'm not sure I like having cameras around that can be hacked, and visual interfaces that may record motions I make that I do not intend to go into a computer.
The simplest example would be idly picking my nose, and then coming back later to find those exciting strokes recorded. For those of you who are pornography enthusiasts, a similar problem exists.
Although keyboards are arguably pretty bad, they don't interpret my actions for me. I have to deliberately seek out the keyboard and type on it. It can't watch me or misinterpret me.
Now my only enemy is my own tendency toward tyops and speeling errors.
Re: (Score:1)
This.
Because once attached to your computer, it can never be removed, disabled, or turned off.
Hardware is controlled by software (Score:2)
Actually, this can be circumvented [stackexchange.com], and as this case shows us [computerworld.com], it has been done before.
Re: (Score:3)
Virtually every laptop sold in the country has a built-in camera. What's the distinction of this?
Re: (Score:2)
With respect to watching you without your permission due to unspecified hax.
Re: (Score:2)
Re: (Score:3)
Virtually every laptop sold in the country has a built-in camera. What's the distinction of this?
It's not normally on. As soon as you make the camera an always on input method, then well.. its always on.
Re: (Score:2)
Fair enough, I can't really deny that. But the default behavior is not to record, so it still requires external intervention to spy, which is exactly what is requisite for current technology. The only discernible difference is a little green LED.
Re: (Score:2)
The only discernible difference is a little green LED.
That little green LED tells me whether or not I'm potentially being recorded. If its on, and I'm not in a video call, something is wrong and I'm very suspicious.
With an always on camera trained on you, an LED would be meaningless -- if it existed it's always on. So you will never know if you are being recorded or not.
Re: (Score:2)
Re: (Score:3)
Yeah, it would be terrible if videos of you picking your nose went up on the internet. As opposed to your bank account passwords, credit card details, actual pornography habits and home address and real name - because if someone can hack the camera its far easier to just log keystrokes and take a screen grab of your desktop every minute.
Talk about identifying the wrong the problem.
Re: (Score:3)
Right. But it's far quicker and easier to address the camera issue with a small piece of tape that will solve the problem (or lack thereof, granted) permanently in less than a minute than it is to satisfactorily address the other issues you mention.
Jeeze people, lighten up...
Re: (Score:2)
Re: (Score:2)
Yes, that's actually somewhat consistent with paranoid personality disorder. But there's more than one symptom to that, and it would be insanity to diagnose a stranger on the internet from 2 sentences.
Nose picking porn (Score:1)
If I could idly pick my nose I wouldn't need to be a pornography enthusiast.
How About Learning A Little Before Piping Up? (Score:4, Informative)
"While I'm all for new and exciting technology, I'm not sure I like having cameras around that can be hacked, and visual interfaces that may record motions I make that I do not intend to go into a computer."
The LEAP does not take pictures. It does not even contain a camera.
While it works kind of like a Kinect (in that they both use light), the similarity pretty much stops there.
You missed this part (Score:2)
I then go on to talk about visual gestures and how I don't want those recorded.
You seem to have mis-read the original message. I would apologize, but after having re-read it, I don't think it's unclear. I often read things hastily as well, and that can lead to this kind of misunderstanding.
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
Perfect for a sith Star Wars game (Score:2)
I would probably buy one, (Score:4, Interesting)
Except I don't see Android or Linux on the list of things they run on
Would be quite nice for tablet, phone or android stick attached to giant TV.
>>The Leap Motion Controller will change the way you work without changing what already works for you. So it doesn’t replace your keyboard, mouse, stylus, or trackpad. It works with them, and without special adapters. Just plug it into the USB on your Mac or PC, and you’re off.
Re: (Score:1)
I'm more interested in those other controllers he mentioned, like the "V" and the "Connect" - where can I find out more about those?
Re: (Score:2, Insightful)
Check the Linux [leapmotion.com] category in the forum.
There seems to be a ground swell for Linux support. Be heard.
Re: (Score:2)
Re: (Score:2)
From what I have understood from reading Leap' employees posts in the Linux subforum, a large amount of input processing is done in drivers on the host which will therefore have to stay proprietary.
Re: (Score:2)
From what I have understood from reading Leap' employees posts in the Linux subforum, a large amount of input processing is done in drivers on the host which will therefore have to stay proprietary.
Almost right, up until the "...processing is done in drivers", which is imprecise. It's done in software. There is no reason the drivers couldn't be open.
And then, also wrong at "have to stay proprietary". Should read, "...is done in software on the host which they are likely to keep as proprietary."
It may seem like a moot point, but there's a significant difference there, especially since many of the algorithms can already be commonly found in OpenCV and similar areas. They *could* just make good hardware
Re: (Score:2)
Re: (Score:3)
"Right... so why not support the DUO instead... ?"
While I know quite a bit about the LEAP, information seems pretty scarce about the DUO. Also, I would not be too sure about the Open Source bit. This is from the OS X forum on their website:
"Thanks for your API feedback. The vision pipeline is not Objective-C, and in answer to your question about source library or precompiled/headers, the degree to which the software will be open source is unannounced yet. However, your thoughts about the SDK are extremely valuable and the team is listening, keep the comments coming!"
So... they haven't even decided how much, if any, of it will be open source yet. Further, they are nowhere as far along in the development cycle as the LEAP is. Yes, the fact that LEAP was in development was announced quite a while ago. But they did not announce a projected shipping date until recently. What's wrong with
Re: (Score:2)
Right... so why not support the DUO instead...
FWIW, I haven't supported either yet (neither financially nor investing time in them, other than talking about them).
That said, the little I can glean about the DUO makes it sound much less polished, and I haven't seen any guarentee of the drivers being open source (though, it appears the hardware is, or will be, open hardware, and they certainly seem more involved in open source projects).
One thing that seems quite different about the two, and please correct me if I'm wrong, is the use of strobing IR's on
Re: (Score:2)
"... ESPECIALLY since all the fancy bits are in their software..."
Not really. An awful lot of processing is done in hardware and firmware. There is no way software could handle the load of data otherwise.
Even so, interpreting that data is processor intensive. But it's up to developers to make that data interface with their own software.
There are already open-source libraries available to programmers, in some languages, for that latter step. But they do still rely on the low-level "driver" if you want to call it that.
Re: (Score:2)
"... ESPECIALLY since all the fancy bits are in their software..."
Not really. An awful lot of processing is done in hardware and firmware. There is no way software could handle the load of data otherwise.
Here's two comments from leapmotion forums from the Co-Founder & CTO:
https://forums.leapmotion.com/showthread.php?1091-Started-Linux-Hacking-Effort&p=7032&viewfull=1#post7032 [leapmotion.com]
https://forums.leapmotion.com/showthread.php?1091-Started-Linux-Hacking-Effort&p=6968&viewfull=1#post6968 [leapmotion.com]
"Just to clear up a tiny bit of mystery. The device does not output any form of depth-map or point cloud over USB. There is no processor on the device."
and
"The developer units do not have firmware with plug-and-pl
Re: (Score:2)
"Here's two comments from leapmotion forums from the Co-Founder & CTO:"
But those two comments do not say what you appear to think they're saying.
"Just to clear up a tiny bit of mystery. The device does not output any form of depth-map or point cloud over USB. There is no processor on the device."
It does not have to have a processor onboard in order to do a lot of the heavy lifting. There are all kinds of ways to process data without a "processor" per se. It could be a custom IC, or a PLA, or any number of other kinds of electronics going on in there.
But more to the point: the comment was about whether it outputs a point cloud. So what? It does output a hell of a lot of data, it just isn't in the form of a point cloud. (Whi
Re: (Score:2)
As I pointed out above, in fact that isn't even optional. It MUST be manipulating the data in order to even operate within the limits of USB.
Can you put this to rest yet? Here...
https://forums.leapmotion.com/showthread.php?1091-Started-Linux-Hacking-Effort&p=9208&viewfull=1#post9208 [leapmotion.com]
https://forums.leapmotion.com/showthread.php?1091-Started-Linux-Hacking-Effort&p=9210&viewfull=1#post9210 [leapmotion.com]
https://forums.leapmotion.com/showthread.php?1091-Started-Linux-Hacking-Effort&p=9284&viewfull=1#post9284 [leapmotion.com]
First link explains how a capture was done (which was fairly simple).
The second link has frames captured from the device.
The third has a
linux support is planned (Score:2)
It's supposedly being worked on, check out their forums.
Re:I would probably buy one, (Score:4, Insightful)
https://forums.leapmotion.com/showthread.php?17-Linux-SDK-relase-extimate/page5
"I just wanted to drop in and give you a little update. Earlier [yesterday], we released our first early build of the Linux SDK to developers on the developer portal. We will be working closely with devs to help make the Linux SDK as robust as possible, and we're looking forward to the feedback"
Re: (Score:2)
Exactly what Windows 8 needed at launch (Score:2)
This turns any computer into a touchscreen. It should have come built in to all windows 8 keyboards: the metro tiles would finally make sense.
Re: (Score:1)
Re: (Score:2)
It is not exactly like a touch screen. There is no way to detect touch -- you can only wave your hands in front of the screen.
Also, because there is no eye-hand-coordination in the system, there will have to be proxy objects (like mouse pointers) on the screen for your finger tips.
Did you guys try it? (Score:1)
I was highly unimpressed with the demo at SXSW and I've heard mixed reviews from people that got into the dev program.
It seems to be sunlight sensitive and it likes to randomly drop elements that it is tracking, maybe just a driver issue and I'm sure it could improve, but at the moment I'm not impressed.
Re: (Score:3, Insightful)
I stopped reading after "SXSW"...
Re: (Score:2)
Between this and Win 8 I need to reinvest (Score:3)
Re: (Score:2)
Patient: it hurts to defragment.
Re: (Score:2)
I'm pulling my money out of foolish things like municipal bonds and buying stock in companies which make rotator cuff treatments and therapies because that is apparently going to be a huge growth area soon.
Yeah, because doing things with your arms and hands that require more motion than moving a mouse around on a desk just isn't natural... or what?
Re: (Score:1)
I'm pulling my money out of foolish things like municipal bonds and buying stock in companies which make rotator cuff treatments and therapies because that is apparently going to be a huge growth area soon.
Yeah, because doing things with your arms and hands that require more motion than moving a mouse around on a desk just isn't natural... or what?
It's not about the motion, it's about not resting any part of your arm for extended periods of time. I mouse with my palm and/or elbow resting on a surface.
Tekwar (Score:2)
Re: (Score:2)
desired application (Score:1)
Re: (Score:2)
Pew-pew gaming (Score:2)
Porn Industry (Score:2)
Re: (Score:2)
Clippy 2.0? So it looks like you're masturbating....
can you replace the keyboard with this? (Score:2)
Musical keyboards too.
Audio Production (Score:1)
Am I the only one that couldn't handle listening to the audio in that clip? One guy is speaking into my left ear and the other guy into my right. It's like I'm standing between them staring off orthogonally, but the video has me looking right at the interviewee. Makes my head spin.
Do us a favor and mix it down to mono.
Their Developer Support is Lame (Score:2)
Re: (Score:2)
I'll say it before and I'll say it again, if we as members of a community that values open-source project
Fingers and chopsticks... (Score:2)
Fingers and chopsticks that "go where no device has gone before.". :D
No, thank you
Re: (Score:2)
its a spam bot, best I can tell - its been posting it as first post to almost every article I've read on /. the last couple of days.
Hopefully the fine folks over at /. or Dice get around to blocking it sooner than later