Leap Motion is perfecting natural hand gestures for VR

As immersive as virtual reality can be, you're still left holding awkwardly shaped controllers in your hands -- a reminder that you're very much in the real world. But what if instead of hitting A to move a rock, you could just use your hands? That's...

Microsoft Research crafts wrist-worn device that tracks hand gestures in 3D space (video)

Microsoft Research crafts wrist-worn device that tracks hand gestures in 3D space (video)

A team led by researchers at Microsoft's UK-based R&D lab has crafted a system that tracks the full 3D pose of a user's hand without the need for a pesky glove. Dubbed Digits, the Kinect-inspired rig latches onto a user's wrist and utilizes a diffuse infrared light, IR laser, camera and inertial measurement unit to track fingertips and just five key points of a hand. Leveraging a pair of mathematical models developed in-house after studying the mechanics of the human hand, the group uses the captured data to extrapolate the position of a user's paw. The team envisions the solution as a supplement to touch-based interfaces, a method for eyes-free control of mobile devices and as a gaming controller that could work in conjunction with Kinect or similar systems. In its current state, the device is composed of off-the-shelf parts and needs to be tethered to a laptop, but the ultimate goal is to create a mobile, self contained unit the size of a wrist watch. Hit the break to catch a video of the setup in action or tap the second source link below for more details in the group's academic paper.

Continue reading Microsoft Research crafts wrist-worn device that tracks hand gestures in 3D space (video)

Filed under:

Microsoft Research crafts wrist-worn device that tracks hand gestures in 3D space (video) originally appeared on Engadget on Tue, 09 Oct 2012 09:50:00 EDT. Please see our terms for use of feeds.

Permalink New Scientist  |  sourceMicrosoft Research, ACM  | Email this | Comments

Akimbo Kinect hack offers precise control with minimal effort (video)

Akimbo Kinect hack offers precise control with minimal effort (video)

We've seen Microsoft's Kinect used in countless ways, but 3Gear Systems means to better these predecessors with the beta release of its SDK, which turns all the subtleties of hand movement into actions. In addition to using two Kinect cameras for accuracy, the software compares hand poses against a pre-rendered database so gesture commands are executed with little lag. It offers complete control of a virtual 3D environment from the comfort of your natural desk position, so you won't have to worry about flail fatigue after long stints. A free public beta is available now until November 30th, at which point bigger companies will require a license, while individuals and small enterprises will continue to get complimentary access. We know what you're thinking -- it's just another Kinect hack -- but we suggest you reserve judgment til you've seen the demo below, showing examples of how the API could be used for CAD, medical, and of course, gaming applications.

Continue reading Akimbo Kinect hack offers precise control with minimal effort (video)

Filed under: ,

Akimbo Kinect hack offers precise control with minimal effort (video) originally appeared on Engadget on Thu, 04 Oct 2012 00:36:00 EDT. Please see our terms for use of feeds.

Permalink GamesBeat  |  source3Gear Systems  | Email this | Comments

Google patent application could give Project Glass one true ring controller to rule them all

Image

Let's face it: right now, the head nods and other rudimentary controls of Google's Project Glass are mostly useful for looking good, sharing photos and not much else. A US patent application submitted last September and just now published, however, raises the possibility of more sophisticated control coming from your hands. A ring, a bracelet or a even a fake fingernail with an infrared-reflective layer would serve as a gesture control marker for a receiver on heads-up display glasses. Having this extra control would give the glasses-mounted computing room to grow by learning gestures, and it could even depend on multiple ornaments for more sophisticated commands -- at least, if you don't mind looking like a very nerdy Liberace. We can imagine the headaches a hand-based method might cause for very enthusiastic talkers, among other possible hiccups, so don't be surprised if Project Glass goes without any kind of ring input. That said, we suspect that Sauron would approve.

Google patent application could give Project Glass one true ring controller to rule them all originally appeared on Engadget on Fri, 18 May 2012 12:03:00 EDT. Please see our terms for use of feeds.

Permalink DVICE  |  sourceUSPTO  | Email this | Comments

Sign language translator turns gestures into spoken letters, makes for a better world (video)

Image

By far one of the greatest challenges of sign language has been to translate it for everyday folk that wouldn't know where to begin a conversation with the deaf. Cornell University engineering students Ranjay Krishna, Seonwoo Lee and Si Ping Wang -- along with some help from Jonathan Lang -- used their final project time this past semester to close this gap in one of the more practical solutions we've seen to date. Their prototype glove uses accelerometers, contact sensors and flex sensors to translate complex finger gestures from the American Sign Language alphabet into spoken letters: after converting hand positions to digital signals, the test unit both speaks out the resulting letters and sends them to a computer, where they can be used for anything from a game (shown in the video below) to, presumably, constructing whole sentences. Along with being accurate, the Cornell work is even designed with a mind towards how it would work in the real world, as the glove and its transmitter are both wireless and powered by 9-volt batteries. We hope that the project leads to a real product and an extra bridge between the deaf and the rest of us, but in the meantime, we'll be happy that at least one form of powered glove is being put to the noblest use possible.

Continue reading Sign language translator turns gestures into spoken letters, makes for a better world (video)

Sign language translator turns gestures into spoken letters, makes for a better world (video) originally appeared on Engadget on Tue, 15 May 2012 07:45:00 EDT. Please see our terms for use of feeds.

Permalink   |  sourceSign Language Translation (Cornell)  | Email this | Comments