3D Gesture Input
Friday, 06 August 2010

Reality goes one better than Sci Fi with a 3D gestural system that doesn't need special gloves and doesn't make a smudged mess of the screen. You just stand and wave your arms about.

Banner

Microsoft isn't the only one making news with whole body

input systems (Inside Kinect). Now the Fraunhofer Institute has developed a 3D gestural input system that has the advantage that you don't leave smudges on the screen.

The system detects hand and finger positions in real-time and translates them into standard gestures. The system doesn't require the user to wear gloves or special markers and it works with multiple people at the same time. Users move their hands and fingers around in the air in front of a screen or projection system in a very similar manner to the way Tom Cruise did in the Sci Fi movie Minority Report. In this case the reality is better than the Sci Fi as no special gloves are needed in the real system.

mreport

The minority report gestural system needed special gloves!

multitouch

In the real system you just wave your hands around in front of the screen.

The system is described as using the "Time of Flight" algorithm to sense the 3D depth of each object in the scene. The result is a 3D depthmap which can then be processed by image analysis software to track the movement of the hands and individual fingers.  This is very similar to the way Microsoft's Kinect  works. In this case however the aim is to track gestures rather than whole body positions. Currently the software has some difficulty with wristwatches and anything that generates reflections. 

You can see a video of it in action:

 

Further Reading

Inside Kinect

 

Banner


JetBrains Makes WebStorm and Rider Free for Non-Commercial Use
24/10/2024

JetBrains has launched a non-commercial license for its JavaScript and TypeScript IDE, WebStorm, and for Rider, its cross-platform .NET and game development IDE.



Google Updates Responsible AI Toolkit
01/11/2024

Google has announced updates to the Responsible Generative AI Toolkit to enable it to be used with any LLM model. The Responsible GenAI Toolkit provides resources to design, build, and evaluate open A [ ... ]


More News

<ASIN:0596518390>

<ASIN:0321643399>

<ASIN:3540436782>

<ASIN:3540669353>

<ASIN:019852451X>

<ASIN:3642125522>

Last Updated ( Friday, 06 August 2010 )