3D Gesture Input
Friday, 06 August 2010

Reality goes one better than Sci Fi with a 3D gestural system that doesn't need special gloves and doesn't make a smudged mess of the screen. You just stand and wave your arms about.

Banner

Microsoft isn't the only one making news with whole body

input systems (Inside Kinect). Now the Fraunhofer Institute has developed a 3D gestural input system that has the advantage that you don't leave smudges on the screen.

The system detects hand and finger positions in real-time and translates them into standard gestures. The system doesn't require the user to wear gloves or special markers and it works with multiple people at the same time. Users move their hands and fingers around in the air in front of a screen or projection system in a very similar manner to the way Tom Cruise did in the Sci Fi movie Minority Report. In this case the reality is better than the Sci Fi as no special gloves are needed in the real system.

mreport

The minority report gestural system needed special gloves!

multitouch

In the real system you just wave your hands around in front of the screen.

The system is described as using the "Time of Flight" algorithm to sense the 3D depth of each object in the scene. The result is a 3D depthmap which can then be processed by image analysis software to track the movement of the hands and individual fingers.  This is very similar to the way Microsoft's Kinect  works. In this case however the aim is to track gestures rather than whole body positions. Currently the software has some difficulty with wristwatches and anything that generates reflections. 

You can see a video of it in action:

 

Further Reading

Inside Kinect

 

Banner


Pure Virtual C++ 2024 Sessions Announced
19/04/2024

Microsoft has announced the sessions for Pure Virtual C++ 2024, which is taking place on April 30th 15:00 UTC. People who sign up will get access to five sessions happening on the day, alongside a ran [ ... ]



Spider Courtship Decoded by Machine Learning
07/04/2024

Using machine learning to filter out unwanted sounds and to isolate the signals made by three species of wolf spider has not only contributed to an understanding of arachnid courtship behavior, b [ ... ]


More News

<ASIN:0596518390>

<ASIN:0321643399>

<ASIN:3540436782>

<ASIN:3540669353>

<ASIN:019852451X>

<ASIN:3642125522>

Last Updated ( Friday, 06 August 2010 )