3D Gesture Input
Friday, 06 August 2010

Reality goes one better than Sci Fi with a 3D gestural system that doesn't need special gloves and doesn't make a smudged mess of the screen. You just stand and wave your arms about.

Banner

Microsoft isn't the only one making news with whole body

input systems (Inside Kinect). Now the Fraunhofer Institute has developed a 3D gestural input system that has the advantage that you don't leave smudges on the screen.

The system detects hand and finger positions in real-time and translates them into standard gestures. The system doesn't require the user to wear gloves or special markers and it works with multiple people at the same time. Users move their hands and fingers around in the air in front of a screen or projection system in a very similar manner to the way Tom Cruise did in the Sci Fi movie Minority Report. In this case the reality is better than the Sci Fi as no special gloves are needed in the real system.

mreport

The minority report gestural system needed special gloves!

multitouch

In the real system you just wave your hands around in front of the screen.

The system is described as using the "Time of Flight" algorithm to sense the 3D depth of each object in the scene. The result is a 3D depthmap which can then be processed by image analysis software to track the movement of the hands and individual fingers.  This is very similar to the way Microsoft's Kinect  works. In this case however the aim is to track gestures rather than whole body positions. Currently the software has some difficulty with wristwatches and anything that generates reflections. 

You can see a video of it in action:

 

Further Reading

Inside Kinect

 

Banner


TornadoInsight Brings The Power Of TornadoVM Inside Intellij
22/02/2024

TornadoInsight is plugin for Jetbrain's popular Intellij IDE for Java developers, that makes working with TornadoVM a much smoother experience.



Ibis 8 Adds Streaming
05/03/2024

Ibis 8.0 has been released with stream processing backends. The new release includes Apache Flink as a streaming backend, and RisingWave, a streaming database backend. There's also a new batch backend [ ... ]


More News

<ASIN:0596518390>

<ASIN:0321643399>

<ASIN:3540436782>

<ASIN:3540669353>

<ASIN:019852451X>

<ASIN:3642125522>

Last Updated ( Friday, 06 August 2010 )