AquaTop Display - A True Immersive Interface
Written by David Conrad   
Sunday, 11 August 2013

This is another simple idea with results that go well beyond what you might expect. Take a tub of cloudy water, a projector, a Kinect to sense objects on its surface and you have the first "immersive" interface - literally. You can place your hands in the water and play with the virtual objects projected onto it. See it!

 

If you put some bath salts in a tub of water the result is a milky liquid, which makes a really good projection surface - so why not project something on to it. This is what the team at Tokyo's University of Electro-Communications Koike Laboratory and the results are more impressive than you might expect.

A projector and a Kinect depth camera work together with some software to allow the user to interact with the water in some amazing ways.

 

aquatopsetup

 

To start off with the Kinect can track the hand and finger positons so that it can interpret gestures. If the system projects photos on the surface, for example, you can move them around, resize them using the usual two-finger pinch, but you can also pick them up in cupped hands and transfer them somewhere else. The gesture I really liked was "sink to delete" - yes, that's often how I feel about a file.

But there is more.

Add some waterproof loudspeakers under the surface and allow the computer to run them at low frequency. The result is that you can now make the surface "boil" in response to the sound. You can make fountains of water appear and project the right colors onto it to make it look like an explosion. The same system can provide haptic feedback so that you feel the water as you push against in different ways. Put all of this together and you have the first water-based shoot-em-up. Throw bolts of fire at squid that explode when hit. It looks fun, if slightly wet.

Watch the video and be patient, it's a slow start but well worth the wait: 

 

You have to admit its impressive. It looks fun and who wouldn't want to have a go at the games. But water? It is difficult to imagine a way that AquaTop could make it as a mainstream (pun intended) interface. So nice idea but...

What about using a non-Newtonian fluid-like cornstarch? Then the loudspeakers could instantly change the viscosity of the fluid You could be moving through it like water one minute and then have it set like concrete around your hand. The same Kinect-based feedback might just make it interesting. 

 

aquatop

 

What AquaTop does demonstrate is that we haven't yet seen the end of novel ideas using the Kinect.

 

More Information

AquaTop

Related Articles

Kinect Fusion Coming to the SDK 

All About Kinect

Open Source Kinect Fusion - Instant Interactive 3D Models

Avatar Kinect - a holodeck replacement

A Kinect Princess Leia hologram in realtime

Kinect augmented reality x-ray (video)

Kinect flies

Kinect plus a glass wedge gives ...

Kinect makes you Superman

Kinect goes self aware - a warning

Kinect for Microsoft Robots

Kinect knows what you are doing... 

 

To be informed about new articles on I Programmer, install the I Programmer Toolbar, subscribe to the RSS feed, follow us on, Twitter, FacebookGoogle+ or Linkedin,  or sign up for our weekly newsletter.

 

espbook

 

Comments




or email your comment to: comments@i-programmer.info

 

Banner


Data Wrangler Gets Copilot Integration
11/11/2024

Microsoft has announced that Copilot is being integrated into Data Wrangler. The move will give data scientists the ability to use natural language to clean and transform data, and to get help with fi [ ... ]



OpenAI Library For .NET Exits Beta
19/11/2024

A few months ago the OpenAI .NET library was released as a beta. It has now reached version 2.0.0 and the time has come to leave beta and, with a few amendments enter production readiness.


More News

 

Last Updated ( Sunday, 11 August 2013 )