Almost Still Photos - Free Cliplet App From MS Research
Written by David Conrad   
Thursday, 08 March 2012

Microsoft Research has just invented "almost" still photography and you can try it out for yourself with a free to download app that converts video clips into photos with just a hint of movement.

Still photography is an art form but just occasionally you can't help feel that just a little motion would make things better. The impressive picture of the sea breaking on the shore might be even more impressive if one or two waves actually did some breaking. As the team from Microsoft Research puts it:

A still photograph is a limited format for capturing moments that span an interval of time. Video is the traditional method for recording durations of time, but the subjective "moment" that one desires to capture is often lost in the chaos of shaky camerawork, irrelevant background clutter, and noise that dominates most casually recorded video clips. This work provides a creative lens used to focus on important aspects of a moment by performing spatiotemporal compositing and editing on video-clip input. This is an interactive app that uses semi-automated methods to give users the power to create "cliplets"—a type of imagery that sits between stills and video from handheld videos.

 

It sounds like an appealing idea. Now with the help fo Microsoft Research, some clever image processing and the resulting Cliplet application, you can take a video clip and convert it into a Cliplet. All you have to do is download the app and then drag-and -drop a video clip onto the work area. Next you simply outline areas that you want to be still or moving. The idea is that you can map which parts of the video display for which relative time periods in the finished cliplet. So you can pick out one part of the video to move against a frozen background, say, or you can create short loops of motion,  or ... To be honest it all becomes much more obvious if you just watch the video of how it is achieved:

            

The clever algorithms do the work of segmenting the video, stabilizing the images and putting the whole thing together without the joins showing. 

Is this a good idea?

There is never any problem with trying to reinvent photography and, even if the current examples aren't impressive, it doesn't mean that a creative person couldn't do something amazing with the algorithms we give them. However, on the current showing the cliplet either seem to be a novelty, a bit like birthday cards that play a tune, or they seem slightly spooky, like the example of the girl whose hair and a tiny piece of clothing move in the breeze.

 

Cliplet

 

Perhaps all it needs is a genius to raise it up to high art, but if it is going to catch on I think the process will have to be made even easier than it currently is. Perhaps we need a camera that takes cliplets directly.

More Information

Cliplet Home

Tutorials

Gallery

Further Reading

New Algorithm Takes Spoilers Out of Pics

Light field camera - shoot first, focus later

 

espbook

 

Comments




or email your comment to: comments@i-programmer.info

 

To be informed about new articles on I Programmer, subscribe to the RSS feed, follow us on Google+, Twitter, Linkedin or Facebook or sign up for our weekly newsletter.

Banner


Firefox 1.0 Released 20 Years Ago
10/11/2024

A news item with the headline "Firefox browser takes on Microsoft" from 20 years ago has attracted renewed attention. It was originally published on the BBC News website on November 9th, 2004 rec [ ... ]



GitHub Universe AI Announcements - Copilot And Spark
30/10/2024

GitHub has announced several improvements for developers at Universe, its annual conference. Developers will get multi-model Copilot and GitHub Spark, an AI-native tool for building applications in na [ ... ]


More News

Last Updated ( Thursday, 08 March 2012 )