Flying Neural Net Avoids Obstacles
Written by Harry Fairhead   
Saturday, 03 November 2012

Quadrotors do some impressive things, but so far they haven't managed the trick of flying free and avoiding obstacles. Now we have a quadrotor that can do just this and using only a standard video camera.

Cornell's Ashutosh Saxena is using just one video camera on board a commercial quadrotor to allow it to obtain 3D data on the terrain it is flying over and use that data to avoid smashing into trees, poles and fences. If you take a look at the video you can't help but be impressed. However, what it really important about this demonstration is that it is all being done using a neural network that learned how to avoid obstacles. The network isn't a run of the mill feedforward network, but a linear-leak integrate and fire LLIF neuronal net.

The network was trained by being shown lots of 2D photos. Notice that no depth field cameras or stereo pairs of cameras were used - the network learned to understand depth cues present in a 2D photo.

quadrotornet1

 

At the moment the hardware is still being constructed and the quadrotor sent pictures back to a laptop that simulated the network. Network latency means that there is a lag between taking the picture and getting back a decision on where to fly. When the hardware is complete it should enable the quadrotor to fly on its own and avoid obstacles. Given the low power consumption and low cost it could give the ability to fly autonomously to almost anything. The potential uses in reconnaissance and rescue situations are obvious.

Take a look at it in action:

 

It even manages to avoid a complex looking stream of people, which given its size is probably a good thing. The final scene, where a student looks back at it in only slight amazement, does indicate the quadrotors must be a common thing on the Cornell campus.

It can even navigate inside buildings in corridors and stairwells as demonstrated in the next video:

 

 

quadrotornet2

More Information

Low-Power Parallel Algorithms for Single Image based Obstacle Avoidance in Aerial Robots,
Ian Lenz, Mevlana Gemici, Ashutosh Saxena. In International Conference on Intelligent Robots and Systems (IROS), 2012
 

http://mav.cs.cornell.edu/

Related Articles

Robot Swarms Get Their Own Drones

Quadrotors Play Ball

Robots That Fly - Video

A Spherical Flying Robot

Free Library Converts 2D Image to 3D

A Neural Network Learns What A Face Is

 
 

blog comments powered by Disqus

 

To be informed about new articles on I Programmer, install the I Programmer Toolbar, subscribe to the RSS feed, follow us on, Twitter, Facebook, Google+ or Linkedin,  or sign up for our weekly newsletter.

Banner


1000 Kilobots Make Patterns
17/08/2014

Self organizing swarms are fascinating. If you have grown bored with watching ants or termites do their thing, you can now watch a swarm of 1000 tiny robots making shapes without anyone having overall [ ... ]



Google Frees Up More Patents
28/08/2014

Google has added 152 patents to the list of ones you can copy in your own open-source version and are covered by its OPN Pledge, whereby Google won't sue unless it is sued first.


More News

 

 

 

Last Updated ( Saturday, 03 November 2012 )
 
 

   
RSS feed of news items only
I Programmer News
Copyright © 2014 i-programmer.info. All Rights Reserved.
Joomla! is Free Software released under the GNU/GPL License.