If you have been frustrated with the lack of an open source skeleton tracking system for the Kinect your wait is over.

Currently there is an open source driver available for the Kinect, or you can use Microsoft's Kinect SDK for Windows, which is free to use commercially as long as you buy a Windows Kinect to work with it. The Microsoft SDK includes a high quality skeleton tracker and there is also a similar free-to-use skeleton tracker in the OpenNI framework. However, if you wanted to get inside the code and modify it, you were out of luck.

Skeltrack is the first alternative open source alternative. It has been implemented by a Spanish company Igalia based on the ideas described in this paper by Andreas Baak. The new skeleton tracker, however, doesn't make use of a pose database. Instead it is just a set of heuristic features. This approach means that the user doesn't have to start of with a special initialization position for the tracker to lock on to. The features are simply computed and the location of the joints returned.

Microsoft spent a large amount of computing time using machine learning to derive its joint detection features, so it is likely to be difficult to construct good features heuristically.

The resulting program provides an asynchronous tracking API using GLib and supports single user tracking with up to 7 joints - head, shoulders, elbows and hands. It uses the same company's open source wrapper for the Open Frameworks.

The big drawback of the system at the moment is that it only works if the user is the only object in the scene. That is, it requires a background subtraction to work properly. As the creators say in a  recent blog post:

Skeltrack is in its early beginnings and we want to detect more skeleton joints and work on stabilizing the results so, its features and API might change in the future.

You can see the Skeltrack in action in the demo video below:

Creating such technically difficult software without the resources of a company like Microsoft is a tough task  for the open source movement. Let's hope that it can be fine tuned and made as efficient as the Microsoft machine learning version.

If you know of any other attempts to build a skeleton tracker let us know.

More Information

A Data-Driven Approach for Real-Time Full Body Pose Reconstruction from a Depth Camera

Announcing Skeltrack

Igalia

Related Articles

Practical Windows Kinect in C# - ebook

Avatar Kinect - a holodeck replacement

A Kinect Princess Leia hologram in realtime

Kinect augmented reality x-ray (video)

Kinect flies

Kinect plus a glass wedge gives ...

Kinect makes you Superman

Kinect goes self aware - a warning

Kinect for Microsoft Robots

Kinect knows what you are doing...

Comments

Make a Comment or View Existing Comments Using Disqus

or email your comment to: comments@i-programmer.info

To be informed about new articles on I Programmer, subscribe to the RSS feed, follow us on Google+, Twitter, Linkedin or Facebook or sign up for our weekly newsletter.

<ASIN:B006UIS53K@COM>

<ASIN:B0078LMS72@UK>

<ASIN:B002BSA298@COM>

<ASIN:B0036DDW2G@UK>

<ASIN:B0036DDW2G@FR>

<ASIN:B002BSA298@CA>

<ASIN:B003H4QT7Y@DE>

<ASIN:B00499DBCW@IT>