Mechanical Turk Launches Categorization App
Mechanical Turk Launches Categorization App
Written by Lucy Black   
Wednesday, 23 May 2012

Amazon's Mechanical Turk has just introduced a Categorization App that should make it easier to get accurate results on categorization projects.

Given that Mechanical Turk has been going since 2005 it is a bit surprising that it has taken so long to devise an app that streamlines the process of specifying a categorization task - but then this crowdsourcing venture that recruits ten of thousands of "workers" to complete "HITs" - Human Intelligence Tasks for "Requesters" is still in beta.

The new facility is designed to help Requesters who have tasks that involve categorization. This type of project is a common one on Mechanical Turk and is often used by organizations to clean dirty data. According to the blogpost announcing the new app:

Categorization is one of the most common use cases for Mechanical Turk.  A categorization HIT is one that asks a Worker to select from a list of options.  Categorization projects are used by many companies for many different reasons. For instance, a retailer‘s categorization project may ask Workers to "Select the product category for this item.”  A listing or directory service may ask Workers “Is this the correct web address for this business?” Or a stock photo site may ask Workers “Is this image a photo or illustration?”

The app is intended to help with every part of defining the HIT - including recruiting pre-qualified Master Worker, eliminating the step of devising a test to screen Workers before accepting them and also providing a pricing recommendation. Essentially it uses forms to go through the steps of supplying categories and providing instruction without requiring Requesters to edit HTML to add radio buttons and label.

The App also arranges that a HIT will be completed by two Master Workers because experience has shown that when two Masters agree on an answer, there is a higher level of accuracy. And where there's disagreement the  instructions can be modified to clarify what is required.

The new app should make Mechanical Turk more attractive to new Requesters and, by encouraging Workers to become Categorization Masters who will receive fair remuneration based on the complexity of the task, should also appeal to Workers.


More Information

Announcing the Mechanical Turk Categorization App

Mechanical Turk

Related Articles

Crowd sourcing replaces journalists


To be informed about new articles on I Programmer, subscribe to the RSS feed, follow us on Google+, Twitter, Linkedin or Facebook, install the I Programmer Toolbar or sign up for our weekly newsletter.



Pivot Podcast Concludes - What Will Be Revealed?

The eighth episode of GE's Pivot Podcast has just been released. Will Sam and Ethan find the answers they need to launch DroneAble, which has grown in concept from an app to a start up company?

Project Oxford Extends Reach

Microsoft Research has provided a public beta of LUIS, Language Understanding Intelligent Service, the fourth element of Project Oxford. Meanwhile beta versions of the other three SDKs are now av [ ... ]

More News


blog comments powered by Disqus  

Last Updated ( Wednesday, 23 May 2012 )

RSS feed of news items only
I Programmer News
Copyright © 2015 All Rights Reserved.
Joomla! is Free Software released under the GNU/GPL License.