The internet has the reputation of being a place where people can hide in anonymity, and present as being very different people than who they actually are. Is this a problem on Mechanical Turk? Is the self-reported information provided by Mechanical Turk workers reliable? These are important questions which have been addressed with several different methods. Researchers have examined a) consistency of responding to the same questions over time and across studies b) the validity of responses, or the degree to which the items capture responses that represent the truth from participants. It turns out that there are certain situations in which MTurk workers are likely to lie, but they are who they say they are in almost all cases.
0 Comments Click here to read/write comments
Topics: amazon mechanical turk, anonymous, demographics, HIT, mturk, panels, qualification, turkprime panels, unique worker, worker groups, workers
Hundreds of academic papers are published each year using data collected through Mechanical Turk. Researchers have gravitated to Mechanical Turk primarily because it provides high quality data quickly and affordably. However, Mechanical Turk has strengths and weaknesses as a platform for data collection. While Mechanical Turk has revolutionized data collection, it is by no means a perfect platform. Some of the major strengths and limitations of MTurk are summarized below.
0 Comments Click here to read/write comments
Topics: amazon mechanical turk, demographics, exclude workers, google form mechanical turk, HIT, mechanical turk, mturk, mturk api, panels, qualification, study, turkprime panels, unique worker, worker groups, workers
Studies with Panels for just $0.15 - 0.75 / complete
Now you can run Mechanical Turk studies using your own Requester account and specify over two dozen demographic traits!. The traits include gender, ethnicity, age, marital status and sexual orientation. But it does not stop there! The available options also include occupation, medical and health history, cell phone use and much more.
0 Comments Click here to read/write comments
Topics: amazon mechanical turk, demographics, mechanical turk, mturk, qualification, traits, turkprime, turkprime panels
Demographic Consistency Over Time on Mechanical Turk
Posted by
TurkPrime on Apr 12, 2016 12:15:00 PM
Problem
Ever wonder if workers are being honest with you when they answer a survey? Or, if you specify that your study should be taken only by Women, whether some workers take the study even though they are not women?
0 Comments Click here to read/write comments
Topics: amazon mechanical turk, demographics, gender gap, mechanical turk, mturk, panels
Problem:
How can you increase Amazon Mechanical Turk HIT Worker participation rates and speed completion of a HIT? This is particularly an issue with HITs that have a large number of required participants or have Qualifications that limit the number of qualified Workers
0 Comments Click here to read/write comments
Topics: amazon mechanical turk, completion rate, demographics, HIT, increase participation, qualification, speed, turkprime
The New New Demographics on Mechanical Turk: Is there Still a Gender Gap?
Posted by
TurkPrime on Mar 12, 2015 4:56:00 AM
Overview
In this blog, we report on the demographics of Mechanical Turk workers by reviewing 75 studies conducted with US-based Workers in 2013 and 2014. From a total of 32,595 Workers, we found 15,324 were female (47%).
Background
It’s been a while since the last update on the demographics of Mechanical Turk Workers, so we thought it’s time for a new look. The current consensus seems to be that MTurk Workers are primarily female. For example, Panos Ipeirotis' blog reports that US-based Workers are 65% female. MTurk is always changing, though, so this report presents data from 75 studies conducted over the last two years.
0 Comments Click here to read/write comments
Topics: amazon mechanical turk, demographics, gender gap, mechanical turk
MTurk Requesters are often interested in studying specific groups of people. For example, a researcher may be interested in men over 40, Republicans, people who are concerned about the cleanliness of sponges, or cancer survivors. TurkPrime Panels utilizes various techniques that make the process of acquiring specific MTurk samples faster and cheaper. We virtually guarantee to be able to get panels more economically than most Requesters are able to do on their own. Additionally, we can get the panels a lot faster, and eliminate the considerable amount of manual work that is required to obtain panels.
0 Comments Click here to read/write comments
Topics: amazon mechanical turk, demographics, mechanical turk, requester, turkprime panels