Some workers on MTurk are extremely active, and take the majority of posted HITs. This can lead to many issues, some of which are outlined in our previous post. Although MTurk has over 100,000 workers who take surveys each year, and around 25,000 who take surveys each month, you are much more likely to recruit highly active workers who take a majority of HITs. About 1,000 workers (1% of workers) take 21% of the HITs. About 10,000 workers (10% of workers) take 74% of all HITs.
1 Comment Click here to read/write comments
Topics: active workers, amazon mechanical turk, exclude, exclude workers, HIT, mechanical turk, mturk, online research, turkprime, workers, active
Greetings Reader,
0 Comments Click here to read/write comments
Topics: amazon mechanical turk, online research, primepanels, turkprime
New Feature: Select MTurk Workers by Big Five Personality Types
Posted by
Jonathan Robinson on Oct 31, 2017 11:33:00 AM
Run Studies Targeting Specific Big Five Personality Types
TurkPrime introduces a new Big Five personality types qualification: Now social science researchers can run studies targeted to the Big Five:
0 Comments Click here to read/write comments
Topics: primepanels, turkprime, turkprime panels
Problem
Many researchers wish to target participants from specific states or regions of the United States like the Northeast or the West. The problem they often encounter is that using MTurk's Geographic Qualification to specify a particular state is often not adequate to ensure participants actually reside in the specified state.
0 Comments Click here to read/write comments
Topics: amazon mechanical turk, exclude workers, IP address, IP block, location, region, survey, turkprime
Dynamic Secret Completion Codes for SurveyMonkey and SurveyGizmo
Posted by
TurkPrime on Dec 2, 2016 1:04:00 PM
What is the completion rate and dropout rate?
Dropout rate is defined as the percentage of participants who start taking a study but do not complete it. Dropout rate is sometimes referred to as attrition rate, and is the opposite of completion rate (dropout rate = 100 – completion rate). On MTurk, completion rate is defined as the number of Workers who submit a HIT divided by the number of Workers who accept the HIT. Note that, for the definition of completion rate used here, Rejected Workers are counted as completes.
0 Comments Click here to read/write comments
Topics: amazon mechanical turk, autoapproval, completion code, dynamic, mturk, secret code, surveymonkey, turkprime
How to Create a Universal Exclude Worker List
Posted by
Jonathan Robinson on Sep 9, 2016 10:41:00 AM
Problem:
Requesters may observe that some workers, even those with high Approval ratings, may not perform to their expectations on a study. Sometimes this may result in rejecting their work which affects the Worker approval rating. But, often the work is not acceptable for research but is not worthy of rejection, or, it may simply be the policy of the research lab to approve all assignments for IRB or some ethical standard they may follow.
0 Comments Click here to read/write comments
Topics: amazon mechanical turk, block worker, exclude, exclude workers, mturk, mturk api, qualification, turkprime
Problem:
You are running a longitudinal study and have identified 1000 workers who you want to allow to take your second phase studies. How do you easily group those workers for easy access.
Or you want to exclude certain workers from taking a number of your studies and wish to group them for easy exclusion in future studies. How can you do that?
0 Comments Click here to read/write comments
Topics: amazon mechanical turk, exclude, exclude workers, include workers, Longitudinal, qualification, turkprime, worker groups
Studies with Panels for just $0.15 - 0.75 / complete
Now you can run Mechanical Turk studies using your own Requester account and specify over two dozen demographic traits!. The traits include gender, ethnicity, age, marital status and sexual orientation. But it does not stop there! The available options also include occupation, medical and health history, cell phone use and much more.
0 Comments Click here to read/write comments
Topics: amazon mechanical turk, demographics, mechanical turk, mturk, qualification, traits, turkprime, turkprime panels
Google Forms can be used to deliver a study with TurkPrime in a similar manner to other survey platforms (like Qualtrics and SurveyMonkey).
0 Comments Click here to read/write comments
Topics: google form mechanical turk, google forms, mechanical turk, mturk, secret code, secret key, survey, turkprime
New Safety Feature: Assignment Rejections are not Automated and Require Manual User Action
Posted by
Jonathan Robinson on Feb 19, 2016 10:39:00 AM
Many researchers set up their studies to use the TurkPrime AutoApprove feature so that they do not need to manually approve worker assignments based on the secret code that workers enter. On occasion, a researcher may set up his study incorrectly which results in many worker assignments getting automatically rejected. This was a significant cause for distress among the Mechanical Turk workers who received rejections for their work which then went unpaid and also lowered their MTurk approval rating. This was also a sore point for TurkPrimeresearcherswho had to deal with upset workers and correspond with them, and often reverse their rejections.
0 Comments Click here to read/write comments
Topics: amazon mechanical turk, autoapproval, reverse rejection, study, survey, turkprime