Evaluating Amazon’s Mechanical Turk as a Tool for Experimental Behavioral Research

A new paper from the lab with Matt Crump was published in PLOSOne today. The paper attempts to replicate a large number of classic findings in cognitive psychology online using Amazon Mechanical Turk. Most of the replications were successful, but a number of important lessons about online data collection are shared.