@NeerajaGupta6 Just got around to reading this -- excellent work and super helpful! Did you condition on approval ratings for MTurk recruitment (e.g., https://t.co/VVaQvlWlRb)? I couldn't find in paper, but quite the endorsement for Prolific over MTurk if
@baobaofzhang @hakeemjefferson This paper (https://t.co/L7MIIF6XYn) suggests reputation is sufficient for high quality data. I always set approval at 90% and pay good wages. I've never been disappointed by MTurk.
@EThulin @AdamBerinsky @lucid_hq Unclear how bad it is v. other platforms like @YouGov that source from similar pool and charge 10x the price. On @lucid_hq you can screen out folks that fail ACQ and not pay for that sample. Possible MTurk is different due
@ylelkes Approval rate, which is likely a function of previous attention, predicts (or at least it did few years ago) passing attention checks. Context will definitely matter but there are better workers than others https://t.co/BiYAc5V9Ig
RT @Psychonomic_Soc: #tbt #ThrowbackThursday this month in 2015 @jasonrfinley wrote a post on a #psynomBRM paper by @Eyal_Pe_er et al. on @…
RT @Psychonomic_Soc: #tbt #ThrowbackThursday this month in 2015 @jasonrfinley wrote a post on a #psynomBRM paper by @Eyal_Pe_er et al. on @…
#tbt #ThrowbackThursday this month in 2015 @jasonrfinley wrote a post on a #psynomBRM paper by @Eyal_Pe_er et al. on @amazonmturk data quality Post: https://t.co/2yQV7xbl6g Paper: https://t.co/3YSgGqJBH2 (accessed 5518 times and cited 387 times!) @Sprin
@haldaume3 This recent paper found that reputation is quite good to ensure high quality data. It makes little difference whether you add the attention checking questions (ATQs) https://t.co/BwzyhR7fSF
Damn! I wish I'd seen this before launching this morning with an approval rating of 80%! I may have just wasted $2500 for me and my co-author. Bummer!
@sTeamTraen Ex. http://t.co/AxIA56V536, http://t.co/gYRaMsJMp0, fn14 here: http://t.co/74WiNoFpqE @lakens @BrianNosek @todd_gureckis
High-Reputation Workers Rarely Fail Behavioral Study Attention Checks on Amazon Mechanical Turk: http://t.co/6FIaMeOycT via @SpringerLink
Reputation as a sufficient condition for data quality on Amazon Mechanical Turk http://t.co/xX4QVhj1A9
“@ScottClif: Evidence attention checks may be unnecessary in MTurk studies when using high reputation workers http://t.co/juckoWwdG4
Reputation maybe enough to insure high quality #mturk data http://t.co/IuQnd3jJIH