Attentive Turkers: MTurk participants perform better on online attention checks than do subject pool participants

Amazon MTurkで使えるデータは約2.6%で、残り97%超はbotや不適切反応。 529人取って14人しか使えないというのは衝撃的 https://t.co/gVw1DwpjZg かつてはMTurk被験者の方が良いという話もあったが https://t.co/O8SaaIChPf ここ数年で一気に状況は悪化していそう。 https://t.co/KSDUwXRSqx

RT @YashvinSeetahul: @ln_lbr https://t.co/h2vWPh8LRy https://t.co/spxdLBaEa4 https://t.co/1QQC03DIF9 https://t.co/MwDFc5LUmv https://t.…

You might also be interested in the follow papers on MTurk data quality... https://t.co/3EVRy7qDgZ

Araştırmalarda MTurker'ların kontrol sorularına yanlış cevap verme oranı öğrenci havuzlarına göre düşük çıkıyor. Bu verilen karşılık sebebiyle düzgün cevapladıklarına yorulurdu ama birçok kişi artık bunun öğrenme etkisiyle alakalı olduğunu düşünüyor https:

@ln_lbr https://t.co/h2vWPh8LRy https://t.co/spxdLBaEa4 https://t.co/1QQC03DIF9 https://t.co/MwDFc5LUmv https://t.co/9vaiIVkdUE https://t.co/LvVkg2p1R0

RT @joshtybur: Neat illustration of participants recruited from Amazon Mechanical Turk passing attention checks at a higher rate than parti…

RT @joshtybur: Neat illustration of participants recruited from Amazon Mechanical Turk passing attention checks at a higher rate than parti…

@_dmh @byrd_nick Will do. Also, someone just alerted me to this study, which reported similar findings: https://t.co/jC7dgr5MSp

RT @joshtybur: Neat illustration of participants recruited from Amazon Mechanical Turk passing attention checks at a higher rate than parti…

RT @joshtybur: Neat illustration of participants recruited from Amazon Mechanical Turk passing attention checks at a higher rate than parti…

RT @joshtybur: Neat illustration of participants recruited from Amazon Mechanical Turk passing attention checks at a higher rate than parti…

RT @joshtybur: Neat illustration of participants recruited from Amazon Mechanical Turk passing attention checks at a higher rate than parti…

RT @joshtybur: Neat illustration of participants recruited from Amazon Mechanical Turk passing attention checks at a higher rate than parti…

RT @joshtybur: Neat illustration of participants recruited from Amazon Mechanical Turk passing attention checks at a higher rate than parti…

RT @joshtybur: Neat illustration of participants recruited from Amazon Mechanical Turk passing attention checks at a higher rate than parti…

RT @joshtybur: Neat illustration of participants recruited from Amazon Mechanical Turk passing attention checks at a higher rate than parti…

Neat illustration of participants recruited from Amazon Mechanical Turk passing attention checks at a higher rate than participants recruited at universities. Consistent with other published work (https://t.co/Yc0phUj32r) https://t.co/uPoHg6RqhF

@beckyneuro There is also evidence that online recruitment from crowdsourcers lead to more diverse more attentive participants - so more costly but maybe a better investment :) e.g. https://t.co/04Z1JP8N0P https://t.co/h4IF2PIPM6

@ylelkes @bnbakker @JasonReifler I haven't run nfc in nat sample. Turk maybe a tricky place to run something like you describe. I know Turkers more attentive (https://t.co/xb3I0tjLhT), and more exposed to CRT but this may (https://t.co/tmWQq4wZXA) or may n

RT @NikosNtoumanis: Study found that Turk participants performed better on online attention checks than subject pool participants did; ht…

RT @AppliedBehEcon: Good news for mTurk researchers https://t.co/kZIE3W9jVd

RT @NikosNtoumanis: Study found that Turk participants performed better on online attention checks than subject pool participants did; ht…

RT @AppliedBehEcon: Good news for mTurk researchers https://t.co/kZIE3W9jVd

RT @AppliedBehEcon: Good news for mTurk researchers https://t.co/kZIE3W9jVd

Study found that Turk participants performed better on online attention checks than subject pool participants did; https://t.co/5Hf3dvJC2e

Attentive Turkers: MTurk participants perform better on online attention checks than do subject pool participants https://t.co/xlE1q0lDwx

Good news for mTurk researchers https://t.co/kZIE3W9jVd

@GordPennycook There is research, actually. David Hauser & @aanobs showed MTurkers are more attentive than undergrads https://t.co/l8Q2lmK9yY. Other good options include @prolificac https://t.co/N0nwbs4Yo2

RT @GordPennycook: BRM: Attentive Turkers: MTurk p's perform better on online attention checks than do subject pool p's https://t.co/kQ1mKg…

RT @GordPennycook: BRM: Attentive Turkers: MTurk p's perform better on online attention checks than do subject pool p's https://t.co/kQ1mKg…

RT @GordPennycook: BRM: Attentive Turkers: MTurk p's perform better on online attention checks than do subject pool p's https://t.co/kQ1mKg…

BRM: Attentive Turkers: MTurk p's perform better on online attention checks than do subject pool p's https://t.co/kQ1mKgeSTm #springerlink

Attentive Turkers: MTurk participants perform better on online attention checks than do subject pool… https://t.co/05VSPhG8GT BehResM

Attentive Turkers: MTurk participants perform better on online attention checks than do subject pool participants. https://t.co/VZczZMuLW6

@sTeamTraen Ex. http://t.co/AxIA56V536, http://t.co/gYRaMsJMp0, fn14 here: http://t.co/74WiNoFpqE @lakens @BrianNosek @todd_gureckis

Amazonの Mechanical Turkで集めた実験参加者は教示への注意が高い。 Attentive Turkers: MTurk participants perform better on online… http://t.co/JDdqrdroDc

Amazonの Mechanical Turkで集めた実験参加者は教示への注意が高い。 Attentive Turkers: MTurk participants perform better on online… http://t.co/JDdqrdroDc

Attentive turkers pass attention checks at much higher rate than #manylabs students. http://t.co/ezcJ2uQ9lp #mturk http://t.co/Ufry1uj59W

MTurk participants perform better on online attention checks than do subject pool participants | BRM http://t.co/bEHdnEmmyB #paywall

Attentive turkers pass attention checks at much higher rate than #manylabs students. http://t.co/ezcJ2uQ9lp #mturk http://t.co/Ufry1uj59W

Attentive turkers pass attention checks at much higher rate than #manylabs students. http://t.co/ezcJ2uQ9lp #mturk http://t.co/Ufry1uj59W

Attentive turkers pass attention checks at much higher rate than #manylabs students. http://t.co/ezcJ2uQ9lp #mturk http://t.co/Ufry1uj59W

Attentive turkers pass attention checks at much higher rate than #manylabs students. http://t.co/ezcJ2uQ9lp #mturk http://t.co/Ufry1uj59W

MTurk participants perform better on online attention checks than do subject pool participants. http://t.co/wUHIoLMDsN

Attentive turkers pass attention checks at much higher rate than #manylabs students. http://t.co/ezcJ2uQ9lp #mturk http://t.co/Ufry1uj59W

Attentive turkers pass attention checks at much higher rate than #manylabs students. http://t.co/ezcJ2uQ9lp #mturk http://t.co/Ufry1uj59W

Attentive turkers pass attention checks at much higher rate than #manylabs students. http://t.co/ezcJ2uQ9lp #mturk http://t.co/Ufry1uj59W

Attentive turkers pass attention checks at much higher rate than #manylabs students. http://t.co/ezcJ2uQ9lp #mturk http://t.co/Ufry1uj59W

Attentive turkers pass attention checks at much higher rate than #manylabs students. http://t.co/ezcJ2uQ9lp #mturk http://t.co/Ufry1uj59W

Attentive turkers pass attention checks at much higher rate than #manylabs students. http://t.co/ezcJ2uQ9lp #mturk http://t.co/Ufry1uj59W

Hauser & Schwarz (2015) MTurk participants perform better on online attention checks than do subj. pool participants http://t.co/VmxrILXSdp