psiturk (@psiturk) profile picture

an open platform for science on mechanical turk

gureckislab, new york
Joined December 2013
Photo by psiturk (@psiturk)Photo by psiturk (@psiturk)
Long thought to be a mystery for the ages, there is now some initial documentation on how to add custom functionality to your psiturk experiments. Basic infrastructure lets you auto-compute bonuses, fit models in real time, and add dataviz to exp psiturk.readthedocs.io/en/la…
1
3
yes, we are down thanks to an upgrade at our data center. hold tight.
Great tutorial on using psiTurk and Docker by Adam Liter atomicwriting.com/tutorials/…
1
6
good news: #psiturk has over 1250 registered users. why 1250? because that’s where we set the cap many years ago assuming we’d never get this far. so if u registered lately and were told to wait... sorry. cap just increased so a few more spaces! try again!
1
1
9
Beating MTurks bots sounds easy, they are probably dumb bots: 1) Captcha (can be home-made: draw 1 of 30 random images of numbers you made) 2) Require typing some fact: "Capital of Chile?", "7 plus fourteen"
7
6
2
27
if you are using mturk sensibly there is, practically speaking, no way a bot could even complete your HIT.
People are noticing quality drops in online studies in recent weeks, including what appears to be bot-like behaviors. I have noticed that as well. You might want to make sure you filter the data appropriately facebook.com/groups/psychmap…
1
nosub: a simple new command-line tool for web experiments on mechanical turk, developed for my lab by @longouyang babieslearninglanguage.blogs… with help from @elManuBohn
1
23
2
44
we went down for a few hours because were getting kinda popular. we’re back. all good. but, like, a lot of pressure to be so many peoples implicit #cogsci2018 coauthor! 😬
7
Damn. I want to use @psiturk just because their website, featuring @kylanlarson's illustrations, is so wonderful. Why don't all science tools look like this? psiturk.org/
2.2.0 out with cool features like.. a major bug fix! allow repeat participation! let ad server know about reverse proxy servers!
1
3
Contribute to #openscience by joining our team! Job postings for a Front & Back End Developer & Support specialist: ow.ly/cesj3055inV
61,234 unique workerids have participated in psiturk experiments to date. psiturk has been launched over 85,000 times.
use psiturk in your research? consider sharing code from your experiments on the exchange. easiest way to give back psiturk.org/ee/
1
Breadboard is a tool for doing group experiments online breadboard.yale.edu/
2
Crump et al. (2013): “We recommend that… all Internet experiments report dropout rates as a function of condition.” gureckislab.org/papers/Crump…
1
4
New paper on the biasing effect of dropouts from web studies. @psiturk tracks this folks!! faculty.chicagobooth.edu/aye…
2
2
1
Please read our paper before tweeting like we're sharing the same 7,300 MTurkers. That Science piece is misleading journal.sjdm.org/14/14725/jd…
4
5
7,300 is our estimate of the population the *average lab* can access. NOT an estimate of N of active MTurk workers! sciencemag.org/news/2016/06/…
12
10
correction 2 science article. @psiturk developed by Gureckis+TRUCKLOAD OF OPEN SCIENCE HACKERZ who keep making it better. see thanks.md
2