Ibex Farm

IbexFarm is a site that hosts online experiment, and it has become increasingly popular among psycholinguists as it is a quick (and relatively cheap) way to collect psycholinguistic data.

Javascript templates and R codes for running and analysing (speeded) acceptability judgment, self-paced reading, lexical decision, and semantic priming tasks are available on my GitHub page, but feel free to drop me a line if you have any urgent request. Here are some suggestions to solving problems that I often run into when doing experiments online (Special thanks to Brian Dillon for sharing his experience with us!).


Got a questions?
  • Read the user manual
  • If you have any question about a very specific problem that you have encountered, or if you find a glitch in the system, try giving it a shout in this Google group.
Annoying syntax errors?
  • The Online Lint is pretty helpful for proofreading the JavaScript documents.
  • Esprima is also a pretty good syntax validator
Counterbalancing didn’t work?
  • There is a potential pitfall when running Ibex Farm experiments with Latin Square design on Amazon Mechanical Turk – details and solutions can be found here.
  • Unfortunately, this still won’t completely solve the problem . What I find useful is to first do what the author suggested (i.e. include setcounter at the beginning of the experiment), and when you are running the experiment, get 80% of your data (which should be determined a priori), check the counterbalancing, and then fill in the underrepresented lists (e.g. if List 1 is underrepresented, replacing “experiment.html” with “server.py?withsquare=1” will give you the link to List 1 only). That way you will (hopefully) end up with a fully counterbalanced set of data.
Chinese characters turned into gibberish?
  • When you download the zip file from your experiment page, the results can be found in a text document and you can easily convert it into a csv or xls(x) file. When opened with Excel, if the file doesn’t show Chinese characters correctly, try this.
Changing css files?
  • most of the time, w3schools has the reference that will tell you how to do the trick!
Need pseudowords?
  • Wuggy: a multilingual pseudoword generator