So I took the test. (thanks Morendil) And then I said "huh," and got some friends to take the test.
I got 50%/36%, but my friends got normal numbers, one quite below chance, around 30%/42%.
So this generates some hypotheses: The sensible hypothesis: Due to extra steps and human interaction, the variance of the the results is higher than I or the author anticipated, leading to normal fluctuations getting called "statistically significant."
The fun hypothesis: I'm psychic and my friends aren't.
The obligatory hypothesis: The computer program is flawed, either accidentally or intentionally.
Testing time!
The computer program is flawed, either accidentally or intentionally.
This is clearly a case where I'd want to see the source code. (ETA: seems to be in one of the sub-folders, if I can figure out how what app to open it with.)
But you can fool around with an interesting question: if it was you writing the program with the explicit intent of producing results seeming to clinch the psi hypothesis, by exploiting ambiguities in the verbal description of the experimental setup, how would you do it?
(ETA: one interesting observation, on re-running the program, is that the order of presentation of words the first time through seems not to be randomized.)
Ben Goertzel has a rather long psi-related article in Humanity Plus Magazine, apparently prompted by the recent precognition study to be published in Journal of Personality and Social Psychology. He's arguing that psi is real and we should expect to see the results of this study replicated.