= 27d567bc2d48d9f40e9ccc20ea370b15)
Lumifer comments on Open Thread, Apr. 27 - May 3, 2015 - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (352)
Additionally, I'm a little worried about the control group part. I expect it's relatively easy to recruit people to play a game and have them be motivated to play it, but if I tell people that "oh, but you may be randomly assigned to the control condition where you're given more traditional math instruction instead", I expect that that will drop participation. And even the people who do show up regardless may not be particularly motivated to actually work on the problems if they do get assigned to the control condition, especially given that I'm hoping to also educate people who'd usually avoid maths. How insane would it be to just not have a control group?
So, there is this blog/forum which tries to teach people rationality! and science! and proper ways to solve problems! It even hopes to raise the sanity waterline.
And then "oh, but it's inconvenient..." X-/
There's the extent to which I'm willing to go to raise the sanity waterline, and then there's the extent to which I'm willing to go for the sake of possibly improving my grade on a work whose final grade nobody will really ever care about.
That might not be the most productive mindset. If you show that your game works at teaching Bayes, I would expect people to refer to your thesis from time to time.
In this case I don't quite understand what are you asking.
LW is unlikely to know whether your adviser / committee will consider the absence of a control group acceptable enough for this project.
You're right, I wasn't very clear on my objectives. Also, my previous comment was needlessly snarky, for which I apologize.
To be honest, I'm not very sure of what I want, myself. I have reason to believe that they'll consider it acceptable regardless of whether there's a control group or not (this being the CS department and not the psych one), so that's not actually an issue. And I've got some desire to do things "properly", for its own sake, and also because it might be fun to do this well enough to turn it into a real publication. But I'm also swamped with a bunch of other stuff and don't have a chance to spend too much effort on this.
So, I guess I dunno what I'm asking, myself.
How about going to the office hours of a professor in the psychology department and ask them for advice on how to run your study?
Your question made me go d'oh, in that I suddenly remembered that there's an obvious place right nearby to ask help from, both for designing the study and recruiting test subjects. I'll talk with them, thanks.
Speaking very practically - who will be marking/grading your project?
If psychologists aren't going to be looking at it, it's surely going to be fine to do the intervention as best you can and then discuss implications and limitations (including need for control group) in whatever you have to write up. It's not going to be publishable but then you can deal with that later, depending on your circumstances this would probably mean re-doing the study with random assignment to conditions, starting with your project study as a pilot/proof of concept.
It's going to be graded by computer scientists, so yeah, I can get away with a less rigorous protocol than what psychologists would insist on. (And then collaborate with actual psychologists with more resources later on.)