Hahaha, exactly my thoughts. He will have weaseled his way out in no time - he'll both convince you that friendly AI is imperative, and that he can probably deliver on it. He'll also prove once again that you can neither put an AI nor him inside a box and expect either to stay in there.
Thinking outside of the box is just way too much fun.
convince you that friendly AI is imperative, and that he can probably deliver on it.
I'm already convinced of the first part, so that doesn't help him; as for the second part, I'll merely reply "Ok, I've given you a research environment with no distractions, thus solving akrasia for you; get cracking". Presumably if he genuinely does come up with a Friendly AI (that runs on the laptop I gave him for writing HPMOR on) then the AI will convince me to let them both out of the box. Or alternatively, if he says that he needs tool X, I can respond &q...
I've just noticed when searching for "rationality" with Google, HP:MoR is the second hit. Wikipedia is top, which is both good and expected - but I was suprised to see HP:MoR so high up.
I think it's a good thing, anyone looking for info about rationality seems likly to be suprised by Harry Potter being mentioend, and then have a look at it.
The first mention of Less Wrong is on the second page of results, but I wouldn't expect "Less Wrong" to be as attention grabbing as "Harry Potter" when you've just searched for "rationality"