You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

75th comments on Harry Potter and the Methods of Rationality discussion thread, July 2014, chapter 102 - Less Wrong Discussion

7 Post author: David_Gerard 26 July 2014 11:26AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (370)

You are viewing a single comment's thread. Show more comments above.

Comment author: 75th 18 August 2014 08:43:56AM *  0 points [-]

Apparently word of god is that there is going to be no AI.

I was thinking about this recently, and I realized that maybe it should be kind of obvious why he doesn't usually do fiction about AI: because (he believes, at least, that) the first strong AI is either an instant win condition or instant failure condition for the entire universe, and neither immutable utopia nor irrecoverable catastrophe make for very interesting stories. So anything interesting or uncertain or suspenseful about AI has to be written about disguised as other topics, where things can go wrong but then realistically be set right.

Comment author: skeptical_lurker 20 August 2014 05:00:04PM 0 points [-]

AI is not an instant-win condition, but it would be fairly quick. There could be drama with the AI trying to develop nanotech, (running up against physical speed constraints rather than mental) before some sort of disaster hits, although this does remove agency from the humans who would mostly be following the AI's commands.

I think AI can still be part of a story, provided it's kept towards the final chapter. Developing true self-improving superhuman AI is rather like throwing the ring into Mt Doom - all that remains it to crown the king, mourn the (non-recoverable) dead, and write that everyone lived happily ever after.

Apologies for the self-obsessed diversion, but this is on topic: I'm writing a story which involves not AI but recursively self-improving IA, and I'm beginning to think that this might have been a bad idea for this sort of reason. In my story the situation is somewhat improved by the presence of a good reason why multiple entities begin self-improvement at approximately the same time, which means that conflicts remain. I can't write superintelligent dialogue, but I've handwaved this as saying that most of the character's mental energy is going towards other activities, leaving their verbal IQ within normal human ranges. The remaining problem is that the other characters become rapidly sidelined.