dclayh comments on Extraterrestrial paperclip maximizers - Less Wrong

3 Post author: multifoliaterose 08 August 2010 08:35PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (157)

You are viewing a single comment's thread. Show more comments above.

Comment author: dclayh 08 August 2010 09:29:28PM 4 points [-]

I don't think it's even that hard. Presumably an arbitrarily stronger intelligence could build arbitrarily subtle disaster-making flaws into whatever "helpful" technology/science it gives us. They could even have a generalized harmful sensation, as was discussed in another thread recently.

Comment author: magfrump 08 August 2010 10:30:59PM 0 points [-]

See the first chapter of Vinge's "A Fire Upon the Deep" for an example of arbitrarily subtle disaster-making flaws.