dclayh comments on Extraterrestrial paperclip maximizers - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (157)
I don't think it's even that hard. Presumably an arbitrarily stronger intelligence could build arbitrarily subtle disaster-making flaws into whatever "helpful" technology/science it gives us. They could even have a generalized harmful sensation, as was discussed in another thread recently.
See the first chapter of Vinge's "A Fire Upon the Deep" for an example of arbitrarily subtle disaster-making flaws.