Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

iwdw comments on That Alien Message - Less Wrong

111 Post author: Eliezer_Yudkowsky 22 May 2008 05:55AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (164)

Sort By: Old

You are viewing a single comment's thread.

Comment author: iwdw 23 May 2008 05:11:00AM 0 points [-]

@Unknown: In the context of the current simulation story, how long would that take? Less than a year for them, researching and building technology to our specs (this is Death March-class optimism....)? So only another 150 billion years for us to wait? And that's just to start beta testing.

As for the general question, it shouldn't have one unless you can guarantee it's behavior. (Mainly because you share this planet with me, and I don't especially want an AI on the loose that could (to use the dominant example here) start the process of turning the entire solar system into paperclips because it was given a goal of "make paperclips").

So the moral is that if you do write an AI, at the very least get a corporate account with Staples or Office Depot.