You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Lumifer comments on Summoning the Least Powerful Genie - Less Wrong Discussion

-1 Post author: Houshalter 16 September 2015 05:10AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (48)

You are viewing a single comment's thread. Show more comments above.

Comment author: Lumifer 18 September 2015 02:44:39PM 0 points [-]

What's the ROI for a super-intelligent, self-aware machine?

That clearly depends on how super is "super-intelligent". For a trivial example, imagine an AI which can successfully trade in the global financial markets.

Comment author: gurugeorge 23 September 2015 05:14:50PM 0 points [-]

What happens if it doesn't want to - if it decides to do digital art or start life in another galaxy?

That's the thing, a self-aware intelligent thing isn't bound to do the tasks you ask of it, hence a poor ROI. Humans are already such entities, but far cheaper to make, so a few who go off and become monks isn't a big problem.

Comment author: Lumifer 23 September 2015 05:18:38PM *  0 points [-]

What happens if it doesn't want to - if it decides to do digital art or start life in another galaxy?

You give it proper incentives :-)

Or, even simpler X-)

Humans are already such entities

Nope, remember, we're talking about a super-intelligent entity.