Chip comments on Rebelling Within Nature - Less Wrong

23 Post author: Eliezer_Yudkowsky 13 July 2008 12:32PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (37)

Sort By: Old

You are viewing a single comment's thread.

Comment author: Chip 13 July 2008 01:49:45PM 0 points [-]

Since the human brain is not capable of recursive alteration of it's source code, and remains almost identical to the first conscious brains evolved 100,000 years ago, one must wonder if it is a tool capable of (or appropriate for) designing a friendly AI. In a time when the parabolic rate of increase in information far exceeds any possibility for natural selection to produce brains that do not rely on the evolved emotions and motivations you discuss, how can such a brain be expected to program the AI source code appropriately, when that brain is not capable of doing the same for itself? That is, how can that brain be expected to be capable of choosing what actually is "friendly", in light of its evolved state?

Comment author: Aryn 28 August 2010 11:22:16PM 0 points [-]

Where are you getting not capable?

Comment author: DanielLC 05 September 2010 06:46:00PM 12 points [-]

The human brain isn't even appropriate for arithmetic. If we can manage making AI with it, it's nothing short of a miracle. But we might be able to do it, just like you could probably unscrew something with a hammer. It's entirely the wrong tool for the job, but if it's the only tool you have, perhaps you can make it work.

I don't see how this is relevant to the article.