Rationality Quotes December 2011

Jayson_Virissimo

Here's the new thread for posting quotes, with the usual rules:

Please post all quotes separately, so that they can be voted up/down separately. (If they are strongly related, reply to your own comments. If strongly ordered, then go ahead and post them together.)
Do not quote yourself.
Do not quote comments/posts on LW/OB.
No more than 5 quotes per person per monthly thread, please.

Here's the new thread for posting quotes, with the usual rules:

Please post all quotes separately, so that they can be voted up/down separately. (If they are strongly related, reply to your own comments. If strongly ordered, then go ahead and post them together.)
Do not quote yourself.
Do not quote comments/posts on LW/OB.
No more than 5 quotes per person per monthly thread, please.

I would instead ask "What preferences would this agent have, in a counterfactual universe in which they were fully-informed and rational but otherwise identical?".

Quoting a forum post from a couple years ago...

"The problem with trying to extrapolate what a person would want with perfect information is, perfect information is a lot of fucking information. The human brain can't handle that much information, so if you want your extrapolatory homunculus to do anything but scream and die like someone put into the Total Perspective Vortex, you need to enhance its information processing capabilities. And once you've reached that point, why not improve its general intelligence too, so it can make better decisions? Mayb... (read more)

7

Rationality Quotes December 2011

7

7

7

Rationality Quotes December 2011

7

7