You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Elithrion comments on Amending the "General Pupose Intelligence: Arguing the Orthogonality Thesis" - Less Wrong Discussion

2 Post author: diegocaleiro 13 March 2013 11:21PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (22)

You are viewing a single comment's thread.

Comment author: Elithrion 14 March 2013 12:02:15AM *  3 points [-]

Out of curiosity, is rejection of the Orthogonality thesis a common position in philosophy? (If you can make a guess at what percentage of philosophers reject it, that'd be cool.)

I seem to remember always finding it intuitively obvious, so it's difficult for me to understand why someone would disagree with it (except for being a theist, maybe).

Comment author: Larks 14 March 2013 07:42:04PM *  1 point [-]

Moral motivation: internalism or externalism?

Other 329 / 931 (35.3%)

Accept or lean toward: internalism 325 / 931 (34.9%)

Accept or lean toward: externalism 277 / 931 (29.8%)

source

Internalism is the belief that it is a necessary truth that, if A believes X to be wrong/right, A is at least partly motivated to avoid/promote/honour X. Externalism is usually considered to be the denial of internalism, so I don't know what 35.5% of people are talking about. My guess is they meant "don't know".

Comment author: Qiaochu_Yuan 14 March 2013 07:15:54AM 1 point [-]

it's difficult for me to understand why someone would disagree with it

Typical mind fallacy, but with respect to the entirety of mindspace?

Comment author: FiftyTwo 14 March 2013 12:37:29AM 1 point [-]

Someone with a hardcore 'rationalist' position (someone who thought all moral statements could be derived from first principles e.g. a Kantian) would probably reject it, but they're basically extinct in the wild.

Comment author: Qiaochu_Yuan 14 March 2013 07:03:52PM 0 points [-]

In what sense is this a 'rationalist' position?

Comment author: beoShaffer 14 March 2013 07:19:35PM 1 point [-]

In the sense of moral rationalism. The fact that rationalist can be used to refer to rationality or rationalism is unfortunate, but IIRC (to busy to search for it) we've had a few debates about terminology and decided that we currently are using the least bad options.

Comment author: FiftyTwo 14 March 2013 11:01:21PM *  1 point [-]

Indeed. Its a problem of language evolution.

To summarise a few centuries of Philosophy very briefly: A lng tie ago there were Rationalists who thought everything could be proven by pure reason, and Empiricists who depended on observation of the external world. Because Reason was often used in contrast to emotion (and because of the association with logic and mathematics) "Rational" evolved into a general word for reasonable or well argued. The modern rationalist movement is about thinking clearly and coming to correct conclusions, which can't really be done by relying exclusively on pure reason. (Hence why moral rationalists in the original sense don't really exist anymore)

Comment author: timtyler 17 March 2013 04:28:12PM *  0 points [-]

The Orthogonality Thesis:

Intelligence and final goals are orthogonal axes along which possible agents can freely vary. In other words, more or less any level of intelligence could in principle be combined with more or less any final goal.

It seems true - but pretty irrelevant. We mostly care about real world agents - not what could "in principle" be constructed. It's a kind of weasel wording - no doubt intended to provoke concern about evil geniuses.

Comment author: lukstafi 15 March 2013 02:22:54AM 0 points [-]

Try chapter 7 of "Good and Real" by Gary Drescher.

Comment author: shminux 14 March 2013 06:15:59AM 0 points [-]

David Pearce appears to be, judging by his posts here.