You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

timtyler comments on Amending the "General Pupose Intelligence: Arguing the Orthogonality Thesis" - Less Wrong Discussion

2 Post author: diegocaleiro 13 March 2013 11:21PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Article Navigation

Comments (22)
Tags: goals morality orthogonality convergence

Comments (22)

You are viewing a single comment's thread. Show more comments above.

Comment author: timtyler 17 March 2013 04:28:12PM *  0 points [-]

The Orthogonality Thesis:

Intelligence and final goals are orthogonal axes along which possible agents can freely vary. In other words, more or less any level of intelligence could in principle be combined with more or less any final goal.

It seems true - but pretty irrelevant. We mostly care about real world agents - not what could "in principle" be constructed. It's a kind of weasel wording - no doubt intended to provoke concern about evil geniuses.

Powered by Reddit Powered by Reddit